Lead Software Engineer - Big Data
FINRA
Rockville, MD (Job Posting)
Full-Time
$114,200
RemoteManager
Essential Job Functions:
Collaboration:
Essential Technical Skills:
Big Data Technologies: Extensive hands-on experience with Hadoop, Spark, Hive, and Trino for processing petabyte-scale datasets. Proven ability to diagnose and resolve data skew, resource limitations, scalability challenges, and job failures in production environments.
Apache Spark Expertise: Deep understanding of Spark architecture including executors, tasks, stages, and DAG execution. Demonstrated proficiency in performance tuning techniques such as partitioning strategies, caching, broadcast joins, and optimization of large-scale data processing jobs.
SQL Mastery: Advanced proficiency in complex SQL including window functions, multi-table joins, aggregations, and query optimization. Experience handling edge cases involving NULLs, duplicates, and ordering in production environments.
Cloud Technologies: Strong experience with AWS services including S3, EMR, Glue, Lambda, Athena, EKS, and serverless architectures. Practical knowledge of file format optimization, consistency management, and cloud-based data processing workflows.
Programming (Python/Scala): Proficiency in writing clean, modular, and performant code using Python or Scala. Strong understanding of functional programming concepts (immutability, higher-order functions), collections, concurrency, and memory management for scalable data processing.
AI Tool Proficiency: Hands-on experience with AI development tools (GitHub Copilot, Q Developer, ChatGPT, Claude, etc.) and AI workflow design. Proven ability in prompt engineering and leveraging AI coding assistants for enhanced productivity.
Agile Methodology & Change Management: Extensive experience with Scrum, Kanban, and continuous improvement practices. Demonstrated experience leading teams through AI adoption, technology transformation, and workflow optimization initiatives.
System Design & Architecture: Strong system design experience with ability to architect scalable, distributed data processing solutions and enterprise-level applications.
Object-Oriented Development: Strong experience in object-oriented programming principles, design patterns, and software engineering best practices.
Data Storage Technologies: Strong experience with modern data storage solutions, database technologies, and data modeling approaches for both relational and NoSQL systems.
Performance Tuning & Optimization: Demonstrated expertise in identifying bottlenecks and optimizing application and data processing performance across the full stack.
DevOps & CI/CD: Strong experience with DevOps practices, continuous integration, continuous deployment pipelines, and infrastructure as code.
Software Security: Strong understanding of security best practices, secure coding principles, and application security across all layers.
Data Analysis & Insights: Ability to interpret AI-generated insights and >
For work that is performed in CO, FL, TX, IL, PA, MA, MD, VA, Washington, DC, NY and NJ, please refer to the chart below for the salary range for the corresponding location. FINRA complies with all state and local pay transparency laws and regulations requiring the disclosure of salary ranges for the position. In addition to location, actual compensation is based on various factors, including but not limited to, the candidate’s skill set, level of experience, education, and market considerations.
CO/FL/TX: Minimum Salary $114,200, Maximum Salary $207,200
IL/PA: Minimum Salary $125,900, Maximum Salary $228,000
MA/MD/VA/Washington, DC: Minimum Salary $131,200, Maximum Salary $238,300
NY/NJ: Minimum Salary $131,200, Maximum Salary $248,700
#LI-Hybrid
To be considered for this position, please submit an application. Applications are accepted on an ongoing basis.
The information provided above has been designed to indicate the general nature and level of work of the position. It is not a comprehensive inventory of all duties, responsibilities and qualifications required.
Please note: If the “Apply Now” button on a job board posting does not take you directly to the FINRA Careers site, enter www.finra.org/careers into your browser to reach our site directly.
Employees may be eligible for a discretionary bonus in addition to base pay. Non-exempt employees are also eligible for overtime pay in accordance with federal, state, or local law. As part of its dedication to employee wellness, FINRA provides comprehensive health, dental and vision insurance. Additional insurance includes basic life, accidental death and dismemberment, supplemental life, spouse/domestic partner and dependent life, and spouse/domestic partner and dependent accidental death and dismemberment, short- and long-term disability, long-term care, business travel accident, disability and legal. FINRA offers immediate participation and vesting in a 401(k) plan with company match and eligibility for participation in an additional FINRA-funded retirement contribution, tuition reimbursement, commuter benefits, and other benefits that support employee wellness, such as adoption assistance, backup family care, surrogacy benefits, employee assistance, and wellness programs.
Time Off and Paid Leave*
FINRA encourages its employees to focus on their health and wellness in many ways, including through a generous time-off program of 15 days of paid time off, 5 personal days and 9 sick days, unless otherwise required by law (all pro-rated in the first year). Additionally, we are proud to support our communities by providing two volunteer service days (based on full-time schedule). Other paid leave includes military leave, jury duty leave, bereavement leave, voting and election official leave for federal, state or local primary and general elections, care of a family member leave (available after 90 days of employment); and childbirth and parental leave (available after 90 days of employment). Full-time employees receive nine paid holidays.
*Based on full-time schedule
Important Information
FINRA’s Code of Conduct imposes restrictions on employees’ investments and requires financial disclosures that are uniquely related to our role as a securities regulator. FINRA employees are required to disclose to FINRA all brokerage accounts that they maintain, and those in which they control trading or have a financial interest (including any trust account of which they are a trustee or beneficiary and all accounts of a spouse, domestic partner or minor child who lives with the employee) and to authorize their broker-dealers to provide FINRA with duplicate statements for all of those accounts. All of those accounts are subject to the Code’s investment and securities account restrictions, and new employees must comply with those investment restrictions—including disposing of any security issued by a company on FINRA’s Prohibited Company List or obtaining a written waiver from their Executive Vice President—by the date they begin employment with FINRA. Employees may only maintain securities accounts that must be disclosed to FINRA at one or more securities firms that provide an electronic feed (e-feed) of data to FINRA, and must move securities accounts from other securities firms to a firm that provides an e-feed within three months of beginning employment.
You can read more about these restrictions here.
As standard practice, employees must also execute FINRA’s Employee Confidentiality and Invention Assignment Agreement without qualification or modification and comply with the company’s policy on nepotism.
Search Firm Representatives
Please be advised that FINRA is not seeking assistance or accepting unsolicited resumes from search firms for this employment opportunity. Regardless of past practice, a valid written agreement and task order must be in place before any resumes are submitted to FINRA. All resumes submitted by search firms to any employee at FINRA without a valid written agreement and task order in place will be deemed the sole property of FINRA and no fee will be paid in the event that person is hired by FINRA.
FINRA is an Equal Opportunity Employer
All qualified applicants receive consideration for employment without regard to any legally protected category, including race, color, age, national origin, ethnicity, religion, disability, genetic information, military or veteran status, sex, or any other status or classification protected by state or local law.
FINRA strives to make our career site accessible to all users. If you need a disability-related accommodation for completing the application process, please contact FINRA’s Employee Relations team at 240-386-4865 or by email at EmployeeRelations@FINRA.org. Please note that this process is exclusively for inquiries regarding accommodations in the application process.
FINRA abides by the requirements of 41 CFR 60-741.5(a). This regulation prohibits discrimination against qualified individuals on the basis of disability and requires affirmative action by covered prime contractors and subcontractors to employ and advance in employment qualified individuals with disabilities.
FINRA abides by the requirements of 41 CFR 60-300.5(a). This regulation prohibits discrimination against qualified protected veterans and requires affirmative action by covered prime contractors and subcontractors to employ and advance in employment qualified protected veterans.
©2026 FINRA. All rights reserved. FINRA is a registered trademark of the Financial Industry Regulatory Authority, Inc.