Lead Data Scientist
Association of American Medical Colleges
Washington, District of Columbia
Full-Time
$140,250
RemoteManager
The Association of American Medical Colleges is a not-for-profit association dedicated to transforming health care by supporting the entire spectrum of medical education, medical research, and patient care conducted by our member institutions. We are dedicated to the communities we serve and steadfast in our goal to improve the health of all.
At the AAMC, we are committed to supporting our employees with a comprehensive and competitive benefits package designed to promote well-being, professionaldevelopment, and work-life balance.
Additional information can be found on our website.
Lead Data Scientist is responsible for leading and conducting research and analysis to evaluate, enhance, or create products and services. Collaborates with internal colleagues across the organization and external partners throughout research and development to achieve significant impact. Leads the design, application, and oversight of methodological frameworks, including advanced statistical modeling, analytic strategy, and evaluation plans; ensures rigor, reproducibility, and alignment with strategic research objectives. Analyzes data, prepares data visualizations and summarizes results and delivers reports describing results and recommendations for technical and non-technical audiences. Queries, extracts, and transforms data from various AAMC databases and repositories, such as the data warehouse and data mart; sets coding standards and develops reusable analytical assets and automation tools. Collaborates cross-functionally and provides scientific leadership, consulting on research direction, mentoring analysts, and partnering with stakeholders to shape products, dissemination strategies, and research roadmaps that advance organizational priorities.
Lead the design, execution, and scientific direction of research portfolios focused on residency selection, applicant behavior, and the evaluation of new selection tools; ensure methodological rigor, psychometricsoundness, and clear research pathways from concept to implementation.
Identifyresearch questionsandhelp to define research priorities and analyticstrategyat scale, developing conceptual frameworks, research questions, methodological approaches, and statistical models to evaluate tool performance and policy impacts.
Serveas a primary scientific liaison with internal teams, external vendors, advisory committees, and specialty stakeholders,anticipatingrisks, makingmethodological recommendations, and resolvingcomplex technical issues.
Overseeevidencesynthesis and knowledge integration, guiding literature reviews, environmental scans, and validity frameworks to inform adoption and responsible use of emerging assessment and selection tools.
Leadresearch governance and compliance processes, including IRBcompliance, DUAs, NDAs, and legal agreements, ensuringethical data use, risk mitigation, and alignment with organizational policies andrelatedguidelines.
Lead dissemination of findings through manuscripts, technical briefs, and presentations, ensuring transparent documentation ofmethodologyand results, andmentorjunior staff in scholarly writing and publication standards.
Data Management:
Provide strategic direction for data architecture and management processes, developing and refining standards, governance frameworks, and workflows that support large-scale residency selection research and product development.
Lead complex dataextraction, integration, and transformation from AAMC repositoriessuch as the data warehouse and data mart,optimizingquery performance, automatingrepeatable workflows, and ensuringscalability and traceability across projects.
Serve as primary data liaison withinternal teams and/or external partners toalign ondata formats, schedules,and security considerations.
Oversee operational and research data exchanges, including recurring and ad-hoc transfers, andensure timeliness, accuracy, and compliance.
Lead quality assurance, validation, and risk mitigation processes for incoming and outgoing data, proactivelyidentifyinganomaliesand directing resolution with technical teams and stakeholders.
Develop and reproducible analytical workflows, including dataset production, documentation standards, code versioning, and transparent lineage tracking.
Perform data validation for data displayed in products or tools (e.g., Residency Explorer, Careers in Medicine) to ensure dataisrenderedaccurately and in compliance with data display rules.
Conduct quality assurance checks of data toidentifyred flags and coordinate with AAMC colleagues to investigate and resolve issues.
Clean data, document syntax, and analyze external analytic data sources in collaboration with research partners and constituents.
Analyze qualitative and quantitative data to answer questions about residency selection or assessments, as needed (e.g., advanced analytics and AI, regressions and multilevel modeling,correlationsand descriptive analyses).
Synthesize findings for leadership and external audiences, preparing executive-ready summaries, technical reports, and presentations, andmentor junior analysts in analytical reasoning and communication.
Develop Resourcesand DeliverablesforExternal and Internal Audiences:
Lead the definition of project scope, researchobjectives, and deliverables, ensuring alignment with strategic priorities, scientific rigor, and operational feasibility.
Facilitate meetings, take notes, and follow up on action items.Facilitate and guide cross-functional collaboration, setting agendas, driving decision-making discussions, ensureaction items translate into measurable research progress, anddelegatetactical tasks whereappropriate.
Design and overseecreationof compelling data visualizations and evidence-driven narratives, ensuring accuracy, methodological transparency, and effective translation of complex analytical findings for varied audiences.
Develop high-quality presentations, reports, and leadership materials forleadershipbriefings, advisory committees, and external stakeholders,coachingteam members onevidencecommunication and messaging strategy.
Serve as lead on manuscripts, conference submissions, and scholarly products, ensuring methodological clarity, alignment with publication standards, and dissemination of findings to the medical education community.
Relationship Management:
Cultivate and steward high-level collaborationsacrossASRD, the Services, and other clustersaligning research priorities with enterprise strategy and enabling coordinated delivery of high-impact solutions.
Establish relationships with constituents and colleagues in external organizations to co-create high-impact products and servicesthat deliver meaningful value to the community.
Represent the research portfolio in cross-organizationaldiscussions, providing thought leadership, negotiating research scope and expectations, and ensuring stakeholder alignment throughout the project lifecycle.
Required Qualifications:
MinimumEducation:Master’sdegreein Psychologyor related field
Preferred Education:Mastersdegree inindustrial-organizationalpsychology, educationalmeasurement, economics, datascienceor related fields
Required Experience:
8-10 years of related work experience.
1-3 years of supervisory experience.
Preferred Experience:
Research Experience: Hands-on research experience in selection, admissions, educationalmeasurementor related field, with a demonstratedtrack recordof producing high-quality applied research. This may include working on large, complex research projects, technical reports, publications in peer-reviewed journals, andexpertisein research methodologies.
Project Management: Experience in managing complex research projects, including budgeting, planning, and execution, as well asproficiencyin statistical tools, research software, and other relevant technologies.
Strategic Oversight: Experience in aligning researchobjectiveswith organizational goals, contributing to long-term strategic planning, and effectively communicating research findings to stakeholders at various levels (internal teams, external partners).
ManagementExperience: Experience in a managerial role, such as managing research teams, overseeing projects, and providing mentorship.
Additional Information:
Expert-level knowledge of personnel selection science, validation frameworks, and evidence-based assessment design, including predictive modeling, fairness evaluation, scoring, and implementation in high-stakes selection contexts.
Deepexpertisein research design, statistics, psychometrics, and measurement theory, with the ability to select, justify, and operationalize methodological approaches for large-scale, complex research initiatives.
Leads project strategy and execution,establishingtimelines, resource plans, analytic milestones, and risk-mitigation structures; ensures successful delivery across concurrent, high-visibility initiatives.
Proactivelyidentifies,resolvesorescalatesmethodological, analytic, and operational issues, exercising sound judgment indeterminingescalation pathways, communicating trade-offs, and guiding decision-making.
Demonstrates strategic prioritization and workload balancing, managing multiple research streams whilemaintainingscientific rigor, documentation quality, andtimelydelivery.
Time-management skills with the ability to prioritize multiple, critical tasks whilemaintaininga high levelof service and attention to detail and adhering to a strict schedule.
Exceptional written and verbal communication skills, capable of translating complex analyses into clear narratives for leaders, researchers, product teams, anda wide variety of stakeholders,including AAMC staff and constituents.
Effectively influences and leads within collaborative and consensus-driven environments, building alignment across diverse perspectives and guiding stakeholders toward evidence-based decisions.
Maintains strict adherence toAAMC policiesregardingconfidentiality, data privacy,personally identifiableinformationand governance policies, ensuring compliant handling of sensitive data.
Expert in advanced statistical and methodological techniques, including multilevel models, psychometrics, causal inference, machine learning/AI, text analysis, and fairness evaluation.
Strongproficiencyin analytical and computing environments, withexpertisein R, Python, SQL, and reproducible research workflows; able to architect analytic pipelines and mentor others in best practices.
Intermediate skill in Excel to perform work such as data analysis, formulas, reportdesign.
Fluency with productivity, collaboration, and visualization environments (e.g., Microsoft 365, data platforms, version control, business intelligence tools), using them to drive efficient, transparent, and scalable work.
Remote Work Eligibility
This position is eligible for remote work in the contiguous USCompensation Grade Range
$140,250.00-$165,000.00Multiple factors are taken into consideration to arrive at the final hourly rate/annual salary to be offered to the selected candidate. Factors may include, but are not limited to, the scope and responsibilities of the role, the selected candidate’s work experience, education and training, as well as internal equity, market, and business considerations.
If a bachelor’s degree is required, related work experience may be substituted in some positions. One year of college course work at an accredited institution is equivalent to one year of related work experience.
The AAMC is an Equal Opportunity Employer. The AAMC is committed to an Equal Employment Opportunity policy in recruitment, hiring, career advancement, and all other personnel practices. The AAMC will not discriminate on the basis of race, color, sex, national origin, religion, age, marital status, personal appearance, sexual orientation, gender identity or expression, family responsibilities, matriculation, political affiliation, genetic information, disability, past or current military service, or any other legally protected characteristic. The AAMC is committed to the full inclusion of all qualified individuals. As part of this commitment, the AAMC will ensure that people with disabilities are provided reasonable accommodations. If reasonable accommodation is needed to participate in the job application or interview process, perform essential job functions, and/or receive other benefits and privileges of employment, please contact the talent acquisition team.
Please attach a resume as part of the application process. It is important that files DO NOT include periods ( . ) within the file name.
BROWSER REQUIREMENTS: Applications must be submitted using Chrome, Mozilla Firefox, Safari, or Microsoft Edge.