Opportunity:
As a Senior AI QA Engineer, you will go beyond traditional functional testing. You will be responsible for building the framework that ensures our clinical insights are accurate, safe, and reliable. This role requires a unique blend of high-level software testing and data engineering to validate complex, non-deterministic medical outputs using a hybrid of automated grading methodologies.
Key Responsibilities:
- Architect Multi-Layered Validation Frameworks: Design and implement structured testing strategies that combine deterministic checks, semantic similarity metrics, and model-based evaluations.
- Automated Model Grading: Develop systems to evaluate clinical pipeline outputs for faithfulness, safety, and hallucination detection using various automated scoring techniques (e.g., BERTScore, ROUGE, or custom heuristics).
- Vibe-Driven Development: Leverage agentic AI tools to rapidly prototype complex test harnesses, "red-team" clinical logic, and build internal validation utilities at high velocity.
- Data Pipeline Integrity: Execute integration and regression tests for >KLAS Research, Fierce Healthcare, and AVIA Marketplace. A SymphonyAI Group company, GW RhythmX leverages various firm assets, including $1B+ in R&D investment, longitudinal data related to 300 million patients, 4.4 billion total annual claims, and 1.8 million healthcare professionals at more than 3,000 facilities globally.
GW RhythmX is proud to be an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, disability, age or veteran status.