AI Data Operations Manager

About the role

We are looking for an AI Data Operations Manager to own and run our end-to-end data creation and maintenance pipeline, from sourcing and managing vendors to coordinating annotation workflows and ensuring the data our models train on meets the highest quality standards.

This is a cross-functional operations role that sits at the intersection of ML, product, and operations management. You will be the connective tissue between our machine learning engineers, internal annotators, and external vendors, translating technical requirements into actionable data creation workflows and ensuring every batch of data that reaches our models is accurate, well-annotated, and fit for purpose. Critically, you will also drive automation across the pipeline, designing and deploying AI agents that eliminate manual bottlenecks and make the entire operation smarter over time.

What you will do

• Own the full vendor lifecycle, from sourcing and onboarding to quality management and relationship building at scale.
• Design and deploy agentic workflows that automate multi-step processes including vendor briefing, annotation verification, and batch tracking.
• Translate model evaluation signals (precision gaps, recall failures, edge case blind spots) into targeted data creation cycles.
• Partner with MLEs and PMs to stay ahead of model data needs, and close the loop between evaluation findings and pipeline improvements.
• Maintain clear, living documentation across data batches, annotation guidelines, and vendor SOPs.

Who you are

• 3+ years in data operations, annotation management, or vendor management in an AI/ML or tech environment.
• AI-fluent: you use AI tools naturally, think in terms of what can be automated, and can hold credible conversations with both technical and non-technical stakeholders about model behavior, prompt design, and agent architecture.
• Hands-on experience building or working with AI agents. Organized and detail-oriented, comfortable managing multiple vendors, deadlines, and pipelines simultaneously.
• Familiar with ML evaluation basics (precision, recall, edge cases) and can engage meaningfully with engineers on data quality.

Even better if you have

• Prior experience working with NLP or AI training data pipelines.
• Familiarity with annotation tools (e.g. CVAT, Label Studio, Scale AI, Surge AI, or similar).
• Experience working in a startup or high-growth environment where processes are still being built.

You will thrive in this role if you

• Get frustrated when things are manual that don't need to be, and you do something about it.
• Can translate messy technical requirements into clear, actionable briefs without losing anything in translation.
• Treat data quality as a product, not a checkbox.
• Are comfortable operating in the gap between engineering and operations, and you actually enjoy being there.