Staff AI Infrastructure / Platform Engineer (IT)

Staff AI Platform Engineer

About the Role

We'rebuilding a new AI Platform team, andwe'relooking for a mid-to-senior engineer to help shape it. This team is the backbone that lets the rest of the company build with AI safely, reliably, and cost-effectively. We own theMLOpsandLLMOpstooling, andwe'rethe bridge to the cloud model providers we depend on (AWS Bedrock, Google Vertex AI, and others).

You'llwork alongside senior engineers who set the architectural direction, andyou'llbe trusted to own significant pieces of the platform yourself building the reusable components, APIs, and integration patterns that accelerate AI adoption across the enterprise. This is a hands-on platform and operations role, not a research or model-training role: your job is to make it easy, reliable, and cost-effective for other teams to build with AI.

This isa great rolefor a strong platform or backend engineer who is cloud-comfortable, thinks about reliability and cost, and is genuinely curious about the fast-moving AI space.

What You'll Do

• Build andoperatethe platform and tooling our teamsuseto develop, deploy, andmonitorAI-powered applications.

• Create platform enablers — reusable components, APIs, and integration patterns — that make it faster and safer for teams to adopt AI.

• Own our integrations with cloud model providers (AWS Bedrock, Google Vertex AI), including usage, cost, and reliability.

• Be a key point of contact for internal users bringing us AI use cases — understand whatthey'reasking for, ask the right questions, and route them to the right approach.

• Drive observability: make sure we can see what our systems are doing, and debug them when they break (logging, metrics, tracing).

• Contribute to and uphold AI engineering standards — security, compliance, cost, and governance — across our multi-cloud environment.

• Grow into deeperMLOps/LLMOpsownership overtime, andhelp level up the practices of the team as it matures.

Must-Have Skills

• Solid software engineering fundamentals with strong, working Python — you write clean, maintainable code, use Git, and are comfortable automating tasks.

• Hands-on experience with at least one major cloud provider (AWS is a plusgivenour stack, but strong GCP/Azure experience is welcome — good engineers pick up a second cloud quickly).

• Working knowledge of cloud fundamentals: IAM/permissions, networking basics, and a healthy awareness of cost (GPU instances and model API calls add up fast).

• Docker and comfort working with containerized applications.

• A strongoperationsand reliability mindset — you care about monitoring, reproducibility, logging, metrics, and tracing.

• Experience building or operating platforms, internal tooling, or services that other engineers depend on.

• Strong communicationand a service mindset. A platform team exists to support other engineers, so being approachable and asking good questions matters as much as technical skill.

• A demonstrated ability to learn fast. This field reinvents its tooling constantly; curiosity beats a fixed checklist of tools.

Foundational Knowledge

Youwon'tbe building these fromscratchbut you should understand them well enough to have an intelligent conversation and point people in the right direction:

• The LLM landscape: what it means to call a hosted model via a gateway like Bedrock or Vertex AI, and the basics of tokens, cost, latency, and context limits.

• RAG (retrieval-augmented generation): what it is and why someone would use it to ground a model in their own data.You'llrecognize when a user is describing one.

• Fine-tuning: understanding thatit'sa training process that needs GPUcompute(e.g., AWS EC2 GPU instances), and thatit'sa heavier lift than prompting or RAG. The key skill is recognizing what auser'srequest implies for resources and cost.

• Agentic AI: a working understanding of reasoning, planning, and autonomous workflows, and the orchestration frameworks (e.g.,LangChain) that support them.

Nice to Have

• Exposure to CI/CD (GitHub Actions, GitLab CI, or similar).

• Exposure to Infrastructure as Code (Terraform,Pulumi, CloudFormation).

• Kubernetes, ora strong desireto learn it.

• Familiarity with the broader model provider ecosystem (OpenAI, Anthropic, Hugging Face, etc.).

• Hands-on exposure to ML/LLM tooling or agentic systems — a genuine bonus, not an expectation.

• A background in distributed systems, scalability, or performance optimization for demanding workloads.

Preferred Education and Experience

• Bachelor's orMaster's degree in Computer Science, Artificial Intelligence, Machine Learning, Data Science, or a related technical field (or equivalent practical experience).

• 4-6 years of platform engineering experience, ideallyincluding cloud-native infrastructure, backend services, or internal developer platforms.

• Experience delivering and operating production systems in cloud environments, with an eye to security and reliability.

• Exposure to the AI/ML orMLOps/LLMOpsspace is a strong plus, butwe'rehappy to teach the depth to a strong platform engineerwho'seager to grow into it.