Software Engineer, AI Squads

The Opportunity

Our AI teams build highly available, low-latency microservices using modern, cloud-native technologies. This role sits within our broader AI organization and focuses on developing the platforms, services, and tooling that support AI-powered products from inference and embeddings to APIs, data flows, and observability.

Youll work in a fast-paced environment where reliability, performance, and usability matter just as much as innovation. While some squads work closer to inference pipelines and LLM tooling, others focus on platform foundations, troubleshooting and reliability, data systems, or observability all critical to delivering AI in production at scale.

What Youll Do

• Build, test, and deploy scalable microservices for AI-powered systems, including text and voice processing
  
  
• Design developer-friendly APIs, agents and internal tools that make AI easy to use across the Telnyx product ecosystem
  
  
• Contribute to AI inference, embeddings, and platform services that support real-time and low-latency workloads
  
  
• Optimize performance, reliability, and observability in production environments
  
  
• Collaborate closely with Product, Infrastructure, and ML teams to bring features from ideation to production
  
  
• Troubleshoot, debug, and support critical systems running in production
  
  
• Participate in code reviews and uphold high engineering and operational standards
  
  

Depending on the squad, your focus may lean more toward inference pipelines, platform foundations, observability, data systems, or production troubleshooting.

Who Were Looking For

• Someone who has built something with cutting-edge AI tooling (something that has only become possible in the last 6 months, rolling from application date). It doesn't really matter what it is; we just want to know you are building and staying up to date.
  
  
• Strong understanding of async programming, concurrency, and parallel execution
  
  
• Experience with microservice-based systems
  
  
• Excellent communication skills and the ability to work effectively across teams
  
  

Nice to Haves

• Familiarity with LLM frameworks and tools (e.g. PyTorch, Transformers, DeepSpeed, vLLM)
  
  
• Experience with distributed computing frameworks such as Ray (Ray Core, Serve, Train)
  
  
• Exposure to cloud-native stacks (Docker, Kubernetes, Prometheus, Jaeger)
  
  
• Knowledge of LLM optimization techniques (e.g. quantization, speculative decoding)
  
  
• Background in Retrieval Augmented Generation (RAG) systems
  
  
  

How We Hire Across Our AI Teams

Our AI Chapter is made up of multiple squads, including:

• AI application & software engineering
  
  
• Platform & infrastructure foundations
  
  
• Troubleshooting, reliability, and production support
  
  
• Data, storage, and embeddings
  
  
• Observability and performance monitoring
  
  

We hire into a shared AI engineering pipeline. During interviews, we focus on core engineering skills, system design, and problem-solving ability. Final squad alignment happens later, based on:

• Your strengths and interests
  
  
• Team needs at the time
  
  
• Where youll have the biggest long-term impact
  
  

This means the exact focus of the role may vary by squad, but the core expectation remains the same: building reliable, scalable AI systems in production.

Why Youll Love It Here

At Telnyx, were not just building products were building the future of intelligent communication. Our TelnyxAI platform empowers developers and businesses to:

• Store and serve vector embeddings at scale
  
  
• Use open-source models with our hosted inference infrastructure
  
  
• Deploy multimodal AI features across text, voice, and storage seamlessly
  
  

Youll have the autonomy to take ownership of meaningful projects, contribute ideas that shape the product roadmap, and collaborate with talented people who care deeply about impact, quality, and long-term thinking.

#LI-KG1
#LI-VIETNAM
#LI-BRAZIL
#LI-INDIA