Experience
8+ years of relevant software engineering, cloud engineering, AI/ML engineering, platform engineering, or solution engineering experience, including hands-on delivery of production-grade Generative AI, RAG, or Agentic AI systems
Key Responsibilities
- Work directly with business and technical stakeholders to identify high-value AI use cases and convert ambiguous requirements into production-ready solutions.
- Design and build Generative AI, Retrieval-Augmented Generation (RAG), Advanced RAG, and Agentic AI applications.
- Engineer retrieval pipelines covering document ingestion, parsing, chunking, metadata enrichment, embeddings, indexing, hybrid retrieval, reranking, grounding, and response generation.
- Build single-agent and multi-agent systems with planning, reasoning, tool calling, workflow orchestration, state management, memory, retries, exception handling, and human-in-the-loop approvals.
- Develop and integrate Model Context Protocol (MCP) servers and clients to securely connect AI agents with enterprise tools, APIs, data sources, and workflows.
- Build reusable tools, functions, plugins, APIs, and connectors for structured and controlled agent execution.
- Develop AI-enabled backend services and microservices using Python, FastAPI, Flask, REST APIs, asynchronous processing, and event-driven patterns.
- Integrate AI solutions with enterprise applications, databases, SaaS platforms, cloud services, security platforms, and knowledge repositories.
- Apply prompt engineering and context engineering, including system prompts, few-shot prompting, structured outputs, context compression, and conversation-memory strategies.
- Build automated evaluation pipelines to measure retrieval quality, groundedness, faithfulness, answer relevance, hallucination, task completion, latency, security, token consumption, and cost.
- Implement LLMOps and GenAIOps practices covering model and prompt versioning, testing, deployment, tracing, observability, rollback, and production monitoring.
- Implement AI security guardrails against prompt injection, indirect prompt injection, jailbreaks, sensitive-data disclosure, insecure tool execution, privilege escalation, and excessive agency.
- Rapidly develop proofs of concept and convert validated prototypes into secure, scalable, resilient, maintainable, and supportable enterprise applications.
- Troubleshoot complex AI, retrieval, application, data, API, cloud, and integration issues and drive them through root-cause analysis and closure.
- Create technical designs, architecture diagrams, evaluation reports, runbooks, deployment documentation, and operational support procedures.
- Collaborate with Product Owners, Architects, Software Engineers, DevOps, Cybersecurity, Data Engineering, and business teams while maintaining clear delivery visibility.
Required Technical Skills
Must Have
- Strong programming experience in Python, including production-grade backend and AI application development.
- Hands-on experience building Generative AI and Large Language Model (LLM) applications using Azure OpenAI, OpenAI APIs, or equivalent enterprise model platforms.
- Strong experience with RAG and Advanced RAG patterns, including query rewriting, multi-query retrieval, metadata filtering, hybrid search, reranking, contextual retrieval, citations, and grounded generation.
- Hands-on experience with Agentic AI, AI agents, tool/function calling, structured outputs, agent orchestration, and multi-agent workflows.
- Understanding of Model Context Protocol (MCP), including MCP hosts, clients, servers, tools, resources, prompts, authentication, authorization, and secure enterprise integration.
- Experience with prompt engineering and context engineering, including system instructions, few-shot examples, context-window management, memory, and output schemas.
- Strong understanding of embeddings, semantic search, vector search, similarity search, hybrid retrieval, reranking models, and retrieval-quality optimization.
- Experience with vector stores and search platforms such as Azure AI Search, PostgreSQL/pgvector, Redis, Pinecone, Qdrant, Weaviate, or equivalent.
- Experience with document ingestion and knowledge pipelines, including PDF/Office document parsing, OCR, chunking, metadata extraction, indexing, and access-control-aware retrieval.
- Experience with AI frameworks such as Microsoft Semantic Kernel, LangChain, LangGraph, AutoGen, or equivalent orchestration technologies.
- Experience building APIs and microservices using FastAPI, Flask, REST, JSON, asynchronous programming, background workers, and message queues.
- Experience with Microsoft Azure services and cloud-native application architecture.
- Experience with AI evaluation and Evals, including groundedness, faithfulness, retrieval precision/recall, answer relevance, hallucination detection, regression testing, and LLM-as-a-Judge approaches.
- Experience with LLMOps/GenAIOps, including model configuration, prompt versioning, experiment tracking, tracing, monitoring, telemetry, quality gates, and release management.
- Ability to optimize model selection, token usage, context size, latency, throughput, caching, reliability, and inference cost.
- Knowledge of Responsible AI, AI governance, privacy, data isolation, PII handling, content safety, and enterprise >
Weekly Hours:
40Time Type:
RegularLocation:
IND:AP:Hyderabad / Argus Bldg 4f & 5f, Sattva, Knowledge City- Adm: Argus Building, Sattva, Knowledge City, IND:KA:Bangalore / Intl Tech Park, Navigator Bldg, Whitefield Road: Intl Tech Park, Navigator Bldg:Intl Tech Park, Navigator Bldg
AT&T and its subsidiaries are committed to equal employment opportunity. All hiring, promotion, and other employment decisions remain merit-based and free from discrimination on the basis of race, color, religion, religious creed, national origin, ancestry, age, sex, sexual orientation, gender, gender identity, gender expression, physical disability, mental disability, pregnancy, medical condition, genetic information, marital status, citizenship status, military status, veteran status, or any other characteristic protected by federal, state, or local laws. In addition, AT&T will provide reasonable accommodations to qualified individuals with disabilities. AT&T is a fair chance employer and does not initiate a background check until an offer is made. Click here to learn more or request an application accommodation here.