This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Sr Backend Engineer - AI based in India.
This role sits at the cutting edge of backend engineering and applied AI, where you will help build the intelligence layer powering next-generation observability systems. You will design and scale backend systems that support AI agents, LLM-powered workflows, and real-time data streaming across logs, metrics, and traces. The environment is highly technical and fast-moving, focused on building production-grade systems that make complex AI behaviors reliable and observable. You will work on core platform components such as agent orchestration, tool execution, and MCP-based integrations that enable AI systems to interact with real-world observability data. This is a high-impact engineering role where your work directly shapes how developers understand and debug modern distributed systems. You will collaborate closely with a strong remote-first team building open-source infrastructure used globally.
This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Sr Backend Engineer - AI based in India.
This role sits at the cutting edge of backend engineering and applied AI, where you will help build the intelligence layer powering next-generation observability systems. You will design and scale backend systems that support AI agents, LLM-powered workflows, and real-time data streaming across logs, metrics, and traces. The environment is highly technical and fast-moving, focused on building production-grade systems that make complex AI behaviors reliable and observable. You will work on core platform components such as agent orchestration, tool execution, and MCP-based integrations that enable AI systems to interact with real-world observability data. This is a high-impact engineering role where your work directly shapes how developers understand and debug modern distributed systems. You will collaborate closely with a strong remote-first team building open-source infrastructure used globally.
Accountabilities:
- Design and develop backend services powering AI agents, orchestration layers, and tool execution frameworks
- Build and maintain APIs and systems for real-time streaming of observability data (logs, metrics, traces)
- Develop MCP server capabilities enabling LLMs and agents to query and act on system data
- Architect and implement scalable distributed systems with strong focus on performance and reliability
- Work on long-running processes, session management, and stateful AI workflows across backend services
- Implement secure, production-grade systems for LLM tool-calling, evaluation, and prompt execution
- Collaborate on LLM/GenAI observability features to monitor AI-native applications using OpenTelemetry
- Drive end-to-end ownership of features from design and architecture through deployment and scaling
- Contribute to system design discussions, technical documentation, and engineering best practices
- 5–8 years of experience in backend engineering building production-grade distributed systems
- Strong proficiency in Go (concurrency, performance, system design) and Python (FastAPI, asyncio, Pydantic)
- Hands-on experience building and shipping LLM/AI features such as agents, tool calling, or RAG systems
- Strong understanding of API design, data modeling, and scalable backend architectures
- Experience with asynchronous systems, streaming architectures, and event-driven design
- Ability to build reliable systems on top of non-deterministic AI/LLM behavior
- Strong ownership mindset with ability to drive projects end-to-end independently
- Excellent communication skills and ability to document and explain technical decisions clearly
- Experience in remote-first, fast-paced engineering environments
- Familiarity with observability systems or distributed tracing is a plus
- Remote-first and async-friendly work culture
- Opportunity to build cutting-edge AI-native infrastructure products
- High-impact role shaping a new category: agent-native observability
- Work on a globally adopted open-source platform
- Highly technical, product-focused engineering environment
- Strong ownership and autonomy across the full development lifecycle
- Collaboration with a world-class engineering team shipping at high velocity
- Opportunity to contribute to widely used developer infrastructure tools.
In this role, you will design and build scalable backend systems that power AI-driven observability products, ensuring reliability, performance, and seamless integration between LLM systems and distributed infrastructure.
Requirements
The ideal candidate brings strong backend engineering expertise combined with hands-on experience building and shipping AI/LLM-powered systems in production environments.