๐ง๐ต๐ถ๐ ๐ฟ๐ผ๐น๐ฒ ๐ถ๐ ๐ณ๐ผ๐ฟ ๐ผ๐ป๐ฒ ๐ผ๐ณ ๐๐ต๐ฒ ๐ช๐ฒ๐ฒ๐ธ๐ฑ๐ฎ๐'๐ ๐ฐ๐น๐ถ๐ฒ๐ป๐๐
๐ฆ๐ฎ๐น๐ฎ๐ฟ๐ ๐ฟ๐ฎ๐ป๐ด๐ฒ: ๐ฅ๐ ๐ฏ๐ฑ๐ฌ๐ฌ๐ฌ๐ฌ๐ฌ - ๐ฅ๐ ๐ฑ๐ฌ๐ฌ๐ฌ๐ฌ๐ฌ๐ฌ (๐ถ๐ฒ ๐๐ก๐ฅ ๐ฏ๐ฑ-๐ฑ๐ฌ ๐๐ฃ๐)
Experience: 5+ yrs
Location: Bengaluru, Karnataka, India
Job Type: Full-time
We are seeking a highly skilledย Senior Software Engineer โ Backendย to design, build, and scale next-generation AI platform services that power enterprise-grade intelligent applications. This role is ideal for engineers with strong expertise inย Java, cloud-native microservices, distributed systems, and AI platform architecture, along with hands-on experience integrating Large Language Models (LLMs), agent orchestration frameworks, and modern backend technologies.
As a senior member of the engineering team, you will own the development of scalable backend services, AI gateways, and orchestration frameworks while collaborating with cross-functional teams to deliver secure, reliable, and high-performance solutions. The role demands strong technical leadership, excellent problem-solving skills, and a passion for building production-ready AI-powered platforms.
Requirements
Key Responsibilities
- Design, develop, and maintain production-grade backend services for AI platforms, including LLM gateways, model integration services, and agent orchestration frameworks.
- Build scalable cloud-native microservices using Java, Spring Boot, Kafka, and modern distributed system design principles.
- Architect and implement AI gateway capabilities such as multi-provider model routing, intelligent failover, token management, cost optimization, request logging, and observability.
- Develop infrastructure supporting Model Context Protocol (MCP), tool integration, and intelligent agent workflows.
- Design and implement multi-step AI reasoning workflows, tool orchestration, guardrails, and human-in-the-loop processes for enterprise AI applications.
- Take end-to-end ownership of critical backend components, ensuring scalability, security, reliability, and maintainability.
- Diagnose and resolve complex performance bottlenecks across backend services, AI inference layers, and distributed architectures.
- Collaborate with Product, AI/ML, QA, UX, and Engineering teams to design and deliver high-quality software solutions.
- Mentor junior engineers through technical guidance, code reviews, architecture discussions, and engineering best practices.
- Promote software quality through clean code, automated testing, performance optimization, and continuous improvement initiatives.
What Makes You a Great Fit
- 5+ years of professional experience inย backend software engineeringย with strong expertise inย Javaย and object-oriented programming.
- Proven experience building and scalingย cloud-native microservicesย and enterprise backend applications usingย Spring Boot, Kafka, and distributed architectures.
- Strong understanding of relational and NoSQL databases, includingย MySQL,ย MongoDB, and modern data management practices.
- Experience developing enterprise-scale applications with strong knowledge of performance tuning, debugging, monitoring, and backend optimization.
- Hands-on experience with cloud platforms such asย AWSย and familiarity with observability tools, logging frameworks, and monitoring solutions.
- Solid understanding ofย Large Language Models (LLMs), AI platform architecture, and intelligent application development.
- Experience or strong knowledge ofย Model Context Protocol (MCP), AI gateways, multi-model routing, semantic caching, and AI service orchestration.
- Familiarity with agentic AI frameworks such asย LangChain,ย LangGraph,ย LlamaIndex,ย CrewAI,ย OpenAI Agents SDK, or similar orchestration technologies.
- Understanding of AI observability, evaluation techniques, prompt execution monitoring, AI safety practices, content filtering, and hallucination mitigation.
- Excellent analytical thinking, communication, mentoring, and collaboration skills with the ability to thrive in a fast-paced engineering environment while delivering high-quality, production-ready solutions.