Software Engineer II

Software Engineer II | Microsoft Careers Skip to main content Microsoft Careers Careers Careers Search Search jobs Sign in Single PositionView All JobsSoftware Engineer IIIndia, Karnataka, Bangalore +1 moreApply nowAdd to cartFind out how well you match with this jobUpload your resumeJob descriptionCompany and benefitsJob number200043120Date postedJul 20, 2026Work site3 days / week in-officeTravelLess than 25%ProfessionSoftware EngineeringDisciplineSoftware EngineeringRole typeIndividual ContributorEmployment typeFull-TimeOverviewBusiness Group Overview Do you want to build the systems that deliver generative AI to the world at massive scale? Our team builds and operates the cloud services that run large-scale AI model inference for customers across the globe, processing enormous volumes of requests reliably and efficiently. You will work where distributed systems, capacity, and performance meet, solving problems that only exist at hyperscale. Job Purpose Overview As a Software Engineer on our team, you will design and deliver backend services that process high-volume, asynchronous AI workloads and intelligently direct traffic to the right compute at the right time. This role gives you deep, hands-on exposure to distributed systems, large-scale scheduling, capacity and throughput optimization, and service reliability, with room to grow into adjacent parts of the platform. You'll learn to build and operate services that stay fast, efficient, and dependable under intense scale, working alongside a talented and supportive team in a flexible hybrid environment (up to 50% work from home). Microsoft's mission is to empower every person and every organization on the planet to achieve more, and we're dedicated to this mission across every aspect of our company. Our culture is centered on embracing a growth mindset and encouraging teams and leaders to bring their best each day. Join us and help shape the future of the world. ResponsibilitiesResponsibilities   Design, build, and operate scalable, reliable backend services that process high-volume, asynchronous AI inference workloads. Develop intelligent scheduling and request-routing capabilities that make efficient, load-aware use of available compute capacity. Improve throughput, latency, and cost efficiency of large-scale workloads through profiling, tuning, and thoughtful system design. Instrument services with strong telemetry, monitoring, and alerting, and participate in on-call rotations to ensure high availability. Partner with product and platform teams to onboard new models and capabilities and to support growing enterprise adoption. Write clean, testable, maintainable code and contribute actively to design discussions and code reviews. Continuously identify and drive improvements in reliability, scalability, and engineering quality.QualificationsRequired Qualifications Bachelor's degree in Computer Science or a related technical field AND 3+ years of technical engineering experience, OR equivalent experience. 2+ years of experience designing and building backend or distributed services in a modern programming language such as C#, Java, Go, or C++. 1+ years of experience building and operating services on a public cloud platform such as Azure, AWS, or GCP. Preferred Qualifications 1+ years of experience with large-scale distributed systems, high-throughput data processing, or asynchronous/batch workloads. Experience with scheduling, queueing, load balancing, or request-routing systems. Experience with observability tooling and operating production services in an on-call model. Familiarity with containerized services and orchestration (e.g., Docker and Kubernetes) Other Requirements:Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized...