Software Engineer II - Azure AI Services

Software Engineer II - Azure AI Services | Microsoft Careers Skip to main content Microsoft Careers Careers Careers Search Search jobs Sign in Single PositionView All JobsSoftware Engineer II - Azure AI ServicesGermany, Multiple Locations, Multiple LocationsApply nowAdd to cartFind out how well you match with this jobUpload your resumeJob descriptionCompany and benefitsJob number200042698Date postedJul 16, 2026Work site2 days / week in-officeTravelLess than 25%ProfessionSoftware EngineeringDisciplineSoftware EngineeringRole typeIndividual ContributorEmployment typeFull-TimeOverviewAI is rapidly transforming how people work and interact with technology. Join our team at the forefront of this transformation, where we develop Azure OpenAI and other Azure AI cloud services that help developers bring the latest AI models into their applications. As part of the Cloud + AI Foundry Inferencing and Training organization, our team builds and operates large-scale cloud services for AI, with a focus on inference for multimodal models, including audio and image models.We are looking for a highly motivated software engineer to help build and operate cloud services for audio models, including the Azure OpenAI Realtime API. The ideal candidate brings strong distributed systems expertise, a solid foundation in AI concepts, and hands-on experience with the technologies behind high-scale cloud services. This role offers the opportunity for high impact, fast-paced innovation, and close collaboration with teams across the globe.You will work on the infrastructure behind advanced AI experiences in production, solving deep engineering challenges in reliability, latency, scale, and developer experience.In line with our Flexible Work approach, for roles at Microsoft Germany, we recommend spending at least two days per week in the office.ResponsibilitiesArchitect and Implement Cloud Services for AI: design and build scalable, reliable architectures that meet high-performance requirements for AI systems, including inference engine, services, and APIs.Apply deep knowledge of distributed systems principles to create robust solutions.Debug and Optimize Across the Stack: dive deep into large existing codebases to identify and resolve issues quickly. Ensure fast turnaround for critical fixes while maintaining system integrity.Operate global cloud services: be part of the DevOps team responsible for operating our cloud services. Work on diagnosing and mitigating any issues together with partner teams.Collaborate Across Teams and Partners: work closely with multiple internal teams and external partners to solve complex problems, align on technical decisions, and deliver integrated solutions.Innovate and Drive Technical Excellence: identify non-obvious technical approaches that unlock new possibilities.Architect and execute features with measurable goals, iterating rapidly to achieve outcomes.Full-Stack Ownership: engage with components across the entire stack—from infrastructure to APIs—to deliver end-to-end solutions.Leadership and Influence: Articulate complex concepts clearly, build consensus, and create systems that accelerate team velocity.Demonstrate exceptional judgment and autonomy in execution.QualificationsRequired/minimum qualificationsBachelor's Degree in Computer Science or related technical field AND technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience.Additional or preferred qualificationsMaster's Degree in Computer Science or related technical field AND technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR Bachelor's Degree in Computer Science or related technical field AND technical engineering experience with coding in languages including, but not limited to, C,...