Senior Manager, AI Infrastructure Operations
This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Senior Manager, AI Infrastructure Operations based in United States.
This role offers the opportunity to lead the engineering operations behind large-scale AI infrastructure in a fast-growing cloud environment. You will oversee the teams responsible for deploying, operating, and optimizing advanced AI compute clusters that power demanding machine learning workloads. The position combines technical leadership, operational excellence, and hands-on infrastructure expertise to ensure reliable and high-performance systems at scale. You will collaborate with engineering teams across AI/ML, networking, storage, hardware, and product to deliver next-generation cloud capabilities. This is a high-impact leadership role for someone passionate about solving complex infrastructure challenges and building scalable AI platforms.
This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Senior Manager, AI Infrastructure Operations based in United States.
This role offers the opportunity to lead the engineering operations behind large-scale AI infrastructure in a fast-growing cloud environment. You will oversee the teams responsible for deploying, operating, and optimizing advanced AI compute clusters that power demanding machine learning workloads. The position combines technical leadership, operational excellence, and hands-on infrastructure expertise to ensure reliable and high-performance systems at scale. You will collaborate with engineering teams across AI/ML, networking, storage, hardware, and product to deliver next-generation cloud capabilities. This is a high-impact leadership role for someone passionate about solving complex infrastructure challenges and building scalable AI platforms.
Accountabilities:
- Lead the engineering team responsible for deploying, scaling, and operating AI compute clusters, ensuring consistent execution and operational excellence.
- Translate technical strategies into actionable project plans, milestones, and delivery priorities in collaboration with infrastructure leadership.
- Oversee GPU fleet operations, bare metal environments, hardware provisioning, configuration management, firmware updates, and validation processes.
- Drive improvements in cluster reliability, availability, monitoring, automation, and performance optimization.
- Manage incident response processes, root-cause analysis, and operational improvements for AI infrastructure environments.
- Partner with AI/ML, SRE, networking, hardware, and product teams to align infrastructure capabilities with business and technical requirements.
- Support the evolution of orchestration, scheduling, workload management, and multi-tenant infrastructure systems.
- Improve tooling and automation for provisioning, observability, configuration management, and large-scale fleet operations.
- Identify infrastructure bottlenecks and implement engineering solutions to improve efficiency and performance.
- Mentor engineers, support professional development, and foster a culture of ownership, collaboration, and technical excellence.
- Establish and improve engineering processes, including documentation, testing standards, code reviews, and operational runbooks.
- 6–10 years of experience in infrastructure engineering, high-performance computing, large-scale systems, or related technical fields.
- Strong knowledge of AI infrastructure, including GPU/CPU clusters, distributed training systems, and high-performance networking technologies such as InfiniBand or RDMA.
- Proven experience operating production-scale bare metal, GPU, or hardware fleet environments.
- Hands-on expertise with Linux systems, Kubernetes or Slurm, infrastructure provisioning tools such as Terraform or Ansible, observability platforms, and networking fundamentals.
- Experience with cluster operations, hardware bring-up, distributed systems, or supporting machine learning workloads.
- Previous experience leading engineering teams or technical pods while remaining close to complex technical challenges.
- Ability to translate strategic goals into clear engineering priorities and execution plans.
- Strong communication skills with the ability to collaborate effectively across technical and cross-functional teams.
- Demonstrated ability to prioritize, adapt, and deliver results in a fast-paced, high-growth environment.
- Competitive compensation range of $150,000 – $160,000, with final compensation based on experience, skills, location, and applicable regulations.
- Comprehensive medical benefits with company-paid employee medical premiums.
- Company-paid dental and vision coverage.
- 401(k) plan with 100% company match up to 4% and immediate vesting.
- Professional development reimbursement of up to $2,500 annually.
- Paid time off program with holidays, rollover options, increased PTO milestones, and birthday time off.
- Long-term employee benefits including paid sabbaticals and anniversary bonuses.
- Remote work support with equipment setup reimbursement and annual equipment allowances.
- Monthly internet reimbursement.
- Gym membership reimbursement.
- Company-paid wellness program.
- Opportunity to work on cutting-edge AI infrastructure technologies in a collaborative engineering environment.
- Career growth opportunities within a rapidly scaling global technology organization.
As a Senior Manager, AI Infrastructure Operations, you will lead the execution and continuous improvement of AI infrastructure initiatives, ensuring reliable operations, efficient delivery, and strong engineering practices across large-scale compute environments.
Requirements:
The ideal candidate brings extensive experience in infrastructure engineering, AI compute environments, and technical team leadership, with the ability to balance strategic execution with deep technical involvement.