Role responsibilities
The Senior AI Software Engineer will design and develop AI communication middleware for distributed workloads, focusing on performance-critical features and optimizing distributed training. Responsibilities also include profiling workloads, enhancing GPU communication paths, and collaborating with cross-disciplinary teams.
Requirements
Candidates should have over 8 years of experience in high-performance systems programming, particularly in C/C++ on Linux, with strong expertise in GPU communication stacks. Experience with AI frameworks and open-source contributions is preferred.
Key skills
C/C++, Linux, GPU Communication Stacks, CUDA, ROCm, NCCL, RCCL, Distributed Training, Collective Communication, Open-source Contributions, AI Frameworks, libfabric, OFI, UCX, RDMA, RoCEv2
Keywords
AI, Software Engineer, Middleware, Distributed Workloads, Performance Optimization, GPU Communication, Multi-node, Multi-GPU, Profiling, PyTorch, TensorFlow, JAX, Benchmarks, Open-source, Ultra Ethernet, Deployment, Performance Validation, Troubleshooting, Trace Analysis