Software Engineering Manager - Meta Superintelligence Labs - Infra: Optimizations Team

Software Engineering Manager - Meta Superintelligence Labs - Infra: Optimizations Team Responsibilities:

• Lead and support the team that develops various kernels including but not limited to GEMMs, Attention mechanisms etc. Also, contribute to enabling performance at scale of our inference and training of next generation GenAI (Llama) models
• Enable the growth of individual contributors, driving the technical roadmap along with technical leads and expand the impact of the team by growing new skill-sets and capabilities
• Lead a high performance team of engineers to deliver new capabilities and efficient compute systems for our fleet
• Technical management
• Experience in systems architecture, performance, workload-analysis and large scale distributed systems
• Work cross-functionally across hardware and software/services team to drive engineering efforts

Minimum Qualifications:

• MS or BS in Computer Science or Electrical/Electronics Engineering or equivalent
• 3+ years of experience of directly managing or leading a team of engineers with varied skill levels
• Experience in leading teams working on high performance computing (HPC) and AI/ML systems, including:
• GPU/ASIC-based kernel development and optimization (e.g. CUDA)
• Distributed systems for large scale training and serving
• Systems Architecture + Performance
• Large scale distributed systems
• Experience running a large-scale program and dealing with ambiguity

Preferred Qualifications:

• Familiarity with the latest techniques in optimizing GenAI workloads
• Using frameworks like PyTorch, TorchTriton to develop custom kernels
• Understands Kernel enablement and optimizations, including experience working on attention kernels
• Understanding GPU memory hierarchy and computation capabilities
• Understands low-level CUDA kernel optimizations for inference and training
• Experience with Quantization and structure sparsity for low precision training & inference
• Understands Optimizers such as Adam, Shampoo, Muon

About Meta: