Senior Staff Software Engineer, AI Runtime

About the role

Databricks is hiring a Senior Staff Software Engineer for AI Runtime, the serverless product that lets enterprises run GPU training jobs of any size next to their data. You will shape the architecture and long-term direction of this large-scale training infrastructure.

What you'll do

• Lead the architecture and technical strategy for AI Runtime and GPU training infrastructure.
• Define reliability and observability approaches for a rapidly growing GPU fleet.
• Tackle the hardest multi-node training challenges: orchestration, GPU scheduling, data loading and checkpointing.
• Improve training speed and cost efficiency across model architectures and accelerators.
• Shape the developer experience for both humans and AI agents, and partner with research, product and customers.

Requirements

• 15+ years in large-scale distributed systems with depth in GPU training, HPC or ML systems.
• Hands-on large-model training with FSDP, DeepSpeed or Megatron and strong command of parallelism strategies.
• Expertise in GPU performance: accelerator architecture, interconnects and kernels.
• Experience with training resilience patterns and multi-tenant cloud platforms built as products.
• BS in Computer Science or related field; MS or PhD preferred.