Find your next AI role

1 role/ search · ↑ ↓ browse · ↵ open

D
Senior Staff Software Engineer, AI Runtime
Databricks Mountain View / San Francisco, CA, USA
$229K – $343K /yearFound by AICareersOnly. Our team found this opening on the company's official careers page. You apply directly with the employer.New
Engineeringmegatrongpuhpc3 hours ago

Senior Staff Software Engineer, AI Runtime

at DatabricksMountain View / San Francisco, CA, USA

Apply now

$229K – $343K /yearFound by AICareersOnlyOn-siteFull-timeLead / StaffEngineering

AI Signal

Job overview

About the role

Databricks is hiring a Senior Staff Software Engineer for AI Runtime, the serverless product that lets enterprises run GPU training jobs of any size next to their data. You will shape the architecture and long-term direction of this large-scale training infrastructure.

What you'll do

Lead the architecture and technical strategy for AI Runtime and GPU training infrastructure.
Define reliability and observability approaches for a rapidly growing GPU fleet.
Tackle the hardest multi-node training challenges: orchestration, GPU scheduling, data loading and checkpointing.
Improve training speed and cost efficiency across model architectures and accelerators.
Shape the developer experience for both humans and AI agents, and partner with research, product and customers.

Requirements

15+ years in large-scale distributed systems with depth in GPU training, HPC or ML systems.
Hands-on large-model training with FSDP, DeepSpeed or Megatron and strong command of parallelism strategies.
Expertise in GPU performance: accelerator architecture, interconnects and kernels.
Experience with training resilience patterns and multi-tenant cloud platforms built as products.
BS in Computer Science or related field; MS or PhD preferred.

megatrongpuhpcfsdpdistributed-systemsllm-trainingml-infrastructuredeepspeed

Posted 3 hours ago