Engineering Manager, Kubernetes Bare Metal Infrastructure
Together AI · San Francisco
About this role
**Engineering Manager, Kubernetes Bare Metal Infrastructure** **About The Role** Lead the team running Kubernetes on bare-metal GPU infrastructure at Together AI. Own provisioning, orchestration, and health management of thousands of GPUs across data centers for customers training, fine-tuning, and serving models. **Key Responsibilities** • Set technical direction for bare-metal Kubernetes across multiple data centers and regions • Drive automated, zero-touch provisioning from firmware through cluster validation • Own cluster lifecycle: upgrades, capacity expansion, health checks, remediation, decommissioning • Make GPU scheduling, topology-aware placement, and high-performance networking first-class • Define and meet SLOs for cluster availability, node bring-up time, and GPU utilization • Build observability across hardware, networking, Kubernetes, and workloads • Hire, manage, and develop infrastructure and platform engineers • Run team planning, prioritization, and delivery with sustainable on-call culture • Collaborate with data center ops, networking, vendors, and product teams **Requirements** • 8+ years infrastructure/SRE/platform engineering; 2+ years managing engineers • Deep hands-on Kubernetes production experience at scale, ideally bare metal • Strong Linux systems, networking, and hardware knowledge • Experience with fleet provisioning automation (Cluster API, Metal3, Ironic, MAAS, Ansible, Terraform) • Track record owning production systems with on-call and incident response • Strong technical judgment and clear communication **Nice to Have** • Large NVIDIA GPU cluster experience (H100, H200, B200, GB200) • InfiniBand, RoCE, SR-IOV, high-performance storage knowledge • Slurm, Kueue, Volcano, or batch scheduler experience • Kubernetes/CNCF contributions • AI lab, GPU cloud, or hyperscaler experience **Compensation** $300,000–$350,000 + equity + benefits (US base salary) **Equal Opportunity Employer**
Listing freshness
CronJobs last confirmed this listing 2h ago. If its source stops confirming the opening for seven days, this page is removed from active inventory.