Software Engineer - Infrastructure
Baseten · San Francisco
About this role
**Software Engineer - Infrastructure** **About Baseten** Baseten powers mission-critical inference for leading AI companies like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma, and Writer. We recently raised our $1.5B Series F and are building the platform engineers turn to for shipping AI products. **The Role** Build and maintain components of our ML inference platform that powers production AI applications. You'll contribute to core infrastructure, enabling developers to deploy, scale, and monitor ML models with high performance. **Key Projects** • Multi-cloud capacity management • Inference on B200 GPUs • Multi-node inference • Fractional H100 GPUs for efficient model serving **Responsibilities** • Develop infrastructure components using Python and Go • Implement and maintain Kubernetes deployments for model serving • Contribute to inference orchestration layer • Build and enhance monitoring systems for model performance • Implement efficient resource management for ML workloads • Support infrastructure automation • Collaborate on technical solutions and best practices **Requirements** • Bachelor's degree in Computer Science or related field • Proficient in Python, Go, or similar languages • Working knowledge of Kubernetes and containerization • Basic understanding of ML concepts and model serving • Familiarity with distributed systems • Experience with monitoring and logging tools • Strong collaboration and communication skills **Benefits** • Competitive compensation with meaningful equity • 100% medical, dental, vision coverage (U.S.) • Flexible PTO + company Winter Break • Paid parental leave • Fertility and family-building stipend • 401(k) matching (U.S.) • Exposure to ML startup ecosystem **Equal Opportunity Employer**
Listing freshness
CronJobs last confirmed this listing 1h ago. If its source stops confirming the opening for seven days, this page is removed from active inventory.