Software Engineer - Model Performance
Baseten · San Francisco
About this role
**Software Engineer - Model Performance** **About Baseten** Baseten powers mission-critical inference for leading AI companies like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma, and Writer. We recently raised our $1.5B Series F and are building the platform engineers use to ship AI products. **The Role** We're seeking a Software Engineer focused on ML performance to join our team. This role is ideal for backend engineers who thrive on making things faster and are excited about open-source ML models and LLM inference. **Key Responsibilities** • Implement and productionize cutting-edge techniques (quantization, speculative decoding, KV cache reuse, chunked prefill, LoRA) • Debug ML performance issues in TensorRT, PyTorch, TensorRT-LLM, vLLM, sglang, CUDA • Apply optimization techniques across ML models, particularly large language models • Collaborate on innovative solutions and own projects from idea to production **Requirements** • Bachelor's, Master's, or Ph.D. in Computer Science, Engineering, Mathematics, or related field • Experience with Python or C++ • Familiarity with LLM optimization techniques • Strong experience with PyTorch, TensorRT, or TensorRT-LLM • Deep understanding of GPU architecture **Nice to Have** • CUDA or similar technologies experience • Docker and Kubernetes experience • Track record of deploying AI/ML inference solutions **Benefits** • Competitive compensation with meaningful equity • 100% medical, dental, vision coverage (U.S.) • Flexible PTO + company Winter Break • Paid parental leave & fertility stipend • 401(k) (U.S.) **Equal Opportunity Employer** - We welcome qualified applicants from all backgrounds.
Listing freshness
CronJobs last confirmed this listing 2h ago. If its source stops confirming the opening for seven days, this page is removed from active inventory.