Engineering Manager, Forward Deployed Engineering (LLM)
Baseten · San Francisco
About this role
**Engineering Manager, Forward Deployed Engineering (LLM)** **About Baseten** Baseten powers mission-critical inference for dynamic AI companies like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma, and Writer. Recently raised $1.5B Series F led by Altimeter Capital, Conviction Partners, and Spark Capital. **The Role** Lead and mentor a team of Forward Deployed Engineers building, scaling, and optimizing LLM inference workloads. As a Player & Coach, you'll provide hands-on technical ownership while guiding your team through designing, deploying, and managing high-performance AI applications on Baseten's platform. **Key Responsibilities** • Lead, mentor, and grow a Forward Deployed Engineering team • Set clear goals and ensure high-quality delivery across customer-facing LLM projects • Develop production-level software systems using Python and general-purpose languages • Design and deploy end-to-end Baseten solutions (problem framing → evaluation → production → monitoring) • Own products and customer projects end-to-end as engineer, project manager, and product manager • Drive customer impact through inference optimization and technical excellence **Requirements** • Bachelor's, Master's, or Ph.D. in Computer Science, Engineering, or related field • 4+ years professional software engineering experience (1+ year in leadership/mentorship) • Strong Python skills with production ML inference system experience • Proven experience with LLMs, inference optimization, or serving frameworks (vLLM, TensorRT, Triton, Hugging Face, Ray Serve) • Familiarity with observability, profiling, and cost/performance tradeoffs in production ML • Excellent communication and cross-functional collaboration skills **Nice to Have** • Experience leading customer-facing engineering teams or working with enterprise partners • Deep understanding of GPU infrastructure, distributed inference, or model compression **Benefits** • Competitive compensation with meaningful equity • 100% medical, dental, vision coverage (U.S.) • Flexible PTO + company Winter Break • Paid parental leave • Fertility and family-building stipend (Carrot) • 401(k) facilitation (U.S.) • Exposure to diverse ML startups and networking opportunities **Equal Opportunity Employer** - Committed to fostering a diverse and inclusive workplace.
Listing freshness
CronJobs last confirmed this listing 1h ago. If its source stops confirming the opening for seven days, this page is removed from active inventory.