CronJobs

devops-sre jobs

Inference Engineering and Product Lead

Modal · San Francisco

onsitesenior$300,000–$350,000Posted Sep 16, 2026GPUKubernetesLinuxDistributed SystemsLLM InferenceCloud InfrastructureContainer Runtime

Apply on the employer site

About this role

**Inference Engineering and Product Lead** **About Modal** Modal is building a new infrastructure layer for AI. We're trusted by category-defining companies like Lovable, Ramp, Cognition, DoorDash, and Suno for instant GPU access, sub-second container starts, and native storage. Recently raised $355M Series C at $4.65B valuation; $300M+ ARR with 5x growth since September. **The Role** Lead Modal's market-leading LLM inference platform spanning the serving stack, routing infrastructure, optimization platform, and user-facing product. This is a hands-on leadership role balancing technical contribution, product shaping, and people management. **Key Responsibilities** • Recruit, hire, and grow a high-performing engineering team • Drive technical and product decisions through design reviews and architectural discussions • Lead efforts with frontier customers to ensure success on Modal • Translate customer learnings into roadmap for optimization platform and product • Establish reliability and product excellence standards • Partner cross-functionally on compute strategy, GTM, and infrastructure roadmap **Requirements** • 10+ years industry experience (3+ in leadership) • Track record building high-performance systems at scale • Strong cloud infrastructure background • Deep knowledge of OS foundations (Linux kernel, file systems, containers) • *Nice to have:* LLM inference production experience; knowledge of engines, kernels, routing, KV cache management, speculative decoding

Listing freshness

CronJobs last confirmed this listing 58m ago. If its source stops confirming the opening for seven days, this page is removed from active inventory.

Browse all software engineering jobs →

Follow fresh jobs in Discord