Senior Software Engineer (AI Inference & Runtime Platform)
Careers Azx Io · Seattle
About this role
**Senior Software Engineer (AI Inference & Runtime Platform)** **About AZX** Accelerating positive impact in critical industries through AI transformation. We specialize in physics-informed ML and enterprise AI solutions for climate and sustainability challenges. Backed by leading investors, working with category leaders like CBRE, LevelTen Energy, Flexe, and more. **About This Role** Own the inference and runtime layer where AI physically executes. You'll manage: - **Inference Control Plane**: Open-weight models, GPU cloud hosting, Kubernetes orchestration with scale-to-zero economics and per-token cost accounting - **Agent Sandbox Platform**: Hardware-isolated microVMs for secure, compliant execution of untrusted agent code with least-privilege access Expect to write Rust, build Kubernetes controllers, and develop FastAPI endpoints across the full stack. **Key Responsibilities** - Manage serving tier for open-weight models (deployment, cold-start strategy, SLOs) - Administer Kubernetes layer (operators, autoscaling, GPU scheduling, node lifecycle) - Own stateful data plane with tested restore procedures - Oversee sandbox runtime and isolation boundary threat model - Direct FastAPI control-plane services and infrastructure-as-code (Terraform/Bicep) - Manage open-source posture with OSS standards and reproducible builds **Core Qualifications** - 5+ years shipping production systems in systems languages (Rust preferred; Go/C++/Zig welcome) - Operated Kubernetes workloads at scale (controllers, scheduling, autoscaling) - Strong threat-modeling of isolation boundaries (namespaces, cgroups, seccomp, hypervisors) - Hands-on LLM serving infrastructure (vLLM/SGLang or similar) - Performance discipline in distributed systems with measurement-driven optimization - Practical depth in Rust (tokio), Python/FastAPI, Kubernetes operators, KEDA, Karpenter - Familiarity with isolation tech (Firecracker, Kata, gVisor), secrets management, stateful systems - Multi-cloud/GPU substrate experience (AWS/Azure/GCP, infrastructure-as-code, observability) - Bachelor's Degree (Master's a plus) **Why AZX** - Fast-growing, profitable, mission-driven company - Competitive early-stage compensation + bonus + equity - Health insurance with dependent coverage - Flexible PTO • Fully remote with Seattle cluster **Requirements** - Must be authorized to work in the US full-time (no visa sponsorship) - Able to travel 2x/year for company summits - Interview includes take-home assignment + 2-hour technical session - Apply to max 2 roles per 6-month period **Note**: Don't check all boxes? We'd still love to hear from you!
Listing freshness
CronJobs last confirmed this listing 1h ago. If its source stops confirming the opening for seven days, this page is removed from active inventory.