Software Engineer, ML Developer Experience
Anyscale · San Francisco
About this role
## About Anyscale Anyscale is on a mission to democratize distributed computing and make it accessible to software developers of all skill levels. We’re commercializing **Ray** (an open-source project for scalable machine learning) and building the best place to run Ray—so developers and data scientists can scale ML applications from laptop to cluster without needing to be distributed-systems experts. ## About the role Anyscale is looking for a **Software Engineer** to join the **ML Developer Experience (MLDevX)** team. MLDevX owns the “experience layer” of the Anyscale platform: the interfaces through which users and coding agents discover, configure, run, observe, debug, and productionize AI workloads. This includes the **CLI, SDKs, APIs, UI, Workspaces, MCP**, and the workflows/integrations built on top of them. You’ll work across the stack—from developer tooling to cloud infrastructure and the Ray runtime—building systems that: - Manage long-running operations - Improve failure diagnosis across jobs, tasks, actors, nodes, and GPUs - Scale with the platform and remain predictable through failures - Are intuitive for developers, programmable for applications, and operable by coding agents This is a high-impact individual-contributor role with end-to-end ownership, working directly with users and field teams to identify high-leverage problems, shape product/technical design, and build/operate solutions. ## Snapshot of projects you may work on - Build next-generation developer tooling and MLOps capabilities on Ray for both developers and coding agents - Develop an **agent-first CLI** and cohesive **SDK/API/MCP** surfaces (self-discovery, structured errors, dry-run support, consistent behavior) - Improve the path from local code to distributed execution via the **Workspaces** stack (environments, dependencies, images, authentication, submission, debugging) - Build cohesive experience/tools/frameworks across the AI development lifecycle (data prep, fine-tuning/post-training, evaluation, serving, dataset management, experiment tracking, lineage) - Create reliable production deployment paths (model registration, deployment workflows, performance benchmarking, LLM-specific service metrics) - Surface observability across CLI/SDK/UI and agent-facing interfaces to diagnose failures across the execution stack - Design open integrations using durable standards (e.g., **OpenAI-compatible APIs**, **OpenTelemetry**) and stable Jobs/Services interfaces for external orchestrators - Design and operate highly available backend services and platform architecture across serverless and bring-your-own-cloud environments ## What we’re looking for - Bachelor’s degree in Computer Science, Engineering, or equivalent practical experience - **5+ years** writing high-quality production code - Strong background in algorithms, data structures, and system design - Experience with modern machine learning tooling - Familiarity with **PyTorch**, **MLflow**, data catalogs, or similar - Hands-on experience building and operating highly available services in production - Strong product instincts and a track record shipping developer-facing tools people choose to use ## Bonus points - Experience building and maintaining open-source projects - Experience building/operating ML infrastructure in production - Experience building highly available serving systems - Experience using **Ray** ## Equal Opportunity Anyscale is an Equal Opportunity Employer and an E-Verify comp
Listing freshness
CronJobs last confirmed this listing 23h ago. If its source stops confirming the opening for seven days, this page is removed from active inventory.