Senior Software Engineer — Infra Agent Systems
Together AI · San Francisco
About this role
**Senior Software Engineer — Infra Agent Systems** **About the Role** Together AI runs one of the largest GPU fleets in the world. The Infra Agent Systems team builds the software systems that power and automate that infrastructure. You'll work across two areas: • **Infrastructure Agent Systems** - Build production AI agents that diagnose failures, investigate incidents, and assist with remediation across the GPU fleet • **Core Agent Platform** - Build the platform powering these agents, including knowledge graphs, search/retrieval, orchestration, and evaluation **Key Responsibilities** • Design and build production AI agent systems for infrastructure diagnostics and remediation • Build distributed services, orchestration frameworks, knowledge graphs, and retrieval systems • Develop fleet intelligence systems combining telemetry, state, and operational knowledge • Integrate with observability, incident management, and internal infrastructure systems • Own services end-to-end: architecture, implementation, testing, deployment, and operations • Improve agent performance through evaluations and production feedback loops **Requirements** • 5+ years building production backend systems, distributed systems, or infrastructure platforms • Strong systems design skills and experience owning significant systems from design through production • Depth in one of: AI agent systems, knowledge graphs, or search/retrieval/RAG systems • Strong backend engineering: API design, service boundaries, data modeling • Experience with Kubernetes, GitOps (ArgoCD), infrastructure-as-code, cloud platforms • Comfortable with Go, TypeScript, Python, or Rust **Nice to Have** GPU infrastructure, graph databases, event-driven systems (NATS/Kafka), observability platforms, LLM evaluation frameworks **Compensation** $250,000 - $300,000 + equity + benefits (US base salary) Together AI is an Equal Opportunity Employer.
Listing freshness
CronJobs last confirmed this listing 19h ago. If its source stops confirming the opening for seven days, this page is removed from active inventory.