Senior Backend Software Engineer, AI Observability & Evals Platform (NYC)
LangChain · New York, NY
About this role
## About LangChain LangChain’s mission is to make intelligent agents ubiquitous. We build the foundation for agent engineering in the real world—helping developers move from prototypes to production-ready AI agents. Our platform includes **LangSmith** (Observability, Evaluation, Deployment, Fleet, and Sandboxes), open-source frameworks (**LangChain, LangGraph, Deep Agents**), and the newly launched **LangSmith Engine** for autonomous agent improvement. ## About the Team The **LangSmith team** owns and builds LangChain’s core platform for **observability, evaluation, and production reliability** of AI systems—end-to-end, from tracing and annotation to run rules, evaluations, and more. ## About the Role We’re hiring a **Senior Backend Software Engineer** to build backend systems powering LangChain’s **observability and evals platform**. You’ll work on core services that help developers **monitor and evaluate AI applications at scale**. While the focus is backend feature development, experience with full-stack/frontend concepts, performance tuning, and production debugging is a plus. ## What You’ll Do - Design, develop, and maintain backend services and APIs for LangSmith tracing, monitoring, and evaluation workflows - Collaborate on architecture to ensure systems are performant and maintainable - Optimize storage and query performance for high-volume observability/evaluation data - Ensure reliability with strong testing, monitoring, and alerting practices - Troubleshoot production issues with root-cause analysis and long-term fixes - Create and maintain technical documentation (system design, API references) - Partner with full-stack engineers, product managers, and product designers to roll out new features ## What You’ll Bring - **5+ years** of professional backend engineering experience on complex products - Proficiency in one or more backend languages/frameworks—**Python or Go preferred** - Strong API design skills and experience building reliable data services - Experience with high-throughput or mission-critical systems - Proven ability to optimize backend services for performance and reliability - Experience with **Postgres, Redis, ClickHouse** and **AWS/GCP/Azure** - Strong communication and cross-functional collaboration - Customer-centricity and an ownership mindset ## Compensation & Benefits - **Annual salary range:** $180,000–$240,000 - Compensation includes base salary, variable compensation (for relevant roles), meaningful equity, and benefits/perks - Benefits include medical, dental, and vision coverage, flexible vacation, a 401(k) plan, meals on in-office days in the US, and more
Listing freshness
CronJobs last confirmed this listing 2h ago. If its source stops confirming the opening for seven days, this page is removed from active inventory.