Staff Software Engineer, Agent Quality
Databricks · New York City, New York
About this role
**Staff Software Engineer — Agent Quality** *P-1567* At Databricks, we enable data teams to solve the world’s toughest problems—from security threat detection to cancer drug development—by building and running the world’s best data and AI platform. The Databricks AI Research organization is pushing the frontier of next-generation enterprise AI. As a **Staff Software Engineer — Agent Quality**, you’ll be a founding member of a new team focused on **evaluating and continuously improving Databricks AI Agents**. ## The impact you will have - Stand up foundational evaluation infrastructure for **Genie Agents**, enabling rigorous benchmarking, regression detection, and quality measurement across research and product teams. - Build the flywheel that connects evaluation results back into agent improvement—closing the loop between production signals, training, and iterative development. - Shape the long-term technical direction for agent quality infrastructure, with real influence over how Databricks measures and improves its first-party agents and agent development platform. ## What we look for - **6+ years** industry experience building software systems - Strong **Python** skills, with experience building production or research infrastructure - Experience building/operating **distributed systems**, **data pipelines**, or large-scale infrastructure with a focus on reliability, correctness, and operational maturity - Ability to design pragmatic but rigorous systems that produce trustworthy, reproducible signals for complex applications - Comfort working across ambiguous research and product boundaries, partnering with both researchers and engineers to turn ideas into robust internal platforms - High bar for technical quality, strong ownership, and ability to influence roadmap and execution across multiple teams ## Nice to have - Experience with **devtools**, **CI/CD**, testing frameworks, **observability**, or benchmarking infrastructure - Familiarity with how **LLM/agent quality** is measured (e.g., evals, experimentation platforms, or production monitoring) ## About Databricks Databricks is the Data and AI company. More than 20,000 organizations worldwide—including adidas, AT&T, Bayer, Block, Mastercard, Rivian, Unilever, and 70% of the Fortune 500—rely on the Databricks Data + AI Platform to build and scale data and AI apps, analytics, and agents. ## Benefits For specific details on benefits offered in your region, see the link provided in the original posting. ## Diversity & Inclusion Databricks is committed to fostering a diverse and inclusive culture and to inclusive hiring practices. ## Compliance If access to export-controlled technology or source code is required for performance of job duties, it is within the Employer’s discretion whether to apply for a U.S. government license, and the Employer may decline to proceed based on that basis alone.
Listing freshness
CronJobs last confirmed this listing 2h ago. If its source stops confirming the opening for seven days, this page is removed from active inventory.