Senior Software Engineer, AI Developer Experience
Vanta · Remote U.S.
About this role
## About the role At Vanta, our mission is to help businesses earn and prove trust. We believe security should be monitored and verified continuously—and we empower companies to practice better security with ease. The AI DX team is building the foundations for a more autonomous software development experience at Vanta, including background agents, agent evaluation systems, and tooling that helps engineers work more effectively with AI. As a **Senior Software Engineer** on the AI DX team, you’ll help shape these systems from the ground up—working directly with engineers to understand workflow friction, build practical solutions, and use evidence from real usage to continuously improve quality, reliability, and adoption. Learn more about the team’s work: https://www.vanta.com/all-categories/engineering ## What you’ll do - Plan, build, and improve **background-agent infrastructure** for reliable, trackable, and repeatable automated engineering work. - Develop **evaluation systems** for agent performance using task outcomes, quality measures, human intervention, cost, and other signals. - Create **evaluation sets and feedback loops** to help AI systems improve over time through regular review, tuning, and correction. - Improve how engineers **discover, understand, and use shared AI tools and workflows**. - Evaluate AI development tools (e.g., code generation, AI-assisted review, testing) against real engineering needs and help integrate what proves useful. - Build **visibility** into which tools/workflows work, where they create friction, and how they should evolve. - Create clear **guidance and documentation** to help engineers adopt new AI-enabled development practices. - Improve **code review workflows** using feedback from real engineering work to address recurring friction. - Influence the foundations of an **autonomous software factory**, including safe completion of bounded engineering tasks. - Partner with engineers and internal users to understand needs, validate solutions, and make thoughtful product tradeoffs. - Help move ambiguous, dependency-heavy projects from early exploration through reliable delivery. - Raise the quality bar through thoughtful code reviews, technical design discussions, testing, observability, and attention to reliability and security. - Collaborate closely with engineers and cross-functional stakeholders as a dependable, collaborative teammate. ## How to be successful in this role - Substantial industry **software engineering experience**. - Experience taking **technical leadership** roles on teams or complex projects. - Experience improving **AI systems**, creating evaluation sets, and driving quality through measurement and iteration. - Strong software engineering fundamentals; experience designing, building, testing, and operating reliable systems. - Experience with **developer tooling**, AI-enabled workflows, agentic systems, infrastructure, or related domains. - Track record working through ambiguity, decomposing complex problems, managing dependencies, and driving projects to completion. - Experience in rapidly scaling startups or larger companies with a strong bias for action. - Action-oriented approach; willingness to engage directly with users and contribute hands-on. - Product judgment and curiosity—strong technical opinions while staying focused on building platforms that meet users where they are. - Strong written and verbal communication; ability to explain technical concepts clearly and c
Listing freshness
CronJobs last confirmed this listing 1h ago. If its source stops confirming the opening for seven days, this page is removed from active inventory.