Software Engineer, Agent Optimization & Evaluation
Reddit · Remote - United States
About this role
<div class="content-intro"><div class="c-message_kit__blocks c-message_kit__blocks--rich_text"> <div class="c-message__message_blocks c-message__message_blocks--rich_text" data-qa="message-text"> <div class="p-block_kit_renderer" data-qa="block-kit-renderer"> <div class="p-block_kit_renderer__block_wrapper p-block_kit_renderer__block_wrapper--first"> <div class="p-rich_text_block"> <div class="p-rich_text_section">Reddit is a community of communities. It’s built on shared interests, passion, and trust, and is home to the most open and authentic conversations on the internet. Every day, Reddit users submit, vote, and comment on the topics they care most about. With 100,000+ active communities and approximately 130 million daily active unique visitors, Reddit is one of the internet’s largest sources of information. For more information, visit <a class="c-link" href="http://www.redditinc.com/" target="_blank" data-stringify-link="http://redditinc.com" data-sk="tooltip_parent">www.redditinc.com</a>.</div> </div> </div> </div> </div> </div></div><h3><strong>We are Software Engineers across multiple levels!<br><br>The Team<br></strong></h3> <p>We're building Reddit's next-generation AI developer platform: a best-in-class agent stack that helps every Snoo build, test, review, and ship software efficiently while preserving Reddit's control over quality, costs, and long-term AI strategy. Our optimization harness measures and improves agents across the software development lifecycle by benchmarking models, detecting regressions, optimizing routing, incorporating production feedback, and improving developer productivity.<strong><br><br></strong><span style="font-size: 14px;">You'll report to Kyle Maxwell and partner with Platform Engineering, Infrastructure, and Developer Productivity to shape AI-assisted software development across Reddit.</span></p> <h3>The Role</h3> <p>As a<strong>&nbsp;Software Engineer, Agent Optimization &amp; Evaluation</strong>, you will lead our agent optimization and evaluation platform.&nbsp;You'll build systems to measure and improve agents' impact on engineering velocity, including Reddit-specific evaluation environments, intelligent model orchestration, and feedback loops that learn from production usage.&nbsp;This hands-on role involves writing production code and building new systems with ownership and autonomy. Strong platform and infrastructure partners will support your work on agent optimization, evaluation, and orchestration.</p> <h3>What You’ll Do:</h3> <ul> <li>Design and build Reddit's agent optimization harness for evaluating, benchmarking, and improving AI agents across real software engineering workflows.</li> <li>Develop Reddit-specific evaluation environments that accurately measure agent performance against meaningful engineering tasks.</li> <li>Build systems for offline replay, automated evaluation, synthetic task generation, regression detection, and human-in-the-loop feedback.</li> <li>Design model routing and orchestration...
Listing freshness
CronJobs last confirmed this listing 52m ago. If its source stops confirming the opening for seven days, this page is removed from active inventory.