Software Engineer, TPU Compilers
OpenAI · San Francisco
About this role
## About the Team Our Inference team brings OpenAI’s most capable research and technology to the world through our products. We empower consumers, enterprises, and developers to use and access state-of-the-art AI models—enabling capabilities that weren’t previously possible. We focus on **performant and efficient model inference**, and on **accelerating research progression** via model inference. ## About the Role We’re looking for an engineer to **lead the optimization of OpenAI’s frontier models on TPUs**. You’ll own performance across the full forward pass—from **model code** through **kernels** to **execution on the hardware**. You’ll have broad technical ownership: identifying performance bottlenecks, choosing the most impactful improvements, and carrying them through implementation and validation. We welcome experience from either **training or inference**, with a strong foundation in optimizing real workloads on TPUs. ## In This Role, You Will - **Optimize model execution on TPUs**, improving performance across the complete forward pass and the interactions between model code, kernels, and hardware. - **Profile workloads**, identify bottlenecks, and implement improvements to **latency**, **throughput**, and **hardware utilization**. - **Develop and optimize kernels**, using an understanding of the surrounding model to guide implementation choices. - Explore techniques such as **quantization** to improve inference efficiency while preserving model quality. - **Build benchmarks and tools** to measure performance, validate correctness, and guide optimization work. - Partner with **researchers and engineers** to support new model architectures and bring performance improvements into production. ## You Might Thrive If You - Have practical experience optimizing **machine learning workloads on TPUs** (training, inference, or both). - Understand modern **model architectures** and how their computation maps onto accelerator hardware. - Can connect detailed **kernel behavior** to the performance of a complete model and work across these layers of the stack. - Bring strong **software engineering** skills and a systematic approach to profiling, debugging, and validating performance improvements. - Take ownership of open-ended technical problems—identify priorities, make design decisions, and deliver working solutions. - Enjoy collaborating with researchers and engineers, learning unfamiliar parts of a system, and communicating technical tradeoffs. - Have experience with **quantization** or **attention kernels** (especially useful). ## About OpenAI OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose AI benefits all of humanity. We push the boundaries of AI capabilities and seek to safely deploy them through our products. OpenAI is an **equal opportunity employer** and provides reasonable accommodations for applicants with disabilities. *For additional policy and background check information, please refer to the posting details.*
Listing freshness
CronJobs last confirmed this listing 1h ago. If its source stops confirming the opening for seven days, this page is removed from active inventory.