Member of Technical Staff, GPU Infrastructure
Cohere · Seattle
About this role
## Cohere — Member of Technical Staff, GPU Infrastructure ### About Cohere Cohere is a leading, security-first enterprise AI company. We build foundation AI models and end-to-end products designed to solve real business problems—training and deploying frontier models for enterprises building AI systems. ### Why this team (Internal Infrastructure) Internal Infrastructure builds the infrastructure and tools used to train, evaluate, and serve Cohere’s foundation models. You’ll work with AI researchers and ML engineers on **stability, scalability, and observability**, and help accelerate the models behind Cohere’s platform. You’ll also run the shared Kubernetes fleets where these workloads land: **multi-cloud GPU and TPU clusters**, including **node health, performance**, and partnerships with cloud providers and hardware vendors. > This role includes a **compensated 24x7 on-call rotation**. --- ## What you will do - Deploy and operate **GPU Kubernetes clusters** across clouds, and bring up **new hardware generations and providers**. - Partner with **cloud providers and hardware partners** on reliability, performance, and cost (including **RDMA** and high-speed interconnects). - **Automate node/GPU/fabric fault detection and remediation** so most faults are fixed without human intervention. - Improve **fleet utilization**, track **cost**, and reduce the time to return faulty nodes to service. - Troubleshoot **production failures** and **performance issues**, leaving systems easier to operate than you found them. --- ## You may be a good fit if you have - Experience running **GPU Kubernetes clusters** with **thousands of GPUs** for ML or HPC workloads. - Debugging skills in **Linux**, **networking**, and **performance** problems. Familiarity with **RDMA**, **NCCL**, or accelerator health is a plus. - Software experience in **Python or Go**—you’d rather extend solid open-source than rebuild it. - Experience working with researchers, ML engineers, or teams with different goals. - A track record of finding bottlenecks, proposing fixes, and driving improvements in a fast-moving environment. > If you don’t match perfectly, you’re still encouraged to apply. --- ## Hiring level Cohere hires at more than one level. The level is determined based on the scope you’ve owned and how independently you drive work. --- ## Perks (full-time employees) - Weekly lunch stipend: **$75/£75** (or equivalent) - Full health and dental benefits, including a separate mental health budget - **RRSP matching**, **401K**, Pension Scheme - **100% parental leave top-up** for up to 6 months (either parent) - Annual enrichment benefits (arts & culture, fitness/wellness, quality time) + workspace improvement credit - Education & learning stipend for conferences, courses, and coaching - **6 weeks paid vacation** (30 working days) - Travel budget to other offices if remote + annual company offsite - **$500 home office stipend** --- ## How and where we work - Remote-friendly, with offices in **Toronto, London, New York City, San Francisco, Montreal, Paris, Berlin, and Seoul** (more opening soon) - Office perks include daily lunch program, snacks, and community/social events - For those not near an office: co-working benefit --- ## Equal opportunity & accommodations Cohere is committed to an inclusive work environment and equal opportunities. If you need accommodations during the recruitment process, submit an Accommodations Request Form: https://docs.google.com/fo
Listing freshness
CronJobs last confirmed this listing 54m ago. If its source stops confirming the opening for seven days, this page is removed from active inventory.