Staff Software Engineer, Observability
Cerebras · Sunnyvale, CA
About this role
**Cerebras Systems — Staff Software Engineer, Observability** Cerebras builds the world’s largest AI chip—56× larger than GPUs—enabling industry-leading training and inference speeds (10× faster than GPU-based hyperscale cloud inference). This role helps build the observability platform that powers real-time iteration and reliable operation at Cerebras scale. --- ## Responsibilities - **Set Technical Direction:** Own the long-term architecture and roadmap for the observability platform across **metrics, logs, traces, and events**. Drive adoption via **RFCs, design reviews**, and close partnership with stakeholders. - **Build for Cerebras-Scale:** Design telemetry pipelines for **high-cardinality, high-frequency** data from thousands of **Wafer-Scale Engines**, large **Kubernetes clusters**, and the storage/network fabric. Solve ingestion and query performance problems that break conventional approaches. - **Drive Reliability Across the Organization:** Partner with **Engineering, SRE, Hardware, and ML Infrastructure** to define **SLOs**, build alerting strategies, and create tooling that accelerates root cause analysis and reduces **MTTR**. - **Bridge Hardware and Software Observability:** Surface critical **hardware health signals** into a unified observability layer alongside software metrics. - **Shape Developer Experience:** Design and implement **instrumentation libraries and standards (OpenTelemetry)** so rich observability is the default for every service. Establish conventions that scale across teams. - **Mentor and Grow Engineers:** Raise the technical bar by mentoring senior engineers, influencing practices across teams, and fostering a culture of operational excellence. --- ## Qualifications - **8+ years** software engineering experience, including **4+ years** building or operating observability/monitoring platforms at significant scale (e.g., **millions of active time series**, **petabytes of log data**). - Deep expertise in the open-source observability ecosystem; experience operating/tuning/extending systems such as **Prometheus**, **Thanos/Cortex/Mimir**, **Elasticsearch/ClickHouse**, or **Loki** (internals, failure modes, and cost characteristics). - Experience with **OpenTelemetry** for instrumentation across a polyglot services environment. - Proficiency in **Go** preferred, with strong experience in **Python**. You build performant, concurrent systems—not just glue scripts. - Strong **distributed systems** and **Kubernetes** expertise (sharding, replication, consistency models, monitoring K8s and workloads, and tradeoffs for reliable data pipelines at scale). - Experience with **observability cost management** and **capacity planning** at scale. - Track record of setting technical direction and driving adoption across multiple teams; comfortable operating with ambiguity and translating business needs into technical strategy. --- ## Why Join Cerebras People who are serious about software make their own hardware. Cerebras is at an inflection point with rapid growth and dozens of model releases. **Five reasons team members joined:** 1. Build a breakthrough AI platform beyond GPU constraints. 2. Publish and open source cutting-edge AI research. 3. Work on one of the fastest AI supercomputers in the world. 4. Enjoy job stability with startup vitality. 5. A simple, non-corporate work culture that respects individual beliefs. Learn more: https://www.cerebras.ai/join-us --- **Apply today** and help drive groundbrea
Listing freshness
CronJobs last confirmed this listing 1h ago. If its source stops confirming the opening for seven days, this page is removed from active inventory.