Senior Software Engineer – Network Observability
Clockworksystems · Onsite Palo Alto, California
About this role
## About Clockwork Systems **Clockwork.io – Software Driven Fabrics to increase GPU cluster utilization** Clockwork Systems was founded by Stanford researchers and veteran systems engineers who share a vision for redefining the foundations of distributed computing. As AI workloads grow increasingly complex, traditional infrastructure struggles to meet the demands of performance, reliability, and precise coordination. Clockwork is pioneering a **software-driven approach to AI fabrics** by delivering **cross-stack observability** to catch and quickly resolve problems, **workload fault tolerance** to keep jobs running through failures, and **performance acceleration** that dynamically routes and paces traffic to avoid congestion. Learn more: https://www.clockwork.io --- ## About the Role We are seeking an experienced **Senior Software Engineer** to contribute to the architecture, development, and scaling of a high-performance network monitoring and observability platform. This role focuses on building systems that provide deep visibility into **RDMA, RoCE, InfiniBand, and TCP/IP** networks. The ideal candidate has strong experience in distributed systems, Linux networking, and modern observability stacks (e.g., **Grafana/Prometheus**). --- ## What You Will Do - Design, develop, and scale high-performance network monitoring platforms for **RDMA, RoCE, InfiniBand, and TCP/IP** infrastructure. - Build backend telemetry services, observability dashboards, alerts, diagnostics, anomaly detection, SLA monitoring, and traffic analysis workflows. - Troubleshoot complex production issues across application, OS, server, RDMA, and network layers while optimizing low-latency collection, aggregation, and alerting. - Collaborate with cross-functional teams to deliver scalable solutions, improve engineering practices, automate operational workflows, and contribute to the technical direction of the platform. --- ## What We’re Looking For - Bachelor’s or Master’s degree in Computer Science, Computer Engineering, Electrical Engineering, or a related technical field. - Strong hands-on programming experience in **C++, Go, Python, Rust**, or similar systems programming languages. - Proven experience delivering complex infrastructure projects and contributing to the design and implementation of distributed systems. - Experience building distributed systems, backend services, telemetry pipelines, or observability platforms. - Hands-on experience with **RDMA, RoCE, InfiniBand**, or other high-performance network fabrics. - Familiarity with **libibverbs**, RDMA verbs, RDMA CM, queue pairs, completion queues, memory registration, and related RDMA concepts. - Strong knowledge of **Linux networking** and **TCP/IP** fundamentals (DNS, HTTP, routing, MTU, congestion control, packet loss, latency, performance tuning). - Experience with traceroute-style diagnostics, path discovery, network reachability checks, synthetic probes, or active network measurements. - Experience with monitoring/visualization platforms such as **Prometheus, Grafana, Datadog, Splunk, OpenTelemetry**, or similar tools. - Strong debugging skills across software, operating system, server, and network layers. - Experience operating production systems in Linux-based environments. - Strong technical judgment and ability to build reliable, scalable, and maintainable systems. --- ## Nice to Have - Experience supporting **AI/ML, HPC, storage, or GPU cluster** infrastructure workloads. - Experie
Listing freshness
CronJobs last confirmed this listing 2h ago. If its source stops confirming the opening for seven days, this page is removed from active inventory.