Staff Software Engineer, Lakeflow Pipelines DR
Databricks · Mountain View, California; San Francisco, California
About this role
**Staff Software Engineer, Lakeflow Pipelines DR** **About the Role** Join Databricks' Lakeflow Disaster Recovery team to design and implement distributed systems that replicate and recover pipelines across regions. You'll solve critical problems involving consistency, idempotency, causal ordering, failover, and safe recovery without data loss or duplication. **Key Responsibilities** • Cross-region replication and recovery for Lakeflow pipelines, streaming tables, and materialized views • Distributed consistency across pipeline dependencies, table versions, and transaction logs • Failover and failback workflows with conservative correctness guardrails • Deep clone, metadata reconciliation, observability, and failure-injection testing • High-fidelity recovery simulations, game-day testing, and formal reasoning about failure modes **What We're Looking For** • Passion for distributed systems, databases, storage systems, streaming systems, or reliability engineering • Strong software engineering skills in Java, Scala, C++, Go, Python, or similar production languages • Understanding of consistency, transactions, idempotency, replication, checkpointing, and data lineage • Ability to define and work toward multi-year technical vision with incremental, production-quality deliverables • 8+ years of experience working on related systems (preferred) • PhD or advanced research experience in databases, distributed systems, or storage (optional) **Compensation** $192,000 – $260,000 USD + annual performance bonus, equity, and comprehensive benefits **About Databricks** Databricks is the Data and AI company. 20,000+ organizations worldwide—including 70% of the Fortune 500—rely on the Databricks Data + AI Platform. Headquartered in San Francisco with 30+ global offices.
Listing freshness
CronJobs last confirmed this listing 14h ago. If its source stops confirming the opening for seven days, this page is removed from active inventory.