Staff Software Engineer – Feature Experimentation Platform

P-186

At Databricks, we are obsessed with enabling data teams to solve the world’s toughest problems, from security threat detection to cancer drug development. We do this by building and running the world’s best data and AI infrastructure platform, so our customers can focus on the high value challenges that are central to their own missions.

We develop and operate one of the largest scale software platforms. The fleet consists of millions of virtual machines, generating terabytes of logs and processing exabytes of data per day. At our scale, we regularly observe cloud hardware, network, and operating system faults, and our software must gracefully shield our customers from any of the above.

The Feature Experimentation team is building our next-generation Experimentation Platform to empower data-driven innovation and engineering at scale. We are looking for a Staff Software Engineer to drive the architecture, design, and development of our experimentation infrastructure, ensuring high reliability, low latency, and seamless user experience.

The Impact You Will Have

• Build the next-generation experimentation platform from scratch to unlock more, better, and faster innovations.
• Develop high-performance distributed systems that create self-driving, real-time, end-to-end feedback-loop to the production.
• Partner with data scientists, ML engineers, and product teams to enhance experimentation capabilities.
• Drive technical excellence and mentoring engineers to elevate our engineering standards.

What We Look For

• Strong experience in distributed systems, experimentation platforms, or data infrastructure.
• Deep understanding of statistics, A/B experimentation, performance and health metrics, and observability.
• Proficiency in Scala, Java, or Python and familiarity with modern cloud infrastructure.
• Passion for building scalable, reliable, and high-performance systems.