Senior Software Engineer - Multi Cloud Efficiency

P-1563

At Databricks, we are passionate about enabling data teams to solve the world’s toughest problems — from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world’s best data and AI infrastructure platform so our customers can use deep data insights to improve their business. Founded by engineers — and customer obsessed — we leap at every opportunity to solve technical challenges, from designing next-gen UI/UX for interfacing with data to scaling our services and infrastructure across millions of virtual machines. And we’re only getting started in Bengaluru , India ! As a software engineer with a backend focus, you will work with your team to build infrastructure for the Databricks platform at scale.

About the Team

We manage the infrastructure efficiency for one of the world’s largest data and AI platforms. Operating at massive scale across AWS, Azure, and GCP, our mission is to ensure that every dollar spent on cloud infrastructure is optimized. The MCE team builds the critical tools, frameworks, and automated systems that provide deep cost visibility and ensure maximum resource utilization. We are looking for engineers to help us engineer systems that optimize our footprint as we scale into the hundreds of millions of dollars in cloud spend.

The Role

As a Senior Software Engineer, you will own the end-to-end design and delivery of high-impact engineering projects. You will act as a primary owner of key system components, handling technical ambiguity, collaborating with stakeholders, and delivering robust, scalable solutions. Your work will directly impact our infrastructure margins by building the next generation of cost attribution, automated resource management, and efficiency tooling.

The impact you will have

• End-to-End System Design: Lead projects from concept to deployment. You will design and build scalable systems that handle high-volume data streams to provide accurate cost attribution and resource management, turning chaotic cloud spend into actionable data.
• Scaling & Optimization: Identify and eliminate inefficiencies in our cloud architecture. You will engineer solutions that mitigate resource waste, improve attribution accuracy, and raise the efficiency of our underlying cloud and data infrastructure.
• Component Ownership: Act as the technical expert for your service area. You will take ownership of the full lifecycle of your services, ensuring high code quality, effective monitoring, and low operational overhead.
• Bridge the Gap: Work effectively with product and infrastructure teams to turn business needs into technical specifications. You will develop tooling that simplifies the complex world of cloud economics for other engineers and budget owners.
• Mentorship & Best Practices: Uplevel the team by contributing to code reviews, sharing engineering best practices, and mentoring junior engineers. You will drive a shift-left culture — catching cost and efficiency problems early in the development cycle — by integrating efficiency checks directly into the developer workflow.
• Automate the manual: Build the automation and AI/agentic tooling that detects waste, attributes cost, and remediates issues with minimal human intervention — turning repetitive cost operations into self-running systems.

What We Look For

• 6+ years of experience, including producing high-quality production code and detailed technical design documents for distributed systems.
• Proven ability to break down complex, multi-month projects into actionable milestones and tasks.
• Solid grasp of industry best practices for distributed systems (monitoring, documentation, testing, and “fit and finish”).
• Experience in optimizing cloud resource utilization or developing large-scale distributed tools.
• Ability to make well-reasoned trade-offs between system performance, development velocity, and technical debt.

About Databricks

Databricks is the data and AI company. More than 10,000 organizations worldwide — including Comcast, Condé Nast, Grammarly, and over 50% of the Fortune 500 — rely on the Databricks Data Intelligence Platform to unify and democratize data, analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache Spark™, Delta Lake and MLflow. To learn more, follow Databri…