Lead Data Platform Engineer

Lead Data Platform Engineer (Databricks) UK-Based | Hybrid / Flexible Working £100k-£120k package Top-Tier Consultancy | Enterprise Data Transformation | Cloud-Native Platforms We’re working with a top-tier consultancy delivering large-scale data and digital transformation across regulated industries. They are seeking a Lead Data Platform Engineer to take ownership of the design, build, and leadership of modern data platforms, with a strong focus on Databricks and cloud-native tooling. This is a hands-on technical leadership role — ideal for someone who’s equally comfortable designing robust data architectures, leading engineering teams, and engaging in strategic conversations around delivery, best practices, and platform evolution. Key Responsibilities Lead the design and delivery of production-grade, cloud-native data platforms Work across multiple concurrent projects, setting direction and ensuring engineering excellence Collaborate with stakeholders, including involvement in pre-sales and delivery estimation (>£1m) Embed best practices for data engineering workflows using Databricks and IaC Ensure platforms meet resilience, recovery, security, and compliance standards Mentor engineers and contribute to capability growth across the team ✅ What You’ll Bring 10 years in software/systems engineering roles 2 years hands-on with Databricks (Professional-level certified) Proven track record leading engineering teams and delivering complex platforms Strong experience with Terraform and infrastructure-as-code best practices Background in designing both cloud-native and hybrid data architectures Solid understanding of cloud security, networking, and DR principles Experience working on major digital transformation or IT consolidation programmes Tech Stack / Tooling Databricks , Spark, Delta Lake Terraform , GitHub/GitLab, Azure DevOps Cloud-native services: e.g. GCP (Dataflow, BigQuery), Azure, or AWS equivalents Jira, Confluence CI/CD and DevSecOps best practices Certifications (Preferred) Databricks Certified Professional (Data or ML Engineer), ideally also Architect-level Cloud architecture certification (AWS, Azure, or GCP) Degree or MSc in Computer Science, Software Engineering, or similar