Senior Databricks Consultant
Permanent | Full-time | Senior Consultant | Melbourne
About my client
My client is a data consultancy that helps organisations shape their data, analytics and AI capability. They are growing their Databricks practice and are looking for a senior specialist to lead delivery, mentor the team and help establish them as a Databricks solutions leader in the market.
The role
As Senior Databricks Consultant, you will lead Databricks projects, help build out the practice's assets and resources, and guide the team to deliver reliable, innovative solutions. You will play a key part in lifting Databricks knowledge across the team, driving continuous improvement and embedding best practice from implementation through to ongoing enhancement. You will also work closely with the sales and marketing team, technology partners and clients.
Key responsibilities
- Act as the subject matter expert in Databricks and related technologies
- Advise on lakehouse design patterns (including medallion architecture), delivery methodologies and tooling
- Ensure delivery quality across Databricks data platform, data engineering and AI/ML projects
- Implement security, governance and compliance using Unity Catalog
- Capture and promote client success stories and case studies
- Work with Databricks and other technology partners on solution design and delivery
- Support the sales team with pre-sales engagements and solution design
- Contribute to training and certification pathways for Databricks consultants
- Identify and develop opportunities with existing Databricks clients
- Contribute thought leadership through published content
- Take part in conference sessions, webinars and executive round table events
About you
- Proven experience delivering Databricks platforms and solutions, including leading small teams or workstreams
- Deep technical knowledge of Databricks, Apache Spark (PySpark and Spark SQL), Delta Lake, data modelling (dimensional or Data Vault) and cloud data architecture (AWS, Azure or GCP)
- Hands-on experience with Lakeflow (Connect, Pipelines, Jobs), Databricks SQL and Unity Catalog for security, access control, lineage and auditing
- Experience with Agile, DevOps/CI-CD (including Databricks Asset Bundles) and modern data delivery practices
- Experience leading migrations from legacy platforms (e.g. SQL Server, Synapse, Hadoop, SAS) to Databricks
- Experience optimising Databricks cost and performance (e.g. compute sizing, serverless, workload tuning)
- Experience integrating Databricks with tools such as dbt, Fivetran, Power BI or Tableau
- Exposure to machine learning and AI on Databricks (e.g. MLflow, Mosaic AI, Genie, Agent Bricks) is highly regarded
- Strong mentoring and capability development skills
- Excellent client engagement, communication and pre-sales experience
- A track record of delivering data solutions with measurable business impact
- Databricks certifications (e.g. Data Engineer Professional), or a willingness to obtain them
Why this role
- Real influence over how the practice designs, delivers and scales Databricks solutions as it grows
- A team that values innovation, learning and client success
- Collaboration with industry-leading technology partners and forward-thinking clients
- Ongoing learning, including Databricks certifications, industry events and professional development
