ICM Asia Pacific Logo

ICM Asia Pacific

Senior Data Engineer / Consultant - Databricks

Posted 3 Days Ago
Be an Early Applicant
Hybrid
Melbourne, Victoria, AUS
Senior level
Hybrid
Melbourne, Victoria, AUS
Senior level
The Senior Data Engineer/Consultant will lead data engineering projects, ensuring high-quality technical outcomes using Databricks, while mentoring team members and collaborating with clients.
The summary above was generated by AI

About Us

Adaptiv is a true Kiwi success story! Recognised for our commitment to premium client delivery, we provide world-class integration, AI consulting and development service, along with data and analytics. We have a wealth of development and integration experience in moving clients from around the world onto cloud platforms.

Our integration work focuses on the exciting challenge of designing innovative API-led and event driven solutions. Leveraging the latest technologies, such as Databricks, MuleSoft, Boomi, Azure, and Solace, we develop services that unlock access to existing data within legacy business systems in new and ingenious ways.

These solutions enable organizations to drive major process efficiencies, engineer new operational workflows, and extract deeper insights from their data. Ultimately, this empowers businesses to operate more effectively and engage with their customers in modern, cutting-edge ways. Our services also include cloud consultancy, round-the clock middleware support, integration development, application lifecycle management, load and performance testing and customised integration training.

Based in our stylish Southbank offices in Melbourne, our team enjoys a collaborative, people-first culture where curiosity, initiative, and growth are valued. We combine serious technical capability with a down-to-earth, can-do approach and we’re looking for someone who shares that mindset.

About the Role

We have an exciting opportunity for a Senior Data Engineer / Consultant to join our growing Data Engineering practice here at Adaptiv Integration to drive the delivery of data engineering engagements on behalf of our clients. In this role, you will ensure high-quality technical outcomes, foster strong client collaboration, and provide effective support to delivery teams.

This position combines advanced data engineering expertise with consulting leadership. You will own engineering delivery across assigned engagements, contribute to solution design within architectural guidelines, and mentor junior and intermediate team members to maintain consistent quality and standards.

This role will be responsible for the delivery of cutting-edge Databricks technology, driving innovative data engineering solutions for clients. You will leverage your expertise to design, implement, and optimise Databricks-based pipelines and solutions, ensuring high-quality technical outcomes and efficient, scalable data architectures.

The role is highly hands-on and delivery-focused, requiring autonomous execution and a strong emphasis on billable contribution.

What You’ll Be Doing

  • Build, maintain, and optimise data pipelines across lakes, lakehouses, and warehouses.
  • Write, test, and maintain high-quality code; develop transformations for reporting, analytics, and AI/ML.
  • Apply data modelling principles; troubleshoot and resolve issues efficiently.
  • Work with Databricks, Delta Live Tables, Lakeflow, Git, and CI/CD pipelines.
  • Implement automated testing, data validation, and performance optimisation.
  • Lead unit and integration testing; ensure solutions meet quality and documentation standards.
  • Support knowledge sharing and improvement of internal frameworks and templates.
  • Act as primary engineering contact, leading technical discussions and translating business needs into technical tasks.
  • Communicate progress, risks, and blockers; contribute to estimation, scoping, and planning.
  • Mentor and coach junior/intermediate team members; conduct peer reviews.
  • Ensure accountability for code quality, documentation, and adherence to best practices.
  • Collaborate with architects on technical solutions and delivery planning.
  • Participate in learning sessions and knowledge sharing; adopt modern data concepts (AI/ML, data visualisation, cloud-native).
  • Contribute to process, template, and documentation improvements; pursue relevant training and certification.

What You’ll Bring

  • 6+ years of professional experience in data engineering or a related field.
  • At least 4 years of hands-on experience developing data pipelines and transformations using Databricks, including Delta Live Tables, notebooks, and workflows.
  • Familiarity with Microsoft Fabric concepts and experience contributing to projects that incorporate Fabric components.
  • Proficiency in Python and SQL for data transformation and analysis.
  • Understanding of data modelling including Star and Snowflake schema design for analytics workloads.
  • Knowledge of Medallion architecture principles and well-architected, scalable data solution design.
  • Experience applying DevOps practices such as version control, CI/CD, and environment automation.
  • Experience with testing and data quality frameworks to ensure reliable, accurate data delivery.
  • Experience with visualisation and data consumption concepts, including Power BI or similar tools.
  • Relevant industry certifications (Databricks Professional and Databricks Associate) or a demonstrated commitment to ongoing professional development.

 

If you are looking for your next role with an organisation where you can elevate your career, this could be the perfect opportunity for you.

Similar Jobs

42 Minutes Ago
Hybrid
Melbourne, Victoria, AUS
Senior level
Senior level
eCommerce • Fintech • Hardware • Payments • Software • Financial Services
As the Senior Lead for Australia Escalations Support, you will enhance complaint resolution processes, lead a team, ensure compliance, and analyze trends to improve services.
Top Skills: Complaints Management SystemsData Analysis Tools
42 Minutes Ago
In-Office
Melbourne, Victoria, AUS
Senior level
Senior level
Food • Retail • Agriculture • Manufacturing
The Senior Retail Category Manager leads category strategy to enhance commercial results, driving insights-led engagement with retailers and managing a category team.
Top Skills: ExcelPowerPoint
Yesterday
In-Office
Melbourne, Victoria, AUS
Junior
Junior
Aerospace • Information Technology • Software • Cybersecurity • Design • Defense • Manufacturing
The Manufacturing Manager leads a production team to meet KPIs, ensure safety, implement improvements, and report metrics. Requires leadership in a manufacturing environment.
Top Skills: Lean Manufacturing

What you need to know about the Melbourne Tech Scene

Home to 650 biotech companies, 10 major research institutes and nine universities, Melbourne is among one of the top cities for biotech. In fact, some of the greatest medical advancements were conceptualized and developed here, including Symex Lab's "lab-on-a-chip" solution that monitors hormones to predict ovulation for conception, and Denteric's vaccine for periodontal gum disease. Yet, the thousands of people working in the city's healthtech sector are just getting started, to say nothing of the tech advancements across all other sectors.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account