Commonwealth Bank Logo

Commonwealth Bank

Staff Data Engineer

Posted 2 Days Ago
Be an Early Applicant
In-Office
Melbourne, Victoria, AUS
Senior level
In-Office
Melbourne, Victoria, AUS
Senior level
Design and deliver scalable batch, streaming and analytical data pipelines and reusable semantic data products. Automate data product lifecycles, implement data matching, cleansing, quality and observability controls, support ML productionisation, build CI/CD with GitHub Actions, and provide technical leadership and governance for secure, resilient data solutions.
The summary above was generated by AI

Staff Data Engineer

Role Purpose

The Staff Data Engineer is a senior technical contributor responsible for designing and delivering scalable, reliable and secure data solutions. The role provides technical leadership across data engineering, analytical pipelines, data ontology, data matching, data cleansing, MLOps and automation.

A key focus is transforming complex source data into trusted, reusable and dashboard-ready data products, while automating their development, deployment, testing and ongoing management.

Key Responsibilities:

  • Design and build scalable batch, streaming and analytical data pipelines.

  • Transform source data into trusted, reusable and analysis-ready datasets.

  • Create curated data layers, semantic models and reusable data products for dashboards, reporting and analytics.

  • Automate the dashboard data lifecycle, including ingestion, transformation, testing, deployment, monitoring, refresh and issue remediation.

  • Design and implement agentic workflows that coordinate data preparation, quality validation, metadata generation, dashboard updates and operational support.

  • Build and maintain CI/CD pipelines using GitHub Actions.

  • Design data models, ontologies, taxonomies and common data definitions.

  • Implement data matching, entity resolution, deduplication and data cleansing solutions.

  • Build automated data quality, validation, reconciliation and observability controls.

  • Develop solutions for large and complex datasets using big data and distributed processing technologies.

  • Support the productionisation and monitoring of machine learning and open-weight models.

  • Develop production-grade solutions using Python and/or R.

  • Establish engineering standards, mentor engineers and provide technical guidance.

  • Ensure data solutions meet security, privacy, resilience and governance requirements.

Essential Experience:

  • Strong experience in data engineering and large-scale data platforms.

  • Strong algorithmic optimisation capabilities

  • Advanced Python and/or R programming skills, with strong SQL capability.

  • Experience building production-grade analytical, batch or streaming pipelines.

  • Experience preparing reusable datasets and semantic data layers for dashboards, reporting and analytics.

  • Strong experience implementing CI/CD pipelines using GitHub Actions.

  • Experience automating data and analytical product lifecycles, including testing, deployment, monitoring and release management.

  • Experience designing or implementing agentic workflows, AI-driven automation or intelligent orchestration.

  • Experience with big data and distributed processing technologies.

  • Experience with data modelling, semantic modelling or data ontology.

  • Experience with data matching, entity resolution, deduplication and data cleansing.

  • Experience implementing data quality and data observability controls.

  • Exposure to MLOps and the productionisation of analytical or machine learning models.

  • Strong cloud platform, software engineering, automated testing and infrastructure-as-code experience.

  • Demonstrated technical leadership and mentoring capability.

Desirable Experience:

  • Experience evaluating, fine-tuning, deploying or operating open-weight models.

  • Exposure to retrieval-augmented generation, embeddings, vector databases or model-serving technologies.

  • Experience applying AI agents to data engineering, analytics or dashboard operations.

  • Exposure to cyber security controls and secure data engineering.

  • Exposure to identity and access management, identity governance or identity-related datasets.

  • Experience in regulated or risk-sensitive environments.

If you're already part of the Commonwealth Bank Group (including Bankwest, x15ventures), you'll need to apply through Sidekick to submit a valid application. We’re keen to support you with the next step in your career.

We're aware of some accessibility issues on this site, particularly for screen reader users. We want to make finding your dream job as easy as possible, so if you require additional support please contact HR Direct on 1800 989 696.

Advertising End Date: 20/08/2026

Commonwealth Bank Darling, Victoria, AUS Office

Darling, Australia

Similar Jobs

13 Days Ago
In-Office
Melbourne, Victoria, AUS
Senior level
Senior level
Fintech • Financial Services
Lead design and delivery of scalable AWS-native data platforms and pipelines. Build data products using Glue, Iceberg, Redshift, Airflow and related tooling. Provide technical leadership, governance, automation, and mentoring to a team of data engineers while ensuring security, cost-effectiveness, and cross-team collaboration.
Top Skills: Amazon AthenaAmazon RedshiftApache AirflowApache IcebergArtifactoryAws EcsAws EmrAws GlueAws KinesisAws LambdaAws S3Aws SagemakerAxiomCsvDataformDevsecopsGitGithub ActionsJenkinsJSONJupyter NotebooksOctopusOraclePostgresPower BIPythonSQLTableauTeamcityTeradataUnix Shell ScriptingXML
18 Days Ago
In-Office
Melbourne, Victoria, AUS
Senior level
Senior level
Fintech • Financial Services
Lead design and delivery of scalable, cloud-native software and data/AI-enabled platforms for Business Banking. Build APIs, services and platform capabilities, drive architecture and engineering standards, mentor engineers, champion CI/CD, observability and DevSecOps, and support production platforms to deliver customer and colleague digital experiences.
Top Skills: .NetAPIsAutomated TestingAWSCi/CdCloudFormationDevsecopsDockerDomain-Driven DesignEvent-Driven ArchitectureGoJavaKubernetesMicroservicesObservabilityPythonTerraformTypescript
13 Days Ago
In-Office or Remote
Senior level
Senior level
Payments
The Staff Engineer will define architecture, lead data pipeline design, ensure platform reliability, and mentor engineers, driving data initiatives and technical standards.
Top Skills: AirflowAWSAzureDbtFlinkGCPKafkaPythonSparkSQLStarrocks

What you need to know about the Melbourne Tech Scene

Home to 650 biotech companies, 10 major research institutes and nine universities, Melbourne is among one of the top cities for biotech. In fact, some of the greatest medical advancements were conceptualized and developed here, including Symex Lab's "lab-on-a-chip" solution that monitors hormones to predict ovulation for conception, and Denteric's vaccine for periodontal gum disease. Yet, the thousands of people working in the city's healthtech sector are just getting started, to say nothing of the tech advancements across all other sectors.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account