Commonwealth Bank Logo

Commonwealth Bank

Staff Data Engineer

Reposted 3 Hours Ago
Be an Early Applicant
In-Office
2 Locations
Senior level
In-Office
2 Locations
Senior level
As a Staff Data Engineer, you'll develop data platforms, design data architectures, lead Agile projects, and optimize data pipelines in a collaborative team environment.
The summary above was generated by AI
  • You are passionate about making peoples jobs simpler and more rewarding

  • We are a team of big thinkers who are engineering the future of banking

  • Together we can create industry leading product lifecycles that support capabilities, people and technology

Do work that matters

Technology is the enabling force behind information technology functions for the Group to achieve the highest levels of customer experience, security and reliability, velocity, and innovation. 

In Business Banking (BB) Technology, we provide technology solutions to Business Banking domains across Business Banking and CommSec. We are empowering businesses and people to succeed with tomorrow’s technology, our purpose is to become the leading digital business bank, powered by the next horizon of technology.

See yourself in our team

We are seeking a highly driven, hands-on Staff Data Engineer who brings deep technical expertise and strong leadership capabilities. In this role, you will architect, build, and deliver business-critical data engineering solutions in payments ecosystem. You’ll lead engineering efforts across the squad, setting technical direction, mentoring engineers, and driving best practices in data engineering.

This is a high-impact role where you’ll collaborate closely with cross-functional teams, influence platform strategy, and ensure scalable, reliable data solutions. We foster an innovative and dynamic culture, with a genuine commitment to diversity, inclusion, and continuous growth. You’ll be supported by a team of passionate engineers and highly invested leaders focused on your career progression and technical leadership

We’re interested in hearing from people who

  • Have solid hands-on experience in Cloudera Data Platform and large migration programs from on-prem to Cloud

  • Are knowledgeable of Data warehousing solutions like Amazon Redshift, Google BigQuery, or Snowflake

  • Are passionate about building next generation Data platforms and Data pipeline solution across the Bank

  • Have got proven track record of Agile delivery including leading and working on end-to-end delivery of project

  • Are confident in their understanding of Data modelling, schema design, and Data architecture principles

  • Are confident leading, directing, coaching and guiding engineers

  • Pride themselves in driving pragmatic and fit for purpose solutions with high technical quality

  • Have solid hands-on experience with building Spark-based pipelines

  • Are pro-actively looking for ways to provide feedback and contribute towards Engineering and automation uplift to the Product

  • Are constantly thinking creatively and breaking boundaries to solve complex Data problems

  • Have solid understanding of DevOps practices and tools for CI/CD (e.g., Github, Jenkins, Docker, Kubernetes)

  • Are knowledgeable of Data governance practices, Data privacy regulations, and Security measures

Tech skills:

We use a broad range of tools, languages, and frameworks. We do not expect you to know them all but experience or exposure with some of these, or a willing to learn these skillsets (or equivalents) will set you up for success in this team 

  • Proven hands-on experience in large-scale distributed data processing with Spark, Scala, HDFS, MapReduce, and YARN

  • Expert-level proficiency in writing complex, optimised SQL queries

  • Strong experience in writing production-grade Python code for data processing, automation, and integration tasks

  • Hands-on experience with core AWS services including S3, Glue, Redshift, EMR and MSK. AWS certification is a plus

  • Deep understanding and hands-on experience with real-time data streaming (Kafka / MSK) and event-driven architectures

  • Expertise in handling complex file formats such as Avro, Parquet, and ORC, including nested structures

  • Solid grasp of traditional data ware housing concepts including dimensional modelling, normalisation, and star/snowflake schemas

  • Experience with modern table formats for large analytic datasets such as Apache Iceberg

  • Proficiency in building and maintaining ETL pipelines using AWS Glue or equivalent tools

Working with us

We support our people with the flexibility to balance where work is done with at least half their time connecting in our Sydney or Melbourne office.

We also have many other flexible working options available including changing start and finish times, part-time arrangements and job share to name a few.

If this sounds like you, apply now!

If you're already part of the Commonwealth Bank Group (including Bankwest, x15ventures), you'll need to apply through Sidekick to submit a valid application. We’re keen to support you with the next step in your career.

We're aware of some accessibility issues on this site, particularly for screen reader users. We want to make finding your dream job as easy as possible, so if you require additional support please contact HR Direct on 1800 989 696.

Advertising End Date: 29/08/2025

Top Skills

Amazon Redshift
Apache Iceberg
AWS
Cloudera Data Platform
Docker
Glue Etl
Google Bigquery
Hadoop
Kafka
Kubernetes
S3
Snowflake
Spark
SQL

Similar Jobs

6 Days Ago
In-Office
2 Locations
Senior level
Senior level
Fintech • Financial Services
As a Staff Data Engineer, you will design and deliver integrated data platforms, oversee data delivery for Finance Risk, and coach junior engineers while utilizing various technologies.
Top Skills: Ab InitioApache KafkaAWSAws CdkAws KinesisCi/CdDbtGlueOraclePerlPower BIPythonQuicksightRdsRedshiftS3ShellSQLTableauTerraformUnix/Linux
7 Days Ago
In-Office
2 Locations
Senior level
Senior level
Fintech • Financial Services
As a Staff Data Engineer, you will build data solutions using AWS Cloud technologies, collaborate with teams to drive data strategy, and ensure code quality while mentoring junior engineers.
Top Skills: Apache KafkaAWSAws KinesisCloudFormationDbtEmrGithub ActionsGlueLambdaPower BIPythonQuicksightRdsRedshiftS3SagemakerSQLTableauTerraform
18 Days Ago
In-Office
Area, Viveiro, Lugo, Galicia, ESP
Senior level
Senior level
Fintech • Financial Services
Seeking a Staff Data Engineer to modernize HR systems using cloud infrastructure, drive AI initiatives, and mentor junior engineers.
Top Skills: .NetAIAirflowAthenaAuroraAWSCucumberDataformDevsecopsEmrGen AiGitGithub ActionsGlueIcebergJavaScriptJestMicroservicesMlMochaNunitPlaywrightPythonRedshiftS3SeleniumSpecflowSQLXunit

What you need to know about the Melbourne Tech Scene

Home to 650 biotech companies, 10 major research institutes and nine universities, Melbourne is among one of the top cities for biotech. In fact, some of the greatest medical advancements were conceptualized and developed here, including Symex Lab's "lab-on-a-chip" solution that monitors hormones to predict ovulation for conception, and Denteric's vaccine for periodontal gum disease. Yet, the thousands of people working in the city's healthtech sector are just getting started, to say nothing of the tech advancements across all other sectors.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account