Commonwealth Bank Logo

Commonwealth Bank

Principal Data Engineer (Snowflake, AWS, Python)

Posted Yesterday
Be an Early Applicant
In-Office
Melbourne, Victoria, AUS
Expert/Leader
In-Office
Melbourne, Victoria, AUS
Expert/Leader
Provides hands-on principal-level leadership for enterprise data engineering across AWS, Snowflake, Kafka, Spark, and real-time streaming. Designs scalable batch and event-driven platforms, modernizes legacy data warehouses, leads end-to-end delivery, establishes engineering standards, and mentors engineers. Builds production-grade Python pipelines and services while improving observability, optimization, data quality, and AI-assisted engineering capabilities.
The summary above was generated by AI
  • We’re building smarter, real-time customer experiences with AWS, Snowflake and Kafka.
  • You have deep data engineering expertise and thrive on solving complex problems at scale.
  • Together we will modernise data platforms and use AI to transform customer experiences.

Do work that matters:


Join our Customer Service Network team within Assisted Technology and help reimagine how our branch colleagues support millions of customers. As a Principal Data Engineer, you’ll provide hands-on technical leadership across AWS, Snowflake and modern data engineering, building scalable platforms that turn complex data into simpler, smarter customer experiences.You’ll shape architecture, modernise legacy data environments and engineer solutions across Spark, Kafka/MSK, batch and real-time streaming. From setting engineering standards to using AI-assisted engineering to accelerate delivery, you’ll influence how we build while mentoring engineers and lifting capability across the team.


See yourself in our team:  


Our Customer Service Network team, within Assisted Technology, is reimagining how data and technology help our branch colleagues serve customers. We’re building the data foundations behind intelligent concierge experiences, agentic appointment booking, customer-intent capture, skills matching and smarter branch operations, connecting customer journeys, colleague experiences and operational data in real time.


We’re creating a modern, cloud-first data ecosystem using AWS, Snowflake and Kafka, with real-time messaging, event-driven architectures and scalable data pipelines at its core. The team is also exploring AI-powered engineering and AI-ready data capabilities to turn trusted, real-time data into smarter experiences and decisions. With significant greenfield engineering ahead, we’re solving complex data challenges together and building capabilities designed to help colleagues serve customers faster, smarter and more seamlessly. 


We’re interested in hearing from people who: 


  • Bring Principal-level technical leadership across data engineering, architecture and full-cycle delivery
  • Have deep hands-on experience building large-scale, enterprise data platforms on AWS
  • Are highly proficient in Python, building production-grade data pipelines, services and engineering solutions
  • Have strong experience with Kafka and real-time messaging, including streaming and event-driven architectures
  • Can architect batch, streaming and near-real-time data solutions across complex environments
  • Own solutions end to end, from problem definition and architecture through engineering, deployment, observability and optimisation
  • Thrive on solving big, complex engineering problems, simplifying disconnected systems and making pragmatic architectural decisions
  • Have experience modernising data ecosystems, including migration from legacy warehouse technologies toward Snowflake
  • Stay hands-on as a Principal Engineer, setting engineering standards, mentoring others and lifting technical capability across teams

Tech skills 

 

We don't expect you to know everything, but experience in several of the following will set you up for success:

  • Cloud: AWS, S3, Lambda, Kinesis, Redshift, Glue, EMR, Athena, IAM, SQS/SNS, ECS/EKS, DynamoDB
  • Data Platform: Snowflake, Databricks
  • Data Modernisation: Enterprise-scale data platform and warehouse modernisation/migration, Teradata to Snowflake
  • Core Engineering: Python, PySpark, SQL, Scala
  • Distributed Processing: Apache Spark, distributed processing, batch processing, streaming
  • Real-Time Streaming: Kafka, Amazon MSK, Flink
  • Architecture: Enterprise data architecture, scalable solution design, systems integration
  • Data Modelling: Dimensional modelling, semantic modelling, entity resolution, matching, deduplication, reconciliation, data quality
  • Data Engineering: ETL, complex enterprise data pipelines
  • Data Warehousing: Snowflake, Teradata, Hadoop/Cloudera, Hive, Oracle
  • DevOps: CI/CD, GitHub Actions, Infrastructure as Code, CloudFormation, AWS CDK
  • AI-Assisted Engineering: AI-assisted development, ETL automation, engineering productivity, quality and delivery acceleration
  • AI / GenAI: GenAI concepts and practical engineering applications
  • Microsoft Ecosystem: Microsoft Fabric, Copilot Studio

If you're already part of the Commonwealth Bank Group (including Bankwest, x15ventures), you'll need to apply through Sidekick to submit a valid application. We’re keen to support you with the next step in your career.

We're aware of some accessibility issues on this site, particularly for screen reader users. We want to make finding your dream job as easy as possible, so if you require additional support please contact HR Direct on 1800 989 696.

Advertising End Date: 15/12/2026

Commonwealth Bank Darling, Victoria, AUS Office

Darling, Australia

Similar Jobs

An Hour Ago
Remote or Hybrid
Senior level
Senior level
Big Data • Food • Hardware • Machine Learning • Retail • Automation • Manufacturing
Leads SOC incident triage, investigation, mitigation, containment, and recovery. Performs live endpoint response and forensic analysis, manages incident tickets, escalates security events, recommends security tooling configurations, and coordinates with incident management teams. Serves as the senior technical escalation point, mentors Level 2 and junior analysts, and delivers security training while supporting enterprise information security, compliance, risk management, and governance.
Top Skills: EdrSIEM
Yesterday
Remote or Hybrid
Senior level
Senior level
Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
Manage strategic channel partners across Spain, partnering with account executives and sales leadership to generate partner-sourced revenue. Responsibilities include developing channel business plans, reviewing pipeline, recruiting and developing partners, coordinating technical enablement, supporting marketing programs, and advancing commercial opportunities. The role requires cybersecurity expertise, B2B SaaS channel sales experience, Spanish and English fluency, strong executive communication, and travel up to 50%.
Top Skills: Ai TechnologiesCybersecuritySaaS
4 Days Ago
In-Office or Remote
Mid level
Mid level
Blockchain • Fintech • Payments • Financial Services • Cryptocurrency • Web3 • Infrastructure as a Service (IaaS)
Build and own Finance data models covering ledgers, settlements, transactions, invoicing, fees, and collateral. Reconcile internal and external systems, investigate discrepancies, support month-end close and audits, automate reporting, implement data quality tests, define reusable financial metrics, and create self-service reporting. Partner with Finance, Accounting, data, and platform engineering teams to maintain trusted, documented data systems.
Top Skills: AirflowBigQueryDagsterDatastreamDbtFivetranLightdashLookerMeltanoOmniPythonRedshiftSnowflakeSQL

What you need to know about the Melbourne Tech Scene

Home to 650 biotech companies, 10 major research institutes and nine universities, Melbourne is among one of the top cities for biotech. In fact, some of the greatest medical advancements were conceptualized and developed here, including Symex Lab's "lab-on-a-chip" solution that monitors hormones to predict ovulation for conception, and Denteric's vaccine for periodontal gum disease. Yet, the thousands of people working in the city's healthtech sector are just getting started, to say nothing of the tech advancements across all other sectors.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account