Commonwealth Bank Logo

Commonwealth Bank

Senior Data Engineer (Scala/Java, Spark, AWS)

Posted 2 Hours Ago
Be an Early Applicant
In-Office
Melbourne, Victoria, AUS
Senior level
In-Office
Melbourne, Victoria, AUS
Senior level
Senior Data Engineer responsible for designing, building and operating scalable cloud data platforms using Scala/Java, Spark and AWS. Deliver ETL pipelines, data modelling, pipeline orchestration, performance tuning, automated testing, and secure data controls. Engage stakeholders, produce technical designs and documentation, mentor engineers, and provide staff-like ownership on initiatives within Financial Crimes Intelligence.
The summary above was generated by AI

Senior Data Engineer (Scala/Java, Spark, AWS)

  • We're embarking on an exciting Data Transformation program and are ready to push the boundaries and deliver engineering best practices to elevate the data quality and availability in our domain

  • You have knowledge and experience that spans both development and architecture, including data engineering, modelling and cloud architecture

  • Together we will build tomorrow’s bank today, using world-leading engineering, technology, and innovation.

Do Work That Matters
We're building tomorrow’s bank today, which means we need creative and diverse engineers to help us redefine what customers expect from a bank. Envisioning new technologies that are still waiting to be invented and reimagining products that support our customers and help build Australia’s future economy. 
 
Here, you'll have the chance to bring your passion to life by working with the latest technology on groundbreaking projects that deliver a seamless and unmatched customer experience.  
See Yourself in Our Team
This role is part of the Monitoring & Payments Crew within Financial Crimes Intelligence domain, where we design and deliver cutting-edge technology solutions that serve data and analytical use-cases within Financial Crimes domain.

We are seeking an outstanding Senior Data Engineer to join our team and contribute to building and evolving our data and analytics cloud platforms through strong hands‑on engineering, with the ability to step up into broader (staff‑like) ownership when required.

We’re interested in hearing from people who:

  • Can build and evolve our data and software engineering platforms, delivering scalable, resilient solutions in a cloud‑based environment.

  • Can independently deliver well‑scoped technical solutions from design through build, testing, release, and support seeking input early when problems are ambiguous or cross‑cutting.

  • Possess a strong security‑first and risk mindset, particularly when handling high‑risk and sensitive data in regulated environments such as Financial Crime.

  • Can engage with business and technical stakeholders to translate requirements into clear, pragmatic technical designs.

  • Can contribute to mentoring and knowledge sharing through pairing and constructive code reviews.

  • Can step up to provide staff‑like ownership for a small initiative (e.g., driving a design, aligning stakeholders, and improving team practices) when required.

Skills Required:
We use a broad range of tools, languages, and frameworks. We do not expect you to know them all but experience or exposure with some of these, or a willing to learn these skillsets (or equivalents) will set you up for success in this team!

  • Strong, hands‑on experience with Scala/ Java for building large‑scale, distributed data and software systems.

  • Experience designing and implementing solutions on AWS, leveraging cloud‑native services for scalable and resilient architectures.

  • Solid foundation in data engineering, including ETL pipeline design, data modelling, and large‑scale data processing.

  • Strong experience with Apache Spark (good to have EMR exp) and distributed data processing frameworks.

  • Demonstrated ability to handle and process large data volumes efficiently, balancing performance, scalability, reliability, and cost.

  • Experience orchestrating pipelines, including dependency handling, retries, and operational resilience.

  • Experience in performance tuning and optimisation across Spark workloads and cloud infrastructure.

  • Experience designing and implementing automated testing approaches for data and software systems, including:

  • Unit testing and integration testing for Scala‑based services and pipelines

  • Testing of Spark jobs and data transformations

  • Data quality, validation, and regression testing within pipelines

  • Strong understanding of secure data engineering practices, particularly when working with high‑risk or sensitive data.

  • Hands‑on experience implementing data security controls, such as encryption at rest and in transit, secrets management, data masking, and fine‑grained access control.

  • Sound knowledge of software engineering best practices, including CI/CD, automated testing, code reviews, and version control (GitHub).

  • Ability to produce clear technical documentation and lightweight design artefacts for engineers and for architecture/cyber security review when required.

  • Experience working with agile delivery practices and tools such as JIRA and Confluence.

  • Certification: Either Quantexa certification (Data Engineering or Scoring) or an AWS certification is desirable.

  • Experience working with Quantexa platforms, upgrades, or financial crime data domains is advantageous.

Working with us:

Our people bring their diverse backgrounds and unique perspectives to build a respectful, inclusive, and flexible workplace with flexible work locations. One where we’re driven by our values, and supported to share ideas, initiatives, and energy. One where making a positive impact for customers, communities and each other is part of our every day.  

Here, you’ll thrive. You’ll be supported when faced with challenges and empowered to tackle new opportunities. We’re hiring engineers from across all of Australia and have opened technology hubs in Melbourne and Perth. We really love working here, and we think you will too.

We support our people with the flexibility to balance where work is done with at least half their time each month connecting in office. We also have many other flexible working options available including changing start and finish times, part-time arrangements and job share to name a few. Talk to us about how these arrangements might work in the role you’re interested in.

If this sounds like the role for you then we would love to hear from you. Apply today!

If you're already part of the Commonwealth Bank Group (including Bankwest, x15ventures), you'll need to apply through Sidekick to submit a valid application. We’re keen to support you with the next step in your career.

We're aware of some accessibility issues on this site, particularly for screen reader users. We want to make finding your dream job as easy as possible, so if you require additional support please contact HR Direct on 1800 989 696.

Advertising End Date: 29/06/2026

Similar Jobs

Yesterday
In-Office or Remote
Senior level
Senior level
Artificial Intelligence • Healthtech • Machine Learning • Natural Language Processing • Biotech • Pharmaceutical
The Director Marketing Academy co-leads the End-to-End Execution Excellence track, ensuring coherent curriculum for U.S. marketers and implementing scalable learning initiatives aligned with business priorities.
Top Skills: AICocoCommercial In CommandMartech
Yesterday
Easy Apply
Remote or Hybrid
Easy Apply
Senior level
Senior level
Artificial Intelligence • Cloud • Security • Software • Cybersecurity
As a Senior Software Engineer, you will enhance the REDAPL platform, leading initiatives in data ingestion, processing, and supporting infrastructure-related projects while mentoring other engineers.
Top Skills: Amazon NeptuneApache IcebergArangodbCalciteDatafusionJanusgraphMemgraphNeo4JPuppygraphSubstraitTrino
2 Days Ago
In-Office or Remote
Senior level
Senior level
Artificial Intelligence • Healthtech • Machine Learning • Natural Language Processing • Biotech • Pharmaceutical
Lead technical strategy and build scalable AI/ML platform infrastructure on AWS and Kubernetes. Design IaC, CI/CD, observability, security, and cost/capacity practices. Mentor engineers, improve deployment reliability, and enable generative AI workloads, model routing, and operational metrics across multiple environments and regions.
Top Skills: AlbAWSAws BedrockAzure OpenaiCloudFormationCloudwatchDockerDynamoDBEcs FargateEksGithub ActionsGrafanaHelmIamLambdaLangfuseLitellmLocustMwaaOidcOpensearchPre-CommitPrometheusPythonS3Secret ScanningSecrets ManagerTerraformVpc

What you need to know about the Melbourne Tech Scene

Home to 650 biotech companies, 10 major research institutes and nine universities, Melbourne is among one of the top cities for biotech. In fact, some of the greatest medical advancements were conceptualized and developed here, including Symex Lab's "lab-on-a-chip" solution that monitors hormones to predict ovulation for conception, and Denteric's vaccine for periodontal gum disease. Yet, the thousands of people working in the city's healthtech sector are just getting started, to say nothing of the tech advancements across all other sectors.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account