Staff / Lead Data Engineer (AWS Cloud)

Staff / Lead Data Engineer (AWS Cloud)

• You are determined to stay ahead of the latest Cloud, Big Data and Data warehouse technologies.

• We're one of the largest and most advanced Data Engineering teams in the country.

• Together we will build tomorrow’s bank today, using world-leading technology and innovation

Do work that matters

We're building tomorrow's bank today, which means we need creative and diverse engineers to help us redefine what customers and regulators expect from a Bank. Envisioning new technologies that are still waiting to be invented and reimagining products that support our customers and help build Australia's future economy.

As a Staff Lead Data Engineer, you’ll be an integral member of our Engineering practice. Your role will be to lead and guide a team of engineers collaborating across a wide range of business and technical stakeholders to deliver a transformative and strategic data platform initiative to meet current and future international regulatory reporting requirements

See yourself in our team

This role is part of the International Regulatory Reporting Crew where we deliver cutting-edge technology solutions allowing the Bank to comply with regulatory reporting and disclosure obligations across the Banks international jurisdictions.

We are seeking an outstanding Staff Lead Data Engineer to join our team and help shape the reporting solutions that we are building

Roles & Responsibilities

• Design, build and deliver a new cloud data solution to transform our international regulatory reporting requirements

• Lead the design and delivery of cost-effective, scalable data solutions aligned with strategic goals that meet performance, security and operational requirements.

• Drive solution architecture decisions ensuring alignment with enterprise architecture principles and business priorities

• Engineer robust data product assets and pipelines in AWS (S3, Glue, Iceberg, Kinesis, Airflow, Sagemaker, Redshift) that integrate with other applications including SaaS reporting applications eg. Axiom

• Provide technical data governance and risk management,

• Lead a team of data engineers providing technical guidance, reviewing work and mentoring team members to deliver high-quality data products

• Define and implement engineering standards, including data modelling, ingestion, transformation, and egression patterns and reviews

• Collaborate across teams to ensure secure, efficient, and well-documented solution.

• Learn and contribute to continuous improvement initiatives within the team.

We are interested in hearing from people who

• Have strong experience in Data Engineering using Agile practices and DevSecOps

• Are experienced in designing, building and delivering “greenfield” data solutions in AWS Cloud using cloud native technologies that produce data products or data assets with proper data quality assurance and security controls.

• Are passionate technology leaders, can mentor and build a good community of engaged and curious engineers

• Have strong solution design capabilities, consistently driving cost effective and technologically feasible solutions, while steering solution decisions across the group, to meet both operational and strategic goals is essential.

• Have excellent verbal and written communication skills

• Have an ability to engage, manage internal stakeholders and external suppliers

• Have a problem-solving mindset with a focus on automation and continuous process improvement

Skills Required
We use a broad range of tools, languages, and frameworks. We don’t expect you to know them all but experience or exposure with some of these (or equivalents) will set you up for success in this team;

• Extensive experience in designing, building, and delivering enterprise-wide data ingestion, data integration and data pipeline solutions

• Strong Data Architecture expertise including different data modelling techniques and design patterns (conceptual, logical, physical, semantic is preferred)

• Strong knowledge of data governance such as data lineage, technical metadata, data quality and reconciliation

• Ability to drive platform efficiency through automation and AI capabilities

• AWS Data Stack: EMR, Glue, Redshift, Athena, S3, Lambda, ECS

• Data Orchestration & Pipelines: Airflow, Dataform

• Data Formats & Modelling: Iceberg, JSON, XML, CSV, Data Modelling

• Programming & DevOps: Python, SQL, Git, GitHub Actions, Team City, Jenkins, Octopus Unix shell scripting

• ETL & Ingestion: File ingress/egress solutions in AWS

• Security and Observability: DevSecOps, Artifactory, Observability tooling

• Testing & Automation: test automation frameworks, Jupyter Notebooks

• Familiarity with data warehousing and build experience in Teradata, Oracle

• Experience in visualisation tools such as PowerBI, Tableau

• Familiarity and experience with Agile processes

• AWS Data Engineer Associate certification

Working with us
Whether you’re passionate about customer service, driven by data, or called by creativity, a career with CommBank is for you.   

Here, you’ll thrive. You’ll be supported when faced with challenges and empowered to tackle new opportunities. We’re hiring engineers from across all of Australia and have opened technology hubs in Melbourne and Perth. We really love working here, and we think you will too.

We support our people with the flexibility to balance where work is done with at least half their time each month connecting in office. We also have many other flexible working options available including changing start and finish times, part-time arrangements and job share to name a few. Talk to us about how these arrangements might work in the role you’re interested in.

If this sounds like the role for you then we would love to hear from you. Apply today!