Senior Data Engineer - AWS and Gen AI
You are determined to stay ahead of the latest Cloud, Gen AI and Big Data technologies.
We're one of the largest and most advanced Data Engineering/Gen AI teams in the country.
Together we can build state-of-the-art data and AI solutions that power seamless experiences for millions of customers.
Do work that matters:
The Retail Tech Data Engineering team is dedicated to transforming the Commonwealth Bank Group into a data-driven organisation. We achieve this by tackling complex data challenges for the business and leveraging data to gain strategic and sustained competitive advantages, all while enhancing the financial wellbeing of our customers in a safe, sound, and secure manner.
As a Senior Data Engineer, you'll be a key member of the Engineering Chapter, responsible for building AI agents that will develop Data Assets for the Everyday Banking domain. Your agents will operate across various platforms, including AWS Cloud, Teradata Group Data Warehouse, Hadoop Big Data Platform, and Ab Initio technologies.
We are seeking people who are:
Enthusiastic about creating cutting-edge data platforms and developing data pipeline solutions/AI agents throughout the bank.
Drive cross- functional collaboration to embed AI capabilities into CI/CD pipelines, secure coding practices, and developer tooling.
Constantly thinking outside the box and breaking boundaries to solve complex data problems.
We are also interested in hearing from people who have:
Demonstrated experience in building and supporting Big Data pipelines using the AWS Stack.
Experience in designing, building, and delivering optimised enterprise-wide data ingestion, data integration solutions for Cloud-based, Big Data and Data warehouse platforms.
Experience in driving high quality outcomes to solve core business objectives and minimise risks.
Experience in development workflows by writing, testing, and optimising system code, and enabling intelligent debugging through AI-powered suggestions.
Experience with data governance controls, data security and data management.
Technical skills:
We use a broad range of tools, languages, and frameworks. We don’t expect you to know them all but experience or exposure with some of these (or equivalents) will set you up for success in this team.
Experience in understanding data solution in Hadoop and Big Data platforms, using Spark and Python.
Experience with AWS Technologies including Redshift, Iceberg tables, EMR, Glue, Athena, S3.
Experience in leading and mentoring data engineers, including ownership of internal business stakeholder relationships and working with consultants.
Hands-on experience with GenAI, including developing Retrieval-Augmented Generation (RAG) systems using frameworks like LangChain, LlamaIndex, or similar.
Experience in designing and implementing Agentic AI systems using tools such as LangGraph, MCP, Pydantic, A2A or similar, to orchestrate multi-agent workflows and enable autonomous task execution.
Experience with Graph databases, including Neo4j and Neptune
Working with us:
Our people bring their diverse backgrounds and unique perspectives to build a respectful, inclusive, and flexible workplace with an ultimate flexibility to work from any of our engineering hubs within Australia. One where we’re driven by our values, and supported to share ideas, initiatives, and energy. One where making a positive impact for customers, communities and each other is part of our every day.
If you're already part of the Commonwealth Bank Group (including Bankwest, x15ventures), you'll need to apply through Sidekick to submit a valid application. We’re keen to support you with the next step in your career.
We're aware of some accessibility issues on this site, particularly for screen reader users. We want to make finding your dream job as easy as possible, so if you require additional support please contact HR Direct on 1800 989 696.
