Commonwealth Bank Logo

Commonwealth Bank

Senior Data Engineer (Microsoft Fabric, PySpark, SQL)

Reposted 8 Days Ago
Be an Early Applicant
In-Office
Area, Viveiro, Lugo, Galicia
Senior level
In-Office
Area, Viveiro, Lugo, Galicia
Senior level
Design, build and maintain a central Microsoft Fabric data warehouse using PySpark and advanced SQL. Implement medallion architecture, ingest from varied sources, create analytics-friendly models, enforce data quality and lineage, automate testing and CI/CD, and collaborate with stakeholders while using generative AI responsibly.
The summary above was generated by AI

Senior Data Engineer (Microsoft Fabric, PySpark, SQL)

  • Build a centralised, trusted data warehouse for internal technology insights using Microsoft Fabric.

  • Own complex engineering work across PySpark, SQL, medallion architecture and source-system integration.

  • Apply AI-powered engineering thoughtfully across coding, testing, deployment and documentation.

Do Work That Matters

Be part of the team driving enterprise-wide transformation at CommBank. In End User Experience team, you’ll help bring data from internal technology sources into a centralised Microsoft Fabric warehouse, creating a controlled and reusable foundation for reporting, analytics and data sharing across the organisation.

See yourself in our team

You’ll join a collaborative, Sydney-based team working across data engineering, analytics and business stakeholders. Your focus will be to design, build and improve scalable data solutions that turn complex source data into trusted, analytics-ready products.

  • Design and build data ingestion and transformation workloads in Microsoft Fabric using PySpark and advanced SQL.

  • Apply medallion architecture principles across Bronze, Silver and Gold layers to create governed, reusable data products.

  • Connect to and ingest data from APIs, web services, relational databases, files, cloud storage and event-based sources.

  • Design analytics-friendly data models, including facts, dimensions and curated datasets.

  • Implement data quality checks, reconciliation controls, validation, monitoring and robust error handling.

  • Translate business and technical requirements into data models, business rules and practical engineering solutions.

  • Use source control, automated testing, continuous integration and delivery practices, and clear technical documentation.

  • Collaborate with engineers, analysts, BI developers, architects and stakeholders in an Agile delivery environment.

We’re interested in hearing from people who:

Bring strong hands-on data engineering experience and can work confidently across design, development, troubleshooting and optimisation. You’ll combine technical depth with sound judgement, clear documentation and a collaborative approach.

  • Have strong hands-on experience with Microsoft Fabric, PySpark and advanced SQL.

  • Have extensive experience applying medallion architecture to enterprise data solutions.

  • Can develop and troubleshoot scalable ingestion, transformation and API-based integration patterns across multiple environments.

  • Understand data modelling, data lineage, metadata management, data quality and reconciliation controls.

  • Use generative AI and coding-assistant tools responsibly, including model selection, prompt and context design, cost awareness, output evaluation, security and human review.

  • Are familiar with Git, automated testing, continuous integration and delivery, and release management for data engineering solutions.

  • Can gather requirements and translate them into durable data models, rules and engineering outcomes.

  • Experience with T-SQL and dynamic SQL is desirable

Working with us:

At CommBank, we're committed to creating an accessible, inclusive and respectful workplace. If you require support or adjustments, please let us know. We welcome applications from people of all backgrounds and we're particularly committed to making a positive difference for Aboriginal and/or Torres Strait Islander Peoples. For support please contact 1800 989 696

If this sounds like you, apply now.

If you're already part of the Commonwealth Bank Group (including Bankwest, x15ventures), you'll need to apply through Sidekick to submit a valid application. We’re keen to support you with the next step in your career.

We're aware of some accessibility issues on this site, particularly for screen reader users. We want to make finding your dream job as easy as possible, so if you require additional support please contact HR Direct on 1800 989 696.

Advertising End Date: 12/09/2026

Commonwealth Bank Darling, Victoria, AUS Office

Darling, Australia

Similar Jobs

4 Days Ago
Remote or Hybrid
Mid level
Mid level
Fintech • Legal Tech • Software • Financial Services • Cybersecurity • Data Privacy
Manages full-cycle accounting for multiple client companies, including bookkeeping, invoicing, bank reconciliations, tax filings and SII submissions, annual accounts, financial reporting, cash-flow and treasury statements, and regulatory reports. Supports audits and prepares documentation for tax authorities. The role requires accurate, timely client communication, multitasking, attention to detail, and fluent Spanish and English in a hybrid Madrid environment.
Top Skills: ExcelSii
4 Days Ago
Remote or Hybrid
Junior
Junior
Fintech • Legal Tech • Software • Financial Services • Cybersecurity • Data Privacy
Manages full-cycle accounting and client portfolios, including bookkeeping, invoicing, bank reconciliations, tax filings, SII submissions, annual accounts, financial reporting, regulatory reports, and audit support. Prepares client reports covering cash flow, payments, financial statements, and tax positions. Requires accuracy, client focus, strong organization, deadline management, teamwork, and fluent English in a fast-paced, multicultural environment.
Top Skills: Sii
4 Days Ago
In-Office or Remote
Expert/Leader
Expert/Leader
Artificial Intelligence • Healthtech • Machine Learning • Natural Language Processing • Biotech • Pharmaceutical
Leads global R&D environmental, health, and safety programs with primary authority in industrial hygiene. Oversees exposure assessments, hazard controls, laboratory safety, containment verification, risk registers, investigations, metrics, governance, and enterprise partnerships. Leads a global EH&S community of practice, influences senior stakeholders across sites, supports vendor programs and M&A due diligence, and develops organizational capability. The role requires up to 30% domestic and international travel and includes periodic laboratory and manufacturing-site access.
Top Skills: CorityEnablonIntelex

What you need to know about the Melbourne Tech Scene

Home to 650 biotech companies, 10 major research institutes and nine universities, Melbourne is among one of the top cities for biotech. In fact, some of the greatest medical advancements were conceptualized and developed here, including Symex Lab's "lab-on-a-chip" solution that monitors hormones to predict ovulation for conception, and Denteric's vaccine for periodontal gum disease. Yet, the thousands of people working in the city's healthtech sector are just getting started, to say nothing of the tech advancements across all other sectors.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account