Senior Data Engineer (Databricks)

The world’s biggest challenge needs you, here.

Big challenges require big solutions. And the transition to a net-zero world is about as big as it gets. Working at Shell Energy - one of Australia’s leading energy retailers - puts you at the heart of that endeavour.

Lead the change, from the frontline

Join our Melbourne team as a Senior Data Engineer, playing a crucial role in delivering and supporting the applications that drive our business. Reporting to the Principal Engineer, you'll ensure the security and efficiency of our infrastructure, drive innovation, and help achieve strategic goals.

In this leadership role within the Data Analytics team, you'll focus on delivering secure, trusted data and visualizations via our data platform, enabling timely decision-making. Your expertise in designing and implementing data pipelines and data lake/warehouse models will be essential in building high-quality data products. Lead your squad in modern engineering practices and ensure business continuity by supporting and maintaining what you build.

With respect, integrity and honesty, responsibilities include:

• Support Operations: Monitor security, performance, and availability of applications; triage and prioritise incidents.

• Value-Driven Decisions: Apply knowledge of business value drivers to prioritise and develop applications.

• Engineering Solutions: Design and implement solutions adhering to security, compliance, and engineering standards.

• Effort Estimation and Delivery: Provide and ensure delivery of accurate engineering effort estimates; escalate risks as needed.

• Data Quality and Security: Conduct thorough testing, perform security audits, system backups, and implement disaster recovery strategies.

• Mentorship and Innovation: Mentor team members, stay current with industry trends, and identify opportunities for process and technology improvements.

Here’s what you’ll need to thrive in this role:

• Data Engineering: Proficiency in data platforms, proven extensive Databricks experience is mandatory, Snowflake knowledge/experience is advantageous, programming languages, design patterns, version control (e.g., Git), and CI/CD practices.

• Agile Delivery: Experience in Agile environments, including project scope definition, work estimation, resource allocation, and stakeholder management.

• Infrastructure Management: Expertise in designing and managing cloud infrastructure, with hands-on experience in configuration management, virtualization, containerization, and automation tools.

• Automation and DevOps: Skilled in automation tools, configuration management (e.g., Ansible, Puppet, Chef), and CI/CD pipelines.

• Database Management: Knowledge of database concepts, relational and NoSQL databases, data modeling, optimization, and security.

• Technical Expertise: Deep understanding of IT domains, including data engineering, networking, systems administration, cybersecurity, cloud computing, and proficiency in multiple programming languages and IT tools.

Why join our team

Every day, our people bring deep expertise, true innovation and investment to help our customers - and the world - reduce their environmental footprint. You can be part of that change.

Here are the top reasons why our people choose us:

• Purpose that you can see. As part of our team, you’ll have the best shot at energising a better future, one customer at a time.

• Work that’s interesting, innovative and high impact. We hope you’ll love the challenge and opportunity to achieve - for our customers and for you.

• People who bring the expertise and drive to succeed. Our team is respectful, inclusive, and supports connection and collaboration.

Visit our careers site to find out more.

Careers | Shell Energy

Read the stories of our incredible people.

Meet Our People – About Us | Shell Energy

Join us. Together, we can make the difference count.

Shell Energy is an Equal Opportunity Employer that values the diversity of its people. We do not discriminate on the basis of gender, race, religion, colour, national origin, sexual orientation, age, marital status, veteran status or disability.