Endava Logo

Endava

Senior Data Engineer - GCP

Posted 19 Hours Ago
Be an Early Applicant
Melbourne, Victoria
Senior level
Melbourne, Victoria
Senior level
As a Senior Data Engineer, you will collaborate with data analysts and stakeholders to develop data processing flows, propose cloud architecture solutions, and design data transformation processes. Your role involves building and maintaining big data solutions and ensuring data quality and security.
The summary above was generated by AI

Company Description

Technology is our how. And people are our why. For over two decades, we have been harnessing technology to drive meaningful change.
By combining world-class engineering, industry expertise and a people-centric mindset, we consult and partner with leading brands from various industries to create dynamic platforms and intelligent digital experiences that drive innovation and transform businesses.
From prototype to real-world impact - be part of a global shift by doing work that matters.

Job Description

Our data team has expertise across engineering, analysis, architecture, modeling, machine learning, artificial intelligence, and data science. This discipline is responsible for transforming raw data into actionable insights, building robust data infrastructures, and enabling data-driven decision-making and innovation through advanced analytics and predictive modeling. 

Responsibilities:

  • Work closely with the Data Analyst/Data Scientist to understand evolving needs and define the data processing flow or interactive reports.
  • Discuss with the stakeholders from other teams to better understand how data flows are used within the existing environment.
  • Propose solutions for the cloud-based architecture and deployment flow.
  • Design and build processes, data transformation, and metadata to meet business requirements and platform needs.
  • Design and propose solutions for the Relational and Dimensional Model based on platform capabilities.
  • Develop, maintain, test, and evaluate big data solutions.
  • Focus on production status and data quality of the data environment.
  • Pioneer initiatives around data quality, integrity, and security.

Qualifications

  • +5 years working with the GCP ecosystem.
  • +5 years of experience in Data Engineering.
  • Proficiency in Apache Spark.
  • Proficiency in Python.
  • Some experience leading IT projects and stakeholder management.
  • Experience implementing ETL/ELT process and Data pipelines.
  • Experience with Snowflake.
  • Strong SQL scripting experience.
  • Background and experience with cloud data technologies and tools.
  • Familiar with data tools and technologies like:
  • Spark, Hadoop, Apache beam, Dataproc or similar.
  • BigQuery, Redshift, or other Data warehouse tools.
  • Real-time pipelines with Kinesis or Kafka.
  • Batch processing.
  • Serverless processing.
  • Strong analytic skills related to working with structured and unstructured data sensibilities.
  • Cloud certifications such as Associate Cloud Engineer will be an asset.

Additional Information

Discover some of the global benefits that empower our people to become the best version of themselves:

  • Finance: Competitive salary package, share plan, company performance bonuses, value-based recognition awards, referral bonus;
  • Career Development: Career coaching, global career opportunities, non-linear career paths, internal development programmes for management and technical leadership;
  • Learning Opportunities: Complex projects, rotations, internal tech communities, training, certifications, coaching, online learning platforms subscriptions, pass-it-on sessions, workshops, conferences;
  • Work-Life Balance: Hybrid work and flexible working hours, employee assistance programme;
  • Health: Global internal wellbeing programme, access to wellbeing apps;
  • Community: Global internal tech communities, hobby clubs and interest groups, inclusion and diversity programmes, events and celebrations.

Top Skills

Python

Endava Melbourne, Victoria, AUS Office

Melbourne, Victoria, Australia

Similar Jobs

Be an Early Applicant
5 Days Ago
Melbourne, Victoria, AUS
192 Employees
Senior level
192 Employees
Senior level
Fintech • Software • Financial Services
As a Senior Data Engineer at GROW Inc, you will design and manage a scalable data platform, author clean code and documentation, mentor junior engineers, and enhance data quality. You will leverage diverse technologies for processing and warehousing data, contributing to the infrastructure development and improvements alongside your team.
Be an Early Applicant
6 Days Ago
Melbourne, Victoria, AUS
617 Employees
Mid level
617 Employees
Mid level
Database
As a Senior Data Engineer, you will implement innovative solutions using Quantexa’s software for various domains. Responsibilities include writing efficient production code, configuring software with technologies like Spark and Hadoop, and collaborating with solution architects to overcome big data challenges.
Be an Early Applicant
15 Days Ago
Melbourne, Victoria, AUS
131 Employees
Mid level
131 Employees
Mid level
Cloud • Mobile • Software • Analytics
As a Data Engineer at InfoCentric, you'll support and enhance the reporting pipeline using Python. Your responsibilities include maintaining existing data processes, improving stability, and ensuring SLAs are consistently met while working independently within a complex environment.

What you need to know about the Melbourne Tech Scene

Home to 650 biotech companies, 10 major research institutes and nine universities, Melbourne is among one of the top cities for biotech. In fact, some of the greatest medical advancements were conceptualized and developed here, including Symex Lab's "lab-on-a-chip" solution that monitors hormones to predict ovulation for conception, and Denteric's vaccine for periodontal gum disease. Yet, the thousands of people working in the city's healthtech sector are just getting started, to say nothing of the tech advancements across all other sectors.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account