Mars Logo

Mars

Data Engineer

Sorry, this job was removed at 01:19 a.m. (AEST) on Tuesday, Feb 18, 2025
In-Office or Remote
Hiring Remotely in Australia
In-Office or Remote
Hiring Remotely in Australia

Similar Jobs

4 Days Ago
In-Office or Remote
Expert/Leader
Expert/Leader
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
Lead data engineering architecture and execution for large-scale, low-latency analytics. Own technical direction, ensure operational data quality, design streaming and batch pipelines, mentor engineers, coordinate cross-functional teams, and deliver scalable solutions using Spark, Airflow, and AWS or equivalent data platforms.
Top Skills: AirflowAthenaColumn StoresDatabricksDatabricks ApisEmrFlinkHiveKafkaKappa ArchitectureLambda ArchitectureMaster Data Management (Mdm)Microservices ArchitectureRedshiftSparkSQLStreaming Pipelines
Yesterday
Remote or Hybrid
Australia
Mid level
Mid level
Big Data • Cloud • Logistics • Machine Learning • Retail
Leads architecture and development of large-scale batch and real-time data platforms and pipelines. Ensures data quality, governance, reliability, observability, scalability, and cost efficiency while building self-service capabilities. Supports analytics, machine learning, and generative AI teams with trusted data infrastructure. Establishes engineering standards, mentors engineers, and drives platform health across multiple teams. The role requires expertise in data integration, distributed processing, data modeling, cloud platforms, CI/CD, and infrastructure automation.
Top Skills: Apache AirflowApache BeamApache FlinkApache HiveSparkBigQueryCi/CdETLGoogle Cloud PlatformInfrastructure AutomationJavaPrestoPythonScalaWcag 2.2 Aa
2 Days Ago
Remote
Entry level
Entry level
Agency • Information Technology
Develop and maintain reliable data pipelines, ELT processes, workflow orchestration, custom data connectors, and CI/CD pipelines using Airflow, Python, PySpark, Hive/Trino, SQL, and Snowflake. Collaborate with cross-functional teams, monitor and troubleshoot data workflows, validate and test data, document technical processes, and support data governance.
Top Skills: Apache AirflowCi/CdHivePysparkPythonSnowflakeSQLTrino

Job Description:

Data and Analytics is foundational to our Petcare OGSM goal to transform the experience of pet ownership through digitalisation at scale. To deliver on this ambition set by this OGSM we require the very highest level of technical / engineering expertise within Global Petcare Data & Analytics. There is a need to expand this high performing team of creative, skilled individuals – to help build out new capabilities and bring fresh ideas to the table, particularly around real-time consumer data to feed marketing use cases.Key Responsibilities:

  • Engineer and orchestrate data flows & pipelines in a cloud environment using a progressive tech stack e.g. Databricks, Spark, Python, PySpark, Delta Lake, SQL, Logic Apps, Azure Functions, ADLS, Parquet, Neo4J, Flask
  • Ingest and integrate data from a large number of disparate data sources
  • Design and build complex data models for analytical and marketing use cases
  • Write high quality code contributing to a platform which is scalable and easy to maintain
  • Work closely with analysts, data scientists and technology partners to understand their requirements
  • Exercise fluid communication with your team of data engineers
  • Adopt DevOps & CI/CD methodologies to collaborate on a growing platform
  • Enthusiastically evolve your technical skillset, engage in training and learn new technologies and techniques
  • Tackle challenging project tasks demonstrating ownership and responsibility

Skills Required:

  • Experience in processing data using Spark / Databricks or similar
  • Experience working in a cloud environment (Azure, AWS, GCP) ·
  • Experience in at least one of: Python (or similar), SQL, PySpark ·
  • Experience in building data pipeline/ETL/ELT solutions
  • Ability and strong desire to research and learn new technologies and languages Interest in the contemporary data engineering and analytics landscape, the current tools, the latest approaches

Nice to Have:

  • Highly advantageous - Experience with consumer data In a real-time environment
  • Advantageous - Microsoft Azure cloud technologies e.g. Blob Storage, ADLS, Azure DevOps, Azure Logic Apps, Azure Functions, ADF, Azure Event Hub ·
  • Advantageous - Experience with Delta Live Tables (DLT) or Data Build Tool (DBT) ·
  • Advantageous - Delta Lake storage layer ·
  • Advantageous - Neo4J / Cypher

What can you expect from Mars?

  • Work with diverse and talented Associates, all guided by the Five Principles.
  • Join a purpose driven company, where we’re striving to build the world we want tomorrow, today.
  • Best-in-class learning and development support from day one, including access to our in-house Mars University.
  • An industry competitive salary and benefits package, including company bonus.

#TBDDT

Mars is an equal opportunity employer and all qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability status, protected veteran status, or any other characteristic protected by law. If you need assistance or an accommodation during the application process because of a disability, it is available upon request. The company is pleased to provide such assistance, and no applicant will be penalized as a result of such a request.

What you need to know about the Melbourne Tech Scene

Home to 650 biotech companies, 10 major research institutes and nine universities, Melbourne is among one of the top cities for biotech. In fact, some of the greatest medical advancements were conceptualized and developed here, including Symex Lab's "lab-on-a-chip" solution that monitors hormones to predict ovulation for conception, and Denteric's vaccine for periodontal gum disease. Yet, the thousands of people working in the city's healthtech sector are just getting started, to say nothing of the tech advancements across all other sectors.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account