Similar Jobs

Atlassian

Data Engineer

Yesterday

In-Office or Remote

Expert/Leader

Cloud • Information Technology • Productivity • Security • Software • App development • Automation

Lead data engineering architecture and execution for large-scale, low-latency analytics. Own technical direction, ensure operational data quality, design streaming and batch pipelines, mentor engineers, coordinate cross-functional teams, and deliver scalable solutions using Spark, Airflow, and AWS or equivalent data platforms.

Top Skills: AirflowAthenaColumn StoresDatabricksDatabricks ApisEmrFlinkHiveKafkaKappa ArchitectureLambda ArchitectureMaster Data Management (Mdm)Microservices ArchitectureRedshiftSparkSQLStreaming Pipelines

Atlassian

Senior Data Engineer

4 Days Ago

In-Office or Remote

Senior level

Cloud • Information Technology • Productivity • Security • Software • App development • Automation

Lead and execute data engineering initiatives: define metrics, instrument logging, ingest and model data, build ETL/ELT pipelines, ensure data quality and governance, optimize processing performance, enable analytics/visualization, and lead projects that drive product and business strategy.

Top Skills: Anomaly DetectionDashboardingData ModelingData QualityData VisualizationEltETLLoggingProduct AnalyticsPythonRelational DatabasesSQL

Anovia Inc.

Data Engineer

4 Hours Ago

Remote

Senior level

Cloud • Information Technology • Professional Services • Software

Build production-grade agentic AI systems that reason, search, and execute workflows. Develop RAG pipelines, AI agents, semantic search layers, data processing solutions, dimensional data models, and scalable AI workloads. Work with structured and unstructured data, LLMs, vector databases, cloud infrastructure, CI/CD, and ML observability. Responsibilities include fine-tuning models, prompt engineering, optimizing context windows, and deploying reliable AI applications.

Top Skills: Ai AgentsAmazon RedshiftAws BedrockAws LambdaCi/CdClaudeEmbedding ModelsGeminiGoogle IndexingGptLangchainLlamaindexMl ObservabilityPandasPgvectorPysparkPythonRagScalaSnowflakeSQLTransformer Architectures

Job Description:

Data and Analytics is foundational to our Petcare OGSM goal to transform the experience of pet ownership through digitalisation at scale. To deliver on this ambition set by this OGSM we require the very highest level of technical / engineering expertise within Global Petcare Data & Analytics. There is a need to expand this high performing team of creative, skilled individuals – to help build out new capabilities and bring fresh ideas to the table, particularly around real-time consumer data to feed marketing use cases.Key Responsibilities:

Engineer and orchestrate data flows & pipelines in a cloud environment using a progressive tech stack e.g. Databricks, Spark, Python, PySpark, Delta Lake, SQL, Logic Apps, Azure Functions, ADLS, Parquet, Neo4J, Flask
Ingest and integrate data from a large number of disparate data sources
Design and build complex data models for analytical and marketing use cases
Write high quality code contributing to a platform which is scalable and easy to maintain
Work closely with analysts, data scientists and technology partners to understand their requirements
Exercise fluid communication with your team of data engineers
Adopt DevOps & CI/CD methodologies to collaborate on a growing platform
Enthusiastically evolve your technical skillset, engage in training and learn new technologies and techniques
Tackle challenging project tasks demonstrating ownership and responsibility

Skills Required:

Experience in processing data using Spark / Databricks or similar
Experience working in a cloud environment (Azure, AWS, GCP) ·
Experience in at least one of: Python (or similar), SQL, PySpark ·
Experience in building data pipeline/ETL/ELT solutions
Ability and strong desire to research and learn new technologies and languages Interest in the contemporary data engineering and analytics landscape, the current tools, the latest approaches

Nice to Have:

Highly advantageous - Experience with consumer data In a real-time environment
Advantageous - Microsoft Azure cloud technologies e.g. Blob Storage, ADLS, Azure DevOps, Azure Logic Apps, Azure Functions, ADF, Azure Event Hub ·
Advantageous - Experience with Delta Live Tables (DLT) or Data Build Tool (DBT) ·
Advantageous - Delta Lake storage layer ·
Advantageous - Neo4J / Cypher

What can you expect from Mars?

Work with diverse and talented Associates, all guided by the Five Principles.
Join a purpose driven company, where we’re striving to build the world we want tomorrow, today.
Best-in-class learning and development support from day one, including access to our in-house Mars University.
An industry competitive salary and benefits package, including company bonus.

#TBDDT

Mars is an equal opportunity employer and all qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability status, protected veteran status, or any other characteristic protected by law. If you need assistance or an accommodation during the application process because of a disability, it is available upon request. The company is pleased to provide such assistance, and no applicant will be penalized as a result of such a request.

What you need to know about the Melbourne Tech Scene

Home to 650 biotech companies, 10 major research institutes and nine universities, Melbourne is among one of the top cities for biotech. In fact, some of the greatest medical advancements were conceptualized and developed here, including Symex Lab's "lab-on-a-chip" solution that monitors hormones to predict ovulation for conception, and Denteric's vaccine for periodontal gum disease. Yet, the thousands of people working in the city's healthtech sector are just getting started, to say nothing of the tech advancements across all other sectors.