Design, build, and maintain scalable data pipelines and Delta tables using Microsoft Fabric and Python/Spark SQL. Optimize datasets for Power BI, monitor data quality, support CI/CD and deployments, manage Fabric performance and security, and document operational runbooks.
Primary Location
Job Description Summary
In this role, you’ll work closely with stakeholders across the organisation to design, build, and optimise scalable data solutions that drive performance, innovation, and operational excellence. This is an ideal opportunity for someone who combines strong technical expertise with business acumen and a passion for turning data into actionable insights.
Location: Collins Street, Melbourne (Hybrid)
Work type: Permanent
Requirements: Australian Citizenship or Permanent Residency desirable
About the Role
- Design, build, and maintain data pipelines using Microsoft Fabric (Data Factory, Lakehouse, Notebooks)
- Develop and optimise Delta tables for reporting and analytics
- Build data transformation workflows using Python and Spark SQL
- Implement robust data engineering patterns (incremental loads, merges, validation)
- Optimise datasets for Power BI (semantic models, Direct Lake)
- Monitor pipeline performance, data quality, and reliability
- Support CI/CD practices (Git integration, deployment pipelines)
- Manage Fabric capacity and performance optimisation
- Implement and maintain data security (RLS, workspace permissions, OneLake)
- Document solutions, standards, and operational runbooks
About you
You’re a passionate data engineer who thrives in a collaborative, fast-paced environment. You’re comfortable working across complex data ecosystems and enjoy solving business problems using modern data technologies.
- 3–4 years in data engineering
- Proven experience building end-to-end data pipelines and enterprise data models
- Hands-on experience with Microsoft Fabric or Azure data technologies (Synapse, Data Factory, Databricks)
- Strong knowledge of Delta Lake and medallion architecture
- Experience supporting Power BI optimisation and migration projects
Skills and qualifications
- Degree in Computer Science, IT, Data Engineering or related field
- Microsoft certifications highly regarded:
DP-700 (Fabric Data Engineer Associate)
DP-900 (Azure Data Fundamentals)
- Strong communication and stakeholder engagement skills
- Ability to work across multiple business units in a complex environment
- Passion for building scalable analytics solutions
- Advocacy for data-driven decision-making
- Resilience and adaptability in evolving environments
About Service Stream
Service Stream is an equal opportunity, ASX-listed business that develops and operates Australia’s essential service networks across telecommunications, utilities, transport, defence and social infrastructure. We keep communities connected—and we’re proud of the work we do.
Why you’ll like working here
- Flexible working: genuine flexibility options available.
- Growth: national career pathways across multiple business units.
- Discounts: retail partners including Woolworths, Airbnb, JB Hi-Fi, Bupa and more.
- Paid leave: parental, cultural, community service, study, volunteering and purchased leave.
- Inclusive culture: we value diversity, inclusion and celebrate excellence.
How to apply
Click Apply to submit your application. You’ll be prompted to create a profile in our recruitment system.
We welcome applications from Aboriginal and/or Torres Strait Islander peoples, people with disability or neurodivergence, members of the LGBTIQA+ community, Veterans and people from all backgrounds.
Applications can’t be accepted via email. If you require reasonable adjustments during the recruitment process, please contact [email protected].
Department
If this sounds like you apply now to the Service Stream Recruitment Team via the online application button.
Similar Jobs
Energy • Utilities
Manage and optimise on-prem SQL Server systems, design and run hybrid ETL/ELT pipelines to AWS/GCP, integrate SaaS APIs (e.g., Genesys), tune query performance, implement orchestration (MS Agent), and ensure secure, governed data movement.
Top Skills:
AWSEtl/EltGCPGenesysGitKimball Dimensional ModellingMs AgentPower BIPythonRest ApisSdksSftpShell ScriptingSQLSQL ServerSsasSshSsisSsrs
Cloud • Fintech • Information Technology • Machine Learning • Software
Design, build, and operate scalable data platform pipelines and models using Snowflake, dbt, Prefect, Flink and AWS. Own end-to-end platform components, apply IaC with Terraform, implement CI/CD and testing, manage production systems, monitoring and incident response, and improve data quality and self-service capabilities for downstream teams.
Top Skills:
AWSDbtFlinkPrefectSnowflakeTerraform
Information Technology • Business Intelligence • Consulting
Design, build and optimise cloud data platforms and lakehouse solutions on Microsoft Azure and Microsoft Fabric. Develop scalable ETL/ELT pipelines, data models, and transformations using SQL, Spark and Python. Implement data governance, security, CI/CD and collaborate with stakeholders to enable analytics, reporting and AI use cases.
Top Skills:
Azure Data FactoryAzure Data Lake StorageAzure DatabricksAzure DevopsAzure SqlAzure Synapse AnalyticsMicrosoft Fabric Data FactoryMicrosoft Fabric LakehouseMicrosoft Fabric WarehouseMicrosoft OnelakeNotebooksPower BIPysparkPythonSparkSQL
What you need to know about the Melbourne Tech Scene
Home to 650 biotech companies, 10 major research institutes and nine universities, Melbourne is among one of the top cities for biotech. In fact, some of the greatest medical advancements were conceptualized and developed here, including Symex Lab's "lab-on-a-chip" solution that monitors hormones to predict ovulation for conception, and Denteric's vaccine for periodontal gum disease. Yet, the thousands of people working in the city's healthtech sector are just getting started, to say nothing of the tech advancements across all other sectors.
