Design and develop scalable data-driven solutions and pipelines using Python and SQL. Leverage Azure data services to build secure, high-performance architectures, ensuring data integrity, governance, and overall success of data projects.
As a Data Engineer, you will play a crucial role in designing and developing data-driven solutions for our clients. Your expertise in data exploration, Python, and SQL will be utilized to create efficient and scalable data pipelines. With a focus on Azure, you will leverage its data products and services to build robust and secure data architectures. Your role is key in ensuring data integrity, performance, and governance, while also contributing to the overall success of our data-centric projects.
Similar Jobs
Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
Design, build, and maintain cloud-native data pipelines and ETL/ELT workflows for high-volume trade lifecycle data. Integrate DTCC sources (RTTM, Settlement Web) into a Unified Trade Record, process ISO 15022 messages, manage trade exception databases, optimize SQL Server performance, and ensure data quality, lineage, governance, and observability while collaborating with business stakeholders.
Top Skills:
AWSDockerDtcc RttmDtcc Settlement WebEksEltETLFixFxmlIbm MqIndexingIso 15022KafkaKubernetesRdsRest ApiS3SQLSQL ServerStored ProceduresUnified Trade Record (Utr)
Information Technology
Design and develop data-driven solutions and scalable data pipelines using Python and SQL. Leverage Azure data products to build robust, secure architectures, ensuring data integrity, performance, and governance while supporting data-centric client projects.
Top Skills:
AzurePythonSQL
Information Technology
Design, build, and maintain scalable ETL/data pipelines and data management blueprints. Ingest, transform, and curate large complex datasets for analytics, support cloud (AWS) implementations, enable downstream consumers, and provide technical leadership and operational support to ensure data governance, quality, and automation.
Top Skills:
APIsAWSBashCronDb2DevOpsDynamoDBEtl FrameworksIbm VsamJavaJSONKanbanPsqlPythonRSafeSASScrumSparkSQLSsisSsrsTsqlXML
What you need to know about the Melbourne Tech Scene
Home to 650 biotech companies, 10 major research institutes and nine universities, Melbourne is among one of the top cities for biotech. In fact, some of the greatest medical advancements were conceptualized and developed here, including Symex Lab's "lab-on-a-chip" solution that monitors hormones to predict ovulation for conception, and Denteric's vaccine for periodontal gum disease. Yet, the thousands of people working in the city's healthtech sector are just getting started, to say nothing of the tech advancements across all other sectors.
