The Azure Data Engineer will build data pipelines and dataflows, implement security modules, and work with Azure services while supporting business requirements and data analysis.
This is a remote position.
Roles & Responsibilities:
- Understand business requirement and actively provide inputs from Data perspective.
- Understand the underlying data and flow of data.
- Build simple to complex pipelines & dataflows.
- Work with other Azure stack modules like Azure Data Lakes, SQL DW, etc.
- Should be able to implement modules that has security and authorization frameworks.
- Recognize and adapt to the changes in processes as the project evolves in size and function.
Requirements
Knowledge, Skills & Abilities:
- Expert level knowledge on Azure Data Factory.
- Expert level knowledge of SQL DB & Data warehouse (e.g. Microsoft SQL Server 2012/2016 & SSIS)
- Should know at least one programming language (e.g. C#, Visual Basic .NET, C++ .NET, PowerShell)
- Should be able to analyse and understand complex data.
- Knowledge of Azure data lake is an added advantage.
- Knowledge of other Azure Services like Analysis Service, SQL Databases will be an added advantage
- Excellent interpersonal/communication skills (both oral/written) with the ability to communicate at various levels with clarity & precision
Similar Jobs
Artificial Intelligence • Big Data • Information Technology • Consulting
The Azure Data Engineer will implement big data pipelines using Azure technologies, collaborate with stakeholders, and utilize tools like Data Factory and Databricks.
Top Skills:
Azure Data FactoryAzure Data LakesDatabricksGitPower BIPythonSQLSynapse
Fintech • Financial Services
The Data Engineer will design, develop, and maintain data pipelines and solutions, ensuring data quality and collaborating with cross-functional teams to meet analytics needs.
Top Skills:
Apache AirflowSparkAWSAzureDockerDynamoDBGCPGitHadoopJavaJenkinsKafkaKubernetesLuigiMongoDBMySQLNode.jsPostgresPythonTerraform
Fintech • Financial Services
Lead the design and development of scalable data pipelines using Ab-initio and Python, migrating workflows, ensuring data quality, and mentoring team members.
Top Skills:
Ab-InitioAWSAzureDeltaDockerGCPGitPandasParquetPysparkPythonSparkSQL
What you need to know about the Melbourne Tech Scene
Home to 650 biotech companies, 10 major research institutes and nine universities, Melbourne is among one of the top cities for biotech. In fact, some of the greatest medical advancements were conceptualized and developed here, including Symex Lab's "lab-on-a-chip" solution that monitors hormones to predict ovulation for conception, and Denteric's vaccine for periodontal gum disease. Yet, the thousands of people working in the city's healthtech sector are just getting started, to say nothing of the tech advancements across all other sectors.
