Design, build, and maintain scalable Snowflake-based data warehouses and ETL/ELT pipelines. Develop complex SQL and Snowflake stored procedures, implement CDC and incremental loads, optimize performance and cost, monitor pipelines, and perform data validation and reconciliation.
- Design, develop, and maintain scalable data pipelines and data warehouse solutions using Snowflake.
- Develop complex and optimized SQL queries for data transformation, extraction, and analysis.
- Build and maintain ETL/ELT pipelines for integrating data from multiple source systems.
- Design Snowflake databases, schemas, tables, views, stages, streams, and tasks.
- Develop efficient data transformation processes using Snowflake SQL and Stored Procedures.
- Implement incremental data loading and change-data-capture (CDC) strategies.
- Optimize Snowflake workloads for performance, scalability, and cost efficiency.
- Monitor data pipelines and troubleshoot data processing failures and performance issues.
- Perform data validation, reconciliation, and quality checks across source and target systems.
- Design, develop, and maintain scalable data pipelines and data warehouse solutions using Snowflake.
- Develop complex and optimized SQL queries for data transformation, extraction, and analysis.
- Build and maintain ETL/ELT pipelines for integrating data from multiple source systems.
- Design Snowflake databases, schemas, tables, views, stages, streams, and tasks.
- Develop efficient data transformation processes using Snowflake SQL and Stored Procedures.
- Implement incremental data loading and change-data-capture (CDC) strategies.
- Optimize Snowflake workloads for performance, scalability, and cost efficiency.
- Monitor data pipelines and troubleshoot data processing failures and performance issues.
- Perform data validation, reconciliation, and quality checks across source and target systems.
- 5+ years of experience in data engineering or a related field.
- Strong hands-on experience with Snowflake.
- Advanced SQL skills.
- Strong understanding of data warehousing concepts, including:
- Star and snowflake schemas
- Fact and dimension tables
- Slowly Changing Dimensions (SCD)
- Data modeling
- ETL/ELT
- Experience developing and managing data pipelines.
- Strong knowledge of Snowflake features such as:
- Streams
- Tasks
- Stages
- Snowpipe
- Time Travel
- Zero-Copy Cloning
- Dynamic Tables
- Stored Procedures
- Experience with cloud platforms such as AWS, Azure, or GCP.
- Experience with Git and CI/CD practices.
- Strong debugging and problem-solving skills.
- Experience working in Agile/Scrum environments
Similar Jobs
Software
Design, build, and maintain batch and real-time ETL/ELT data pipelines and workflows. Automate ingestion, aggregation and logging; ensure data accuracy, security, and compliance. Implement data warehouse and lake solutions, mentor junior engineers, and collaborate with stakeholders to meet business requirements.
Top Skills:
AdfAdls Gen2AirflowAthenaAWSAws QuicksightAzureAzure Sql DbAzure SynapseBigQueryCassandraData LakesData WarehousesEc2EmrFivetranGCPGlueGlue EtlHadoopHiveIamJavaLambdaMapreduceMatillionMongoDBNeo4JNumpyPandasPower BIPythonRdsRedisRedshiftS3ScalaSnowflakeSparkSQLStitchTableau
Information Technology
Design, build, and optimize scalable Snowflake-based data pipelines and architectures. Implement ETL/ELT processes, ensure security and performance, collaborate with data teams, troubleshoot data issues, and mentor junior engineers while staying current with Snowflake features and cloud technologies.
Top Skills:
AWSAzureData SharingDbtGCPInformaticaMatillionPythonSnowflakeSnowpipeSQLTime Travel
Agency • Information Technology
Design, build and maintain ETL mappings and data models; write SQL and Snowflake queries; manage ETL/infrastructure on AWS (EC2); use Informatica, Control-M and ServiceNow; script in Python/Shell/PowerShell; collaborate with onshore/offshore teams and define BI delivery strategy.
Top Skills:
AngularAws Ec2Control-MDaticalInformaticaJenkinsPower BIPowershellPythonServicenowShellSnowflakeSQLStashTableauUdeployUnix
What you need to know about the Melbourne Tech Scene
Home to 650 biotech companies, 10 major research institutes and nine universities, Melbourne is among one of the top cities for biotech. In fact, some of the greatest medical advancements were conceptualized and developed here, including Symex Lab's "lab-on-a-chip" solution that monitors hormones to predict ovulation for conception, and Denteric's vaccine for periodontal gum disease. Yet, the thousands of people working in the city's healthtech sector are just getting started, to say nothing of the tech advancements across all other sectors.
