Build, enhance, and maintain batch, streaming, and near-real-time data pipelines. Design reusable frameworks for ingestion, transformation, orchestration, and data quality. Develop ETL/ELT solutions using SQL and distributed processing, while implementing production-grade error handling, logging, monitoring, troubleshooting, and performance optimization.
Must Have Skills: Kafka, API implementation,
PostgreSQL, AWS
Nice to Have Skills: AWS certified
Detailed Job Description
Good communication
skills with knowledge on Kafka, API implementation, PostgreSQL, AWS
•Strong
understanding of SDLC process.
•Should have
Strong understanding and trouble shooting skills
Core
requirements:
- Must have strong experience in building,
enhancing, and maintaining data pipeline frameworks supporting
batch, streaming, and near‑real‑time processing.
- Must be able to design
reusable data engineering frameworks, accelerators, and templates to
standardize ingestion, transformation, orchestration, and data quality
controls.
- Must demonstrate proficiency in ETL/ELT
development, SQL-based transformations, and distributed data
processing.
Must implement production-grade
pipelines with appropriate error handling, logging, monitoring, and
performance optimization.
XPT Software Australia Pty Ltd Melbourne, Victoria, AUS Office
Melbourne, Australia
Similar Jobs
Fintech • Financial Services
Provides hands-on principal-level leadership for enterprise data engineering across AWS, Snowflake, Kafka, Spark, and real-time streaming. Designs scalable batch and event-driven platforms, modernizes legacy data warehouses, leads end-to-end delivery, establishes engineering standards, and mentors engineers. Builds production-grade Python pipelines and services while improving observability, optimization, data quality, and AI-assisted engineering capabilities.
Top Skills:
Amazon MskApache FlinkSparkAthenaAWSAws CdkClouderaCloudFormationCopilot StudioDatabricksDynamoDBEcsEksEmrGithub ActionsGlueHadoopHiveIamKafkaKinesisLambdaMicrosoft CopilotMicrosoft FabricOraclePysparkPythonRedshiftS3ScalaSnowflakeSnsSQLSqsTeradata
Blockchain • eCommerce • Fintech • Payments • Software • Financial Services • Cryptocurrency
Conduct outbound prospecting through cold calls, email, and social selling to identify prospective Square merchants. Manage and prioritize a business pipeline, understand merchant needs, present targeted solutions, qualify opportunities, document sales activity, and pass qualified leads to Account Executives. Meet or exceed monthly quotas while developing sales expertise through mentorship and career growth opportunities.
Blockchain • Fintech • Mobile • Payments • Software • Financial Services
Supports Australian independent contractor sales teams by answering inquiries, providing product and pricing guidance, resolving operational issues, maintaining sales resources, processing commissions, and keeping systems current. The role requires relationship-building, cross-functional coordination, problem-solving, CRM proficiency, familiarity with B2B sales processes, and basic reporting knowledge. It is remote-first with minimal occasional travel.
Top Skills:
Ai ToolsGoogle WorkspaceHubspotSalesforce
What you need to know about the Melbourne Tech Scene
Home to 650 biotech companies, 10 major research institutes and nine universities, Melbourne is among one of the top cities for biotech. In fact, some of the greatest medical advancements were conceptualized and developed here, including Symex Lab's "lab-on-a-chip" solution that monitors hormones to predict ovulation for conception, and Denteric's vaccine for periodontal gum disease. Yet, the thousands of people working in the city's healthtech sector are just getting started, to say nothing of the tech advancements across all other sectors.



