Progress Partners Logo

Progress Partners

Senior Data Engineer

Posted Yesterday
Remote
Hiring Remotely in European Union
Senior level
Remote
Hiring Remotely in European Union
Senior level
Build a greenfield data platform and unified Lakehouse integrating high-volume payment, marketing, and operational data across AWS and GCP. Design ingestion pipelines, create dbt medallion-layer transformations in BigQuery, and own Airflow orchestration, lineage, backfills, retries, alerting, infrastructure as code, and cost controls. The role requires autonomous ownership in a fully remote, asynchronous environment, with data mesh and Starburst Galaxy experience as preferred qualifications.
The summary above was generated by AI
About Progress Partners

Progress Partners is a fast-growing technology company building and scaling next-generation SaaS and mobile platforms. We blend creativity with data-driven execution to ship high-impact products, including AI-powered tools, productivity platforms, and workflow software, used by millions of people in more than 160 countries.

Our global team of experts in software development, product design, growth, and analytics collaborates across time zones to deliver category-defining innovations. We work end-to-end across the product lifecycle: design, build, launch, and scale.

If you’re passionate about building transformative products, Progress Partners is a place to make a lasting impact.

About the Role

We're looking for a Senior Data Engineer to build our data platform from scratch, a rare greenfield opportunity to make the foundational architecture calls yourself. You'll design the pipelines that bring together high-volume payment transactions, marketing analytics, and operational data across AWS and GCP into a unified Lakehouse. This is a hands-on, ownership-heavy role.

What You’ll Do
  • Design and build ingestion pipelines for high-volume payment data (Stripe, PayPal, Solidgate), marketing analytics (GA4, GTM, Google Ads, Amplitude), and operational databases (MongoDB, PostgreSQL).

  • Build the data infrastructure for a Lakehouse using AWS and GCP.

  • Build medallion-layer transformation models (Bronze → Silver → Gold) in dbt, with payments and marketing data on BigQuery.

  • Own orchestration end-to-end in Airflow, lineage, sensors, backfills, retries, and alerting across the full asset graph.

  • Implement infrastructure as code best practices, cost controls etc.

What We’re Looking For
  • 3+ years building production data platforms and pipelines from the ground up.

  • Deep expertise in Airflow, including lineage, backfill, and retry strategies.

  • Hands-on experience with dbt, version-controlled transformations.

  • Strong AWS and GCP skills, with Terraform for infrastructure as code and a cost-conscious (FinOps) approach.

  • Strong written communication and the ability to work autonomously in a remote, async environment.

Nice to Have
  • Familiarity with data mesh principles, domain ownership, or data product design.

  • Experience with Lakehouse architecture and Starburst Galaxy.

How We Work

We’re fully remote and distributed across time zones. We default to async, communicate in writing, and trust people to deliver outcomes, not log hours. Decisions are transparent, ownership is clear, and your work is visible from day one.

Interview Process


We've designed our interview process to be transparent, respectful of your time, and a genuine two-way conversation, we want to get to know you, and we want you to get to know us. You'll always know what stage you're at, what to expect next, and roughly how long things will take.

  • Initial screen with our Talent Acquisition Team - 30 min

  • Take-home assessment - Estimated effort: 4–6 hours

  • Technical Interview with the Head of Data - 60 min

What We Offer
  • Remote-first: work from anywhere in the world, no relocation required.

  • Flexible hours: we measure outcomes, not time at a desk.

  • Unlimited PTO: take the time you need to rest, recharge, and do your best work.

  • Learning & development budget: courses, books, conferences, certifications, whatever helps you grow.

  • Performance-based compensation: your impact directly shapes your pay and career trajectory.

  • A small, senior, collaborative team where your work is visible and your decisions matter.

  • The chance to build products used by millions of people across 160+ countries.

Equal Opportunity

Progress Partners is an equal opportunity employer, and we’re serious about building a diverse, inclusive team. We welcome applications from people of all genders, gender identities and expressions, sexual orientations, ages, ethnicities, nationalities, religions, disabilities, neurotypes, family situations, socioeconomic backgrounds, and life experiences.

We hire on skills, experience, potential, and values fit, never on protected characteristics. If you need accommodations during the application or interview process, just let us know.

Similar Jobs

21 Days Ago
Remote
Senior level
Senior level
Information Technology • Consulting
Design and build production-grade data-quality frameworks and high-throughput pipelines to power fraud, AML, and transaction-monitoring decision engines. Enable fast deployment of detection rules, embed as a hands-on IC in a product squad, and share engineering best practices across the organisation.
Top Skills: AirflowAWSClaude CodeGCPGitGithub CopilotGoogle BigqueryLinearNotionPostgresPythonSlackSQL
2 Days Ago
Remote
Senior level
Senior level
Edtech • Information Technology • Social Impact • Software • Database • Analytics • Generative AI
Design, build, and operate reliable, analytics-ready data pipelines and platform components. Partner with analytics stakeholders, ensure production data quality, monitor and debug systems, mentor engineers, and drive technical strategy and documentation to improve scalability and operational excellence.
Top Skills: AirflowAPIsBi ToolsCi/CdData Quality ToolingData WarehousesDbtEltGCPGitPythonSQLTerraform
20 Days Ago
Remote
Senior level
Senior level
Information Technology • Consulting
Architect and operate hybrid-cloud data infrastructure (AWS + GCP/BigQuery). Design data lakes, orchestrate pipelines (Airflow), manage IAM and cost optimisation, maintain observability, and embed as a hands-on IC to enable data engineering and AI transformations.
Top Skills: AirflowAthenaAWSBigQueryGCPGluePythonS3Terraform

What you need to know about the Melbourne Tech Scene

Home to 650 biotech companies, 10 major research institutes and nine universities, Melbourne is among one of the top cities for biotech. In fact, some of the greatest medical advancements were conceptualized and developed here, including Symex Lab's "lab-on-a-chip" solution that monitors hormones to predict ovulation for conception, and Denteric's vaccine for periodontal gum disease. Yet, the thousands of people working in the city's healthtech sector are just getting started, to say nothing of the tech advancements across all other sectors.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account