Designs and operates end-to-end data products on Databricks, including ingestion, transformation, streaming pipelines, APIs, applications, and curated datasets. Partners with stakeholders to clarify needs, prototype solutions, and deliver secure, scalable production systems. Responsibilities include data governance, testing, CI/CD, monitoring, optimization, troubleshooting, technical design, code reviews, and mentoring. The role requires strong SQL, Python, PySpark, cloud, event-streaming, backend, and data-modeling expertise.
Who we are
DigiCert is a global leader in intelligent trust. We protect the digital world by ensuring the security, privacy, and authenticity of every interaction. Our AI-powered DigiCert ONE platform unifies PKI, DNS, and certificate lifecycle management, to secure infrastructure, software, devices, messages, AI content and agents. Learn why more than 100,000 organizations, including 90% of the Fortune 500, choose DigiCert to stop today’s threats and prepare for a quantum-safe future at www.digicert.com
Job summary
We are looking for a Sr. Data Engineer - Full Stack to design and deliver end-to-end data solutions on Databricks — from stakeholder discovery and data ingestion through modeling, APIs, applications, and production operations.This hands-on role combines deep data engineering expertise with strong stakeholder partnership, product thinking, and end-to-end solution ownership. You will work directly with business and technical teams to clarify ambiguous problems, rapidly prototype solutions, and turn validated concepts into secure, scalable, and reliable data products.You will bridge data engineering, analytics, software engineering, and business teams to make trusted data actionable.
What you will do
- Partner directly with business and technical stakeholders to understand workflows, define desired outcomes, and translate ambiguous needs into technical requirements and delivery plans.
- Design, build, and maintain end-to-end data products on Databricks, spanning ingestion, Delta Lake storage, transformation, serving, APIs, and user-facing experiences.
- Develop and operate reliable batch, incremental, and streaming pipelines using SQL, Python, PySpark, Kafka, and Databricks-native capabilities.
- Design event-driven and near-real-time data solutions that integrate with operational systems and downstream consumers.
- Build backend services, APIs, and integrations that make governed data available to applications and operational workflows.
- Develop lightweight applications, dashboards, and interfaces in partnership with product, analytics, BI, and user-experience teams.
- Rapidly prototype solutions, validate them through stakeholder feedback, and prepare successful concepts for production use.
- Create scalable data models and curated datasets that support analytics, reporting, AI/ML, and operational decision-making.
- Implement data-quality, security, lineage, and governance controls using Databricks and Unity Catalog.
- Establish automated testing, CI/CD, monitoring, alerting, and documentation across the data-product lifecycle.
- Optimize pipelines, streaming workloads, queries, services, and applications for reliability, performance, scalability, and cost.
- Diagnose and resolve issues across source systems, streaming platforms, pipelines, data models, APIs, applications, and downstream consumers.
- Collaborate with platform and product engineering teams to turn recurring stakeholder needs into reusable capabilities.
- Lead technical design and code reviews, mentor engineers, and help elevate full-stack data-engineering practices.
What you will have
- 5+ years of experience in data engineering, software engineering, or a related role, including ownership of production data solutions.
- Strong proficiency in SQL, Python, and PySpark, with experience building reliable, production-grade pipelines and data products.
- Hands-on experience with Databricks, Apache Spark, Delta Lake, and Unity Catalog or comparable data-governance capabilities.
- Experience designing and supporting streaming or near-real-time data pipelines using Kafka, Kinesis, Event Hubs, or similar event-streaming technologies.
- Strong understanding of event-driven architecture, message processing, schema evolution, data consistency, and streaming reliability.
- Experience delivering full-stack solutions that include data pipelines, backend services or APIs, and lightweight user-facing applications.
- Experience building REST APIs, services, and integrations using Python frameworks such as FastAPI, Flask, or comparable technologies.
- Experience with AWS, Azure, or GCP and cloud-native architecture patterns.
- Strong understanding of data modeling, data warehousing, distributed processing, and analytics-friendly data design.
- Experience with Git, automated testing, CI/CD, monitoring, and production-deployment practices.
- Demonstrated ability to work directly with stakeholders, navigate ambiguity, and translate business problems into practical technical solutions.
- Strong communication, technical leadership, problem-solving, and end-to-end ownership skills.
- Ability to balance rapid delivery with maintainability, security, governance, and operational reliability.
Nice to have
- Experience building applications with React or another modern frontend framework.
- Familiarity with infrastructure as code, containerization, and automated cloud deployment.
- Experience supporting AI/ML pipelines, feature engineering, retrieval systems, or generative AI use cases.
- Experience with data observability, platform engineering, or data-product management practices.
- Working knowledge of JavaScript or TypeScript and a modern frontend framework such as React, or comparable data-application experience.
- Background in forward-deployed engineering, solutions engineering, technical consulting, or another stakeholder-embedded delivery role.
- Experience designing reusable data platforms, frameworks, or self-service capabilities.
- Prior experience mentoring engineers and contributing to engineering standards.
- Experience working in Agile or Scrum environments.
Benefits
- Generous time off policies
- Top shelf benefits
- Education, wellness and lifestyle support
To protect candidate information and maintain a secure hiring process, all applications must be submitted through our careers portal. Resumes or CVs sent directly via email will not be reviewed or considered.
#LI-SD1
Similar Jobs
Fintech • Legal Tech • Software • Financial Services • Cybersecurity • Data Privacy
Oversee private equity fund accounting, NAV calculations, capital accounts, waterfalls, carried interest, fees, expenses, transactions, valuations, and financial reporting. Review statements and investor packages, manage audits, ensure LPA and accounting-standard compliance, coordinate with auditors and tax advisors, and lead a fund accounting team. Drive controls, process standardization, automation, and system enhancements while supporting clients, GPs, and internal stakeholders.
Top Skills:
GenevaIfrsInvestranLux GaapExcelUs Gaap
Artificial Intelligence • Fintech • Information Technology • Logistics • Payments • Business Intelligence • Generative AI
The Senior Payroll Accountant manages global payroll accounting, including journal entries, reconciliations, accruals, tax compliance, and month-end and year-end close activities. The role analyzes payroll-related balance sheet and P&L fluctuations, maintains internal controls, supports audits, and ensures compliance with US GAAP and local statutory requirements across multiple regions. The accountant partners with HR, Payroll, FP&A, and finance teams while improving accounting processes through automation.
Top Skills:
FloqastGoogle GeminiExcelNetSuiteWorkiva
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Lead response and remediation for critical security incidents, coordinating global teams and communicating status, risks, decisions, and outcomes to executives and technical stakeholders. Develop and maintain incident response playbooks, procedures, and documentation; conduct tabletop exercises; support investigations, mitigation, post-incident reviews, and root cause analyses. Improve and automate major security incident processes while tracking metrics and ensuring effective preparation, response, and recovery.
Top Skills:
Mitre Att&Ck
What you need to know about the Melbourne Tech Scene
Home to 650 biotech companies, 10 major research institutes and nine universities, Melbourne is among one of the top cities for biotech. In fact, some of the greatest medical advancements were conceptualized and developed here, including Symex Lab's "lab-on-a-chip" solution that monitors hormones to predict ovulation for conception, and Denteric's vaccine for periodontal gum disease. Yet, the thousands of people working in the city's healthtech sector are just getting started, to say nothing of the tech advancements across all other sectors.
