As a Senior Data Engineer, you will design, implement, and maintain data pipelines in Palantir Foundry, while collaborating with teams, ensuring data integrity, and optimizing workflows.
N-iX is a global software development service company that helps businesses across the globe create next-generation software products. Founded in 2002, we unite 2,400+ tech-savvy professionals across 40+ countries, working on impactful projects for industry leaders and Fortune 500 companies. Our expertise spans cloud, data, AI/ML, embedded software, IoT, and more, driving digital transformation across finance, manufacturing, telecom, healthcare, and other industries. Join N-iX and become part of a team where your ideas make a real impact.
We are seeking a proactive Senior Data Engineer to join our vibrant team. As a Senior Data Engineer, you will play a critical role in designing, developing, and maintaining sophisticated data pipelines, Ontology Objects, and Foundry Functions within Palantir Foundry. The ideal candidate will possess a robust background in cloud technologies, data architecture, and a passion for solving complex data challenges.
Responsibilities:
- Collaborate with cross-functional teams to understand data requirements, and design, implement and maintain scalable data pipelines in Palantir Foundry, ensuring end-to-end data integrity and optimizing workflows
- Gather and translate data requirements into robust and efficient solutions, leveraging your expertise in cloud-based data engineering. Create data models, schemas, and flow diagrams to guide development
- Develop, implement, optimize and maintain efficient and reliable data pipelines and ETL/ELT processes to collect, process, and integrate data to ensure timely and accurate data delivery to various business applications, while implementing data governance and security best practices to safeguard sensitive information
- Monitor data pipeline performance, identify bottlenecks, and implement improvements to optimize data processing speed and reduce latency
- Troubleshoot and resolve issues related to data pipelines, ensuring continuous data availability and reliability to support data-driven decision-making processes
- Stay current with emerging technologies and industry trends, incorporating innovative solutions into data engineering practices, and effectively document and communicate technical solutions and processes
Qualifications:
- 5+ years of experience in data engineering, preferably within the pharmaceutical or life sciences industry
- Strong proficiency in Python and PySpark
- Proficiency with big data technologies (e.g., Apache Hadoop, Spark, Kafka, BigQuery, etc.)
- Hands-on experience with cloud services (e.g., AWS Glue, Azure Data Factory, Google Cloud Dataflow)
- Expertise in data modeling, data warehousing, and ETL/ELT concepts
- Hands-on experience with database systems (e.g., PostgreSQL, MySQL, NoSQL, etc.)
- Proficiency in containerization technologies (e.g., Docker, Kubernetes)
- Effective problem-solving and analytical skills, coupled with excellent communication and collaboration abilities
- Strong communication and teamwork abilities
- Understanding of data security and privacy best practices
- Strong mathematical, statistical, and algorithmic skills
Nice to have:
- Certification in Cloud platforms, or related areas
- Experience with search engine Apache Lucene, Webservice Rest API
- Familiarity with Veeva CRM, Reltio, SAP, and/or Palantir Foundry
- Knowledge of pharmaceutical industry regulations, such as data privacy laws, is advantageous
- Previous experience working with JavaScript and TypeScript
We offer*:
- Flexible working format - remote, office-based or flexible
- A competitive salary and good compensation package
- Personalized career growth
- Professional development tools (mentorship program, tech talks and trainings, centers of excellence, and more)
- Active tech communities with regular knowledge sharing
- Education reimbursement
- Memorable anniversary presents
- Corporate events and team buildings
- Other location-specific benefits
*not applicable for freelancers
Similar Jobs
Information Technology • Consulting
As a Senior Data Engineer, you will build and maintain data pipelines and platforms, improve tools, and collaborate with a team to enhance online car market operations.
Top Skills:
AirflowAthenaAws ServicesFirehoseGCPGlueKafkaPysparkPythonSQL
Information Technology • Software
Design and develop big data processing engines with a focus on ETL pipeline, including complex logic and geo-location analysis.
Top Skills:
AirflowAWSGCPJavaKubernetesNoSQLPysparkScalaSparkSQL
Information Technology • Internet of Things
The Senior Data Engineer designs, builds, and maintains data infrastructure for large data sets, focusing on ETL processes and collaboration with stakeholders on data projects.
Top Skills:
AirflowAthenaAWSEc2EmrFirehoseKinesisLambdaPythonS3ScalaSpark
What you need to know about the Melbourne Tech Scene
Home to 650 biotech companies, 10 major research institutes and nine universities, Melbourne is among one of the top cities for biotech. In fact, some of the greatest medical advancements were conceptualized and developed here, including Symex Lab's "lab-on-a-chip" solution that monitors hormones to predict ovulation for conception, and Denteric's vaccine for periodontal gum disease. Yet, the thousands of people working in the city's healthtech sector are just getting started, to say nothing of the tech advancements across all other sectors.
