As a Data Engineer focusing on web scraping, you will manage scraping configurations, monitor errors, oversee data retrieval, and build data pipelines.
We are growing! We are currently looking to hire a Data Engineer - Web Scraping to work with us remotely on a 4 months contract.
Who we are:
Founded in 2006, our story started with two entrepreneurs. Today, we’re proud to be a global business. From Shanghai to Paris, we have 12 offices and operate across four continents in 70 countries. We are home to over 160 professionals from around the world, working together to serve more than 200 luxury clients.
At CXG, we love to evolve, elevate, and transform experiences while bringing brand promises to life. We offer strategic solutions that impact performance and elevate the customer experience of some of the world’s most iconic premium and luxury brands.
What you will be doing:
- Maintain and manage website scraping configurations using Python.
- Monitor scraping configurations for errors and potential crashes.
- Oversee retrieved data to detect potential issues and blockages.
- Coordinate with stakeholders to understand scraping task requirements and report issues.
- Prepare and share periodic reports on scraping activities with stakeholders.
- Develop necessary pipelines to ingest data into the Datalake and perform required transformations.
Requirements
What you will bring along:
- Proven experience in data engineering with expertise in designing and implementing scalable data architectures.
- Strong experience with ETL processes, data modeling, and data warehousing (Airflow & DBT preferred).
- Expertise in database technologies, both relational (SQL) and NoSQL.
- Knowledge of cloud platforms, particularly Azure.
- Solid understanding of data security measures and compliance standards.
- Excellent Python experience for data engineering and automation.
- Strong collaboration skills to work closely with data scientists and analysts.
- Ability to optimize data pipelines for performance and efficiency.
- Ability to build, test, and maintain tasks and projects.
- Experience with version control systems, such as Git.
- Hands-on experience with Airflow and/or DBT.
- Experience with Terraform for infrastructure management.
- Minimum 2 years of experience in a similar role.
- Strong academic background in a relevant field.
- Fluent in English (French is a plus).
Similar Jobs
Artificial Intelligence • Internet of Things
The Account Manager will build relationships within pharmaceutical markets, manage accounts, achieve revenue goals, and support customer success in specialty chemicals.
Top Skills:
Analytical Tools (ExcelCollaboration Platforms (TeamsCrm Systems (Salesforce)Power Bi)Sharepoint)
Fintech • Payments • Consulting • Financial Services
Seeking a Senior AI Engineer to develop and integrate AI solutions, mentor junior engineers, and build end-to-end pipelines using ML and deep learning methodologies.
Top Skills:
BentomlDockerDvcHugging Face TransformersKubernetesLangchainMlflowMlflow TrackingNumpyOpencvPandasPower BIPythonPyTorchScikit-LearnSparkSQLStreamlitTableauTensorFlowWeights & Biases
Appliances • Manufacturing
The role involves acquiring and analyzing data, building ETL pipelines, and deploying machine learning models to support business decisions and analytics.
Top Skills:
BigQueryDbtExcelLookerPythonRedshiftSQLTableau
What you need to know about the Melbourne Tech Scene
Home to 650 biotech companies, 10 major research institutes and nine universities, Melbourne is among one of the top cities for biotech. In fact, some of the greatest medical advancements were conceptualized and developed here, including Symex Lab's "lab-on-a-chip" solution that monitors hormones to predict ovulation for conception, and Denteric's vaccine for periodontal gum disease. Yet, the thousands of people working in the city's healthtech sector are just getting started, to say nothing of the tech advancements across all other sectors.
