Posted today · be early
Data Engineer - Web Scraping (3 months contract)
CXG
IndiaremotePosted today
Skill Required
Data-EngineerWeb-Scraping-EngineerETL-EngineerData-Pipeline-EngineerAnalytics-EngineerWeb DeveloperData EngineerData Warehousingdata engineeringEngineeringautomationTerraformdesigningsecurityAirflowPythonAzureCloudDesign PatternsdbtETLSQLGitandContract
Key highlights
- Remote work
- 3-month contract
- Minimum 2 years of experience
- Fluent in English required
- French is a plus
- Airflow and DBT preferred
Role overview
We are looking for a Data Engineer - Web Scraping to join our team remotely on a 3-month contract. The role involves maintaining and managing website scraping configurations, monitoring for errors, overseeing retrieved data, coordinating with stakeholders, preparing reports, and developing data pipelines to ingest data into the Datalake.
Responsibilities
- Maintain and manage website scraping configurations using Python.
- Monitor scraping configurations for errors and potential crashes.
- Oversee retrieved data to detect potential issues and blockages.
- Coordinate with stakeholders to understand scraping task requirements and report issues.
- Prepare and share periodic reports on scraping activities with stakeholders.
- Develop necessary pipelines to ingest data into the Datalake and perform required transformations.
Requirements
- Proven experience in data engineering with expertise in designing and implementing scalable data architectures.
- Strong experience with ETL processes, data modeling, and data warehousing.
- Expertise in database technologies, both relational (SQL) and NoSQL.
- Knowledge of cloud platforms, particularly Azure.
- Solid understanding of data security measures and compliance standards.
- Excellent Python experience for data engineering and automation.
- Strong collaboration skills to work closely with data scientists and analysts.
- Ability to optimize data pipelines for performance and efficiency.
- Ability to build, test, and maintain tasks and projects.
- Experience with version control systems, such as Git.
- Hands-on experience with Airflow and/or DBT.
- Experience with Terraform for infrastructure management.
- Minimum 2 years of experience in a similar role.
- Strong academic background in a relevant field.
- Fluent in English.
Nice to have
- Airflow & DBT preferred
- French is a plus
Additional details
- We are growing! We are currently looking to hire a Data Engineer - Web Scraping to work with us remotely on a 3 months contract.
- Who we are:
- Founded in 2006, CXG is a global customer experience company uniquely positioned at the intersection of data-driven retail performance, customer experience transformation, and operational execution across 200+ luxury brands worldwide.
- The mission of our 270 collaborators is to help brands transform customer and employee experiences through tailored insights, strategy, and implementation.
- We are passionate about delivering impact.
- Our clients include the world’s most admired luxury houses, and our solutions combine research, technology, and human expertise to elevate every customer interaction.
- What you will be doing:
- Requirements
- What you will bring along:
- Originally posted on Himalayas
