Posted today · be early
Data Engineer - Offshore
Photon Interactive UK Limited
IndiaremotePosted 1 day ago
Skill Required
Data-EngineerETL-DeveloperBig-Data-EngineerCloud-Data-EngineerOffshore-Data-EngineerRemote-Mid-Level-Data-EngineerData Engineerdata engineeringPostgreSQLSQL ServerEngineeringDatabricksautomationanalyticsJenkinssecurityPythonOracledesignScalaAzureCI/CDCloudDesign PatternsETLSQLGitandCICDFulltime
Key highlights
- 3–7 years of experience in ETL development and data engineering
- Proficiency in Azure cloud functions, Azure Data Factory
Role overview
We are looking for a skilled and detail-oriented ETL Data Engineer to design, build, and maintain robust and scalable data extraction, transformation, and loading (ETL) pipelines. The ideal candidate will work closely with data analysts, scientists, and business stakeholders to deliver high-quality data solutions that support operational reporting, analytics, and decision-making.
Responsibilities
- Design, develop, test, and maintain ETL pipelines to process structured and unstructured data from diverse sources using Azure services such as cloud functions, data factory, databricks and other streaming services.
- Collaborate with data architects and business teams to gather data requirements and ensure data accuracy, integrity, and consistency.
- Optimize ETL workflows for performance, reliability, and scalability.
- Develop and maintain data models, schemas, and documentation for ETL processes.
- Monitor data flows and troubleshoot issues in production environments.
- Implement and enforce data quality rules, validation checks, and exception handling.
- Work with cloud and on-premise data storage systems and integrate them as needed.
- Ensure compliance with data governance, security, and privacy standards.
Requirements
- 3–7 years of experience in ETL development and data engineering.
- Proficiency in Azure cloud functions, Azure Data Factory.
- Strong SQL skills and experience working with relational databases (e.g., SQL Server, Oracle, PostgreSQL).
- Experience in scripting languages such as Python, Shell, or Scala for data manipulation and automation.
- Solid understanding of data modeling, warehousing concepts, and big data platforms.
- Experience with version control and CI/CD tools (e.g., Git, Jenkins).
- Ability to work independently and in cross-functional teams.
Additional details
- Description for Internal Candidates
- Originally posted on Himalayas