India - Senior Data Engineer (Contractual Remote Opportunity)
Inchcape Shipping Services
IndiaremotePosted 8 days ago
Skill Required
Data-EngineeringData-EngineerData-IntegrationCloud-Data-EngineeringETL-ELT-EngineeringSenior-Data-EngineeringSenior-Cloud-Data-EngineerRemote-Data-EngineerData EngineerData Warehousingdata engineeringObservabilityEngineeringDatabricksautomationsecuritybuildingPythondesignScalaSparkKafkaAzureCI/CDCloudETLSQLAWSandCICDAIContract
Key highlights
- Contract duration: 3‑4 months, extendable as per business need.
- Required experience: 8+ years in data engineering/integration.
- Mandatory certification: Azure Data Engineering certification.
- Global presence: over 250 offices in 70 countries.
- Benefit: Access to a diverse, high‑performing workforce with training opportunities.
- Key requirement: Proficiency with Microsoft Fabric, Delta Lake, and cloud platforms (Azure & AWS).
Role overview
The Senior Data Engineer designs, builds and maintains the data ingestion and transformation pipelines that populate Inchcape’s central data platforms. This role ingests raw data from diverse systems, curates the bronze and silver layers of the medallion architecture, ensures data quality and performance, and delivers reliable, reusable datasets for modelling, analysis, reporting and BI.
Responsibilities
- Develop and maintain ETL/ELT pipelines to ingest data from ERP, CRM, operational, financial, and third‑party sources into the Microsoft Fabric Platform - Lakehouse (OneLake) using Delta Lake/Parquet.
- Implement data quality standards and controls, incremental loading, CDC and error handling to ensure reliability and correctness.
- Create bronze tables, curated Silver and gold tables by transforming, cleansing and conforming raw data, document lineage and transformations.
- Optimise performance through partitioning, clustering and tuning of MS Fabric, SQL and Spark workloads, monitor pipeline health and costs.
- Collaborate with Data Architects, Modellers and Data BAs to design schemas, naming conventions and integration patterns to ensure business self‑service enablement through Gold data.
- Build reusable components, templates and automation scripts using Fabric Dataflows Gen2, Spark notebooks or equivalent tools.
- Maintain metadata and sensitivity labels via Purview, ensure proper access controls and compliance.
- Research and evaluate new features and patterns in Microsoft Fabric and make recommendations for adoption, enabling an AI‑driven data strategy.
- Introduce the most economic, optimised technique in the data integration space to reduce total operational cost.
- Ensure NFR requirements like resilience, availability and security standards are applied as per agreed NFR metrics.
- Automated, documented ingestion pipelines with monitoring and alerting.
- High‑quality conforming bronze, silver and gold data assets that are ready for self‑service.
- Performance benchmarks and tuning reports demonstrating efficient resource usage.
- Contribution to ingestion templates, best practice guides and knowledge sharing.
- Low‑Level Designs for data pipelines and other data integration‑related assets.
Requirements
- 8+ years in data engineering or data integration roles, working with SQL, Python and or Scala.
- Experience of ETL/ELT patterns, CDC, incremental loading and data warehousing principles using Microsoft Fabric.
- Practical experience with Delta Lake, Lakehouse/Medallion architecture and cloud data platforms (Azure and AWS).
- Proficient in building pipelines with tools like MS Fabric Dataflows Gen2, Spark/SQL notebooks or equivalent.
- Experienced in data quality frameworks and monitoring/observability tools.
- Ability to collaborate across teams and communicate technical concepts to non‑engineers.
- Bachelor’s degree in computer science, engineering or related discipline.
- Certification in Azure Data Engineering is a MUST.
Nice to have
- Experience with streaming data (Kafka, Event Hubs) or real‑time ingestion.
- Knowledge of master data management and data governance practices.
- Familiarity with version control and CI/CD for data pipelines.
- Experience in, and assisted in, the implementation of governance, controls, and standards.
- Any Shipping or Maritime experience.
- Big Data Ecosystem prior experience is a plus.
- Certifications in AWS cloud data platform or other data platform.
Benefits
- Opportunity to work in a diverse and high‑performing workforce with a focus on training and development.
- Equal Opportunities Employer – commitment to equality, diversity and inclusion.
- Career can be rewarding with exposure to a global network of over 250 proprietary offices across 70 countries.
- Potential for contract extension based on business needs.
Additional details
- About Inchcape Shipping Services: At Inchcape, our vision is to have a connected world, in which our customers trade successfully and make better decisions in every port, everywhere. We use technology and our global network to help our partners connect to a smoother, smarter ocean.
- Inchcape combines its worldwide infrastructure with local expertise through our global network of over 250 proprietary offices, across 70 countries and a team of more than 3,000 committed professionals.
- Our diverse global customer base includes owners and charterers in the oil, cruise, container, and bulk commodity sectors as well as naval, government and intergovernmental organizations.
- We have an ambitious growth model and a career here is certainly going to be a rewarding one that will allow you to bring your skills & experience. We embrace change and are open to new thinking and pushing for positive change in our industry.
- Note: This role is on a contract basis & the duration of contract will be 3-4 months. It can be extendable as per the business need.
- Appointment to this role will be subject to satisfactory references and possession of a valid Right to Work documentation, depending upon your geographical location.
- To protect the interests of all parties, Inchcape will not accept unsolicited or speculative resumes from recruitment agencies and will not be responsible for any fees associated with them.
- Originally posted on Himalayas.