Data Engineer II

NPS Prism

IndiaremotePosted 15 days ago
NPS Prism logo

Skill Required

Data-EngineeringData-Pipeline-DevelopmentCloud-Data-EngineeringETL-EngineeringBig-Data-EngineeringData-EngineerData-Engineer-JobsData EngineerSystem DesignBackup and Recoverydata engineeringrelated fieldETLCD pipelinesAzureEngineeringDatabricksautomationPower BIanalyticsbuildingTableauJenkinswrittenSparkTestNGPythondesignDevOpsKafkaCI/CDCloudDesign PatternsFulltime

Key highlights

  • 3–6 years of experience required
  • Work From Home is a key benefit
  • Proficiency in Python, SQL and PySpark is a must
  • Experience with Databricks and Apache Spark is required
  • Cloud platform expertise in Azure and AWS is mandatory
  • Company owned by Bain & Company, a top workplace

Role overview

We are seeking a highly skilled and experienced Data Engineer to join our team in Gurugram, India (Work From Home). The role involves designing, building, and optimizing ETL/ELT workflows and scalable data pipelines across Azure and AWS cloud platforms, using Databricks, Spark, Python, SQL and other modern data engineering tools. The engineer will collaborate with cross‑functional teams, implement DevOps/CI‑CD pipelines, enforce data quality, and maintain comprehensive documentation in a fast‑paced environment.

Responsibilities

  • Design, build, and optimize ETL/ELT workflows using tools like Databricks, SQL, Python/PySpark and Alteryx (Good to have).
  • Develop and maintain robust, scalable, and efficient data pipelines for processing large datasets from source to emerging data.
  • Work on cloud platforms (Azure, AWS) to build and manage data lakes, data warehouses, and scalable data architectures.
  • Utilize cloud services like Azure Data Factory, AWS Glue for data processing and orchestration.
  • Use Databricks for big data processing, analytics, and real‑time data processing.
  • Leverage Apache Spark for distributed computing and handling complex data transformations.
  • Create and manage SQL‑based data solutions, ensuring high availability, scalability, and performance.
  • Develop and enforce data quality checks and validation mechanisms.
  • Collaborate with cross‑functional teams, including data scientists, analysts, and business stakeholders, to deliver impactful data solutions.
  • Understand business requirements and translate them into technical solutions.
  • Leverage CI/CD pipelines to streamline development, testing, and deployment of data engineering workflows.
  • Work with DevOps tools like Git, Jenkins, or Azure DevOps for version control and automation.
  • Maintain clear documentation for data workflows, pipelines, and processes.
  • Optimize data systems for performance, scalability, and cost‑efficiency.

Requirements

  • Bachelor’s or Master’s degree in Computer Science, Information Technology, Engineering, or a related field.
  • 3–6 years of experience in Data Engineering or related roles.
  • Hands‑on experience with big data processing frameworks, data lakes, and cloud‑native services.
  • Proficiency in Python, SQL, and PySpark for data processing and manipulation.
  • Proven experience in Databricks and Apache Spark.
  • Expertise in working with cloud platforms like Azure and AWS.
  • Sound knowledge of ETL processes and tools like Alteryx (Good to have).
  • Leveraging data lakes, data warehouses, and data pipelines.
  • Build a data pipeline from scratch.
  • Strong understanding of distributed systems and big data technologies.
  • Basic understanding of DevOps principles and familiarity with CI/CD pipelines.
  • Hands‑on experience with tools like Git, Jenkins, or Azure DevOps.
  • Strong problem‑solving skills and a knack for optimizing data solutions.
  • Excellent communication (oral and written) skills.

Nice to have

  • Familiarity with data visualization tools like Power BI, Tableau, or similar.
  • Knowledge of streaming technologies such as Kafka or Event Hubs.
  • Use of Alteryx for ETL (mentioned as Good to have).

Benefits

  • Work From Home (WFH) role
  • Dynamic and fast‑paced work environment
  • Part of a market‑leading platform owned by Bain & Company, known as a top workplace
  • Focus on diversity, inclusion, and collaboration

Additional details

  • NPS Prism is a market‑leading, cloud‑based CX benchmarking and operational improvement platform owned by Bain & Company.
  • Launched in 2019, NPS Prism has rapidly grown to a team of over 200, serving dozens of clients around the world.
  • Location: Gurugram, India
  • Employment Type: Full‑time
  • Originally posted on Himalayas
Apply now