Data Engineer
WebEngage
IndiaremotePosted 1 month ago
Skill Required
Data-Engineer-JobsData-Engineering-AnalystData-Engineering-SpecialistData-Engineering-JobsData-EngineeringData-Pipeline-DevelopmentETL-ELT-EngineeringAnalytics-EngineeringData-Warehouse-EngineeringData-EngineerData-Engineering-PositionsEnterprise-Data-EngineerData EngineerData Warehousingdata engineeringETLObservabilityCD pipelinesEngineeringStatisticsanalyticalautomationGitHub ActionsSnowflakedesigninganalyticsBigQueryRedshiftbuildingAirflowfintechTestNGPythonPandasDockerdesignGitKafkaFulltime
Key highlights
- Required experience: 1–3 years
- Required degree: Bachelor’s in CS, Engineering, Math, Stats, or related field
- Key benefit: Macbook for Engagers
- Key requirement: Strong SQL and Python skills
Role overview
WebEngage is an enterprise-grade customer engagement and retention platform helping global brands turn data into measurable revenue impact through a full-stack retention operating system. Their Data Engineering team serves as the backbone of analytics, personalisation, and machine-learning capabilities. As a Data Engineer, you will own the end-to-end lifecycle of data, from ingesting raw event streams to building reliable datasets for dashboards and predictive models. This is a high-impact, hands-on role working at the intersection of product, analytics, and backend engineering, with a focus on data quality, pipeline observability, cost efficiency, and maintainability.
Responsibilities
- Design, build, and maintain production-grade ETL/ELT pipelines that ingest data from APIs, databases, event streams (Kafka/Pub-Sub), and flat files into the central data warehouse.
- Implement idempotent, incremental load patterns with built-in retry logic, dead-letter queues, and SLA-based alerting to ensure zero-data-loss pipelines.
- Own pipeline observability — set up data freshness checks, row-count validations, schema drift detection, and anomaly alerts using tools like Great Expectations or dbt tests.
- Translate business requirements into clean dimensional models (star/snowflake schemas) and maintain a well-documented data catalogue.
- Design slowly changing dimensions (SCD Type 1/2), bridge tables, and fact tables optimised for analytical query patterns.
- Enforce partitioning, clustering, and materialised view strategies to keep warehouse costs under control while maintaining sub-second query performance.
- Write clean, modular, well-tested Python and SQL code. Follow DRY principles, use version control (Git), and participate in peer code reviews.
- Build reusable transformation frameworks using dbt or equivalent tooling, with proper documentation and testing at every layer (staging → intermediate → mart).
- Containerise data services with Docker and automate deployments via CI/CD pipelines (GitHub Actions / GitLab CI).
- Build interactive dashboards and analytical tools using Streamlit, enabling stakeholders to explore metrics, run ad-hoc analyses, and make data-driven decisions without engineering dependency.
- Design and maintain BI layers — semantic models, KPI definitions, and pre-aggregated mart tables that serve as the single source of truth for reporting across teams.
- Translate raw data into compelling visual narratives using libraries like Plotly, Matplotlib, or Altair; present findings to both technical and non-technical audiences.
- Partner with product managers, analysts, and data scientists to understand data needs and proactively identify gaps in current data coverage.
- Document data lineage, transformation logic, SLAs, and known limitations in a shared knowledge base to enable self-service analytics.
- Contribute to internal engineering guilds, knowledge-sharing sessions, and post-incident reviews for pipeline failures.
Requirements
- Strong SQL skills with expertise in complex queries, performance optimization, and cost-efficient design on cloud data warehouses (BigQuery, Redshift).
- Strong Python scripting for data ingestion, transformation, and validation, with hands-on experience in Pandas, SQLAlchemy, APIs, and automation.
- ETL/ELT- End-to-end ownership of data pipelines, including ingestion, transformation, and loading, with understanding of incremental loads, and backfills.
- Data Modelling- Ability to design dimensional and transactional data models (star/snowflake, SCDs) and translate business needs into optimized table structures.
- Bachelor’s degree in Computer Science, Engineering, Mathematics, Statistics, or a related quantitative field (or equivalent practical experience).
- 1–3 years of professional experience in data engineering, analytics engineering, or a backend role with significant data pipeline work.
- Strong understanding of data warehouse architecture — know when to use wide denormalised tables vs. normalised models, and the trade-offs of each.
- Familiarity with version control workflows (Git branching strategies, pull requests, code reviews) and agile development practices.
- A data quality mindset — you instinctively validate assumptions, add assertions to pipelines, and treat silent data failures as critical incidents.
Nice to have
- Airflow, dbt, Docker, CI/CD
- GCP/AWS, data warehousing concepts
- BI tools / Streamlit / visualization
Benefits
- Full view of team goals via monthly & quarterly town hall meetings.
- Highly inclusive work culture that promotes a relaxed, creative and productive environment.
- Practice autonomy, open communication, growth opportunities, while maintaining a perfect work-life balance.
- Access to cutting-edge tools and mentorship (Macbook for Engagers!).
- Best in class medical insurance (with Covid Care facilities).
- Programs for taking care of your mental health.
- Contemporary Leave Policy (beyond sick leaves).
Additional details
- WebEngage is an enterprise-grade customer engagement and retention platform trusted by 800+ brands globally with a strong presence in India, UAE, KSA, SEA, Europe and beyond.
- WebEngage core capabilities include: Customer Data Platform (CDP), Real-time behavioral segmentation and intelligence, Omnichannel journey orchestration, AI-driven personalization and recommendations, Deep analytics, experimentation, and revenue attribution, and WebEngage BLACK (AI-native layer).
- WebEngage aims to be an equal opportunity employer and takes affirmative action to ensure equal opportunity regardless of race, color, religion, sex, sexual orientation, gender identity, national origin, disability, Veteran status, or other protected characteristics.
- Originally posted on Himalayas