Data Engineer

Role & Responsibilities: Design, develop, and maintain ELT/ETL pipelines on GCP using Dataflow/Beam, Dataproc/Spark, and Airflow/Composer. Model and optimize datasets in BigQuery using partitioning, clustering, materialized views, and UDFs. Build streaming and near-real-time data ingestion using Pub/Sub, Dataflow, and CDC where applicable. Implement data quality checks, validation frameworks, and SLAs, monitoring pipelines via Cloud Monitoring/Logging.