Data Engineer-PL
Iassess Consultants
IndiaPosted 8 days ago
I
Skill Required
IT JobsData EngineerData WarehousingDatabricksObservabilityQuery OptimizationAirflowSparkPythondesignClouddbtETLSQLandFulltime
Role overview
Job Description Strong SQL and Python. Data modelling, warehousing concepts, partitions, clustering, indexing, optimisation. ETL/ELT pipeline design and production support. Batch and streaming pipeline fundamentals. Orchestration using Airflow, Composer, Control-M, ADF, dbt, or equivalent. Big data processing using Spark, PySpark, Beam, Dataflow, Dataproc, Databricks, EMR, or equivalent. Cloud storage and data lake concepts.