Senior Data Engineer

Skill set: Solid coding skills in languages such as SQL/Python/Java/Scala. Proficiency in Spark/Flink/Hive/Hadoop/Azure/Databricks for batch and real-time processing. Solid understanding of data pipeline, data warehousing and data modelling. Experience with data visualization tools like QlikSense or PowerBI. Experience with data governance framework. Exposure to cloud, Full stack (Angular, etc.) preferred. Responsibilities: Design, build, and maintain efficient and reliable ETL pipelines to process and analyze large volumes of data from various sources. Define and build data architecture for a trusted, governed repository of data. Maintain a documented data warehouse using data product and data dictionary concepts. Apply knowledge of real-time, streaming, and batch processing concepts to optimize data processing. Participate in code and design reviews to maintain high development standards. Qualification: B.E. / B. Tech / MCA/ M. Tech