Senior Data Engineer
Mags Consulting
Injambakkam, Chennai, IndiaPosted 4 days ago
M
Skill Required
IT JobsData Engineerdata engineeringEngineeringSparkdesignCloudSQLAWSandFulltime
Role overview
Design, develop, and maintain scalable and high-performance data pipelines . Build distributed data processing solutions using Apache Spark / PySpark . Develop data ingestion, transformation, and integration processes from multiple data sources. Work with AWS data engineering and cloud processing services . Process structured, semi-structured, and unstructured data including JSON, logs, PDFs, and other file formats . Develop complex and optimized SQL queries for data processing and analysis.