Azure Data Engineer
Proarch Technology Services
Hyderabad, Telangana, IndiaPosted 10 days ago
P
Skill Required
IT JobsData EngineerAzureCD pipelinesautomationanalyticsPythondesignSparkCI/CDSQLandCICD
Role overview
Design, develop, and optimize data pipelines using Azure Synapse Analytics, Spark Pools, and Azure Data Factory. Write efficient Python and SQL code with a focus on scalability, performance, and optimization. Manage Azure Data Lake for structured and unstructured data ingestion at scale (volume, variety, velocity). Implement CI/CD pipelines and follow Data Ops practices for automation and reliability. Optimize data partitioning, versioning, and storage/compute costs for large-scale workloads.