We are looking for a skilled Data Engineer to design, build, and optimize scalable data pipelines and modern data platforms. The ideal candidate should have strong expertise in Apache Spark, SQL, and Databricks, with experience handling large-scale data processing, ETL development, and cloud-based data engineering solutions.
Responsibilities
- Design, develop, and maintain scalable ETL/ELT data pipelines.
- Build and optimize data processing workflows using Apache Spark.
- Develop and manage data solutions on Databricks.
- Write efficient SQL queries for data extraction, transformation, and analysis.
- Integrate data from multiple structured and unstructured sources.
- Optimize data models, storage, and pipeline performance.
- Ensure high data quality, integrity, and security across platforms.
- Collaborate with Data Scientists, Analysts, and Software Engineers.
- Troubleshoot production issues and improve system reliability.
- Participate in architecture discussions and implement best engineering practices.
Requirements
- Strong experience with Apache Spark
- Advanced SQL programming
- Hands-on experience with Databricks
- ETL/ELT pipeline development
- Data Warehousing concepts
- Experience with cloud platforms (AWS, Azure, or GCP)
- Git and CI/CD fundamentals
- Data Lake and Delta Lake concepts
- Performance tuning and query optimization
Nice to have
- Python or Scala (preferred)
- Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, or a related field.
- Experience working with large-scale distributed data processing.
- Knowledge of Airflow, Kafka, Snowflake, or Azure Data Factory is an added advantage.
- Familiarity with Agile/Scrum development methodologies.
Benefits
- Competitive salary of ₹12–45 LPA
- Opportunity to work on enterprise-scale data platforms
- Exposure to modern cloud and big data technologies
- Learning and certification support
- Collaborative and innovative work environment
- Career growth opportunities with leading organizations
Additional details
- Job Title: Data Engineer
- Experience: 2–10 Years
- Employment Type: Full-Time
- Location: Bangalore / Mumbai / Gurgaon
- Hiring Process: Resume Screening, Technical Assessment, Technical Interview(s), Managerial Discussion, HR Interview, Offer & Onboarding