Posted today · be early
Data Engineer
EY
Pune City, Maharashtra, IndiaPosted 1 day ago
Skill Required
FulltimeData EngineerData WarehousingKafkaDatabricksSharePointPower BIMongoDBSparkAzureUnityAgileSQL
Key highlights
- 4‑8 years of big‑data architecture experience required.
- Strong SQL and PySpark hands‑on expertise required.
- Experience with Azure Data Factory, Azure Synapse, ADLS, and Databricks is essential.
- Inclusive global culture and access to cutting‑edge technology offered as benefits.
- Minimum 4 years industry experience and at least 3 years hands‑on technical experience.
Role overview
Data Engineer with experience in Azure ADF, Databricks, PySpark, SQL and Power Bi, joining EY to build a career with global scale, inclusive culture, and advanced technology.
Responsibilities
- Responsible for implementing secure, scalable, and highly available cloud-based solutions on Azure Cloud Analytics.
- Collaborate with internal and external stakeholders to understand their business requirements and translate them into technical solutions.
- Identify and implement automation opportunities to increase operational efficiency.
- Conduct knowledge sharing and training sessions to educate clients and internal teams on cloud technologies.
- Interact and collaborate with various teams (web Development/ MS Apps / API Development etc.) to deliver the products.
- Work very closely with Data Architects/Technical Managers in agile environment to identify and understand the problem statements and develop/prototype the solutions accordingly.
- Should be able to work as an individual contributor.
- Participate in all aspects of Big Data solution delivery life cycle including analysis, design, development, testing, production deployment, and support.
Requirements
- 4‑8 years of experience in architecting big data solutions with a proven track record in driving business success.
- Strong SQL expertise with hands‑on experience.
- Strong PySpark expertise with hands‑on experience.
- Hands‑on experience with Azure Data Factory, Azure Synapse pipelines, and Azure Data Lake Storage (ADLS) for integration of ERP, application DBs, cloud systems, and SharePoint sources.
- Hands‑on experience with Databricks and ability to demonstrate Databricks use cases.
- Understanding of data modelling concepts and ability to demonstrate various data modelling mechanisms.
- Experience converting business problems/challenges to technical solutions considering security, performance, and scalability.
- Minimum 3 years of hands‑on experience in one or more of the above areas.
- Minimum 4 years of industry experience.
- Strong verbal and written communication skills (formal and informal).
- Ability to multi‑task under pressure and work independently with minimal supervision.
- Must be a team player and enjoy working in a cooperative and collaborative team environment.
- Adaptable to new technologies and standards.
- Flexible and proactive/self‑motivated working style with strong personal ownership of problem resolution.
Nice to have
- Good understanding of Unity Catalog and Delta Lake concepts.
- Exposure to Azure AI Fundamentals.
- Experience with BI and data analytics databases.
- Exposure to NoSQL technologies such as MongoDB or similar.
- Experience with real‑time data ingestion from live sources using Apache Kafka, Spark Streaming, Event Hub, and related technologies.
- Exposure to Power Bi or similar reporting tools and ability to work with the Power Bi team to achieve end goals.
Benefits
- Global scale and support within a leading professional services firm.
- Inclusive culture that values diverse perspectives.
- Access to advanced technology and continuous learning opportunities.
- Opportunity to build a unique career path aligned with personal strengths.
- Being part of EY’s mission to build a better working world across multiple service lines.
Additional details
- EY exists to build a better working world, helping to create long-term value for clients, people and society and build trust in the capital markets.
- Enabled by data and technology, diverse EY teams in over 150 countries provide trust through assurance and help clients grow, transform and operate.
- Working across assurance, consulting, law, strategy, tax and transactions, EY teams ask better questions to find new answers for the complex issues facing our world today.