Data Engineer
VMC Soft Technologies, Inc
Role tags
Tech stack mentioned
Role overview
Formatting this description...
Role Descriptions: RGS raised for upskilling associate in data engineer- Python| pyspark| databrick Location : Pune Exp: 6 to 8 Job Description mandatory Sr.No Required Information Details 1 Role** Data Engineer 2 Required Technical Skill Set** Python, Databricks, DeltaLake,MongoDB, Sympy, UnityCatalog,SQL,Pandas,GithubAction 4 Desired Experience Range** 6+ Years 5 Location of Requirement Bangalore / Pune Desired Competencies (Technical/Behavioral Competency) Must-Have** (Ideally should not be more than 3-5) - Design, build, and maintain data transformation pipelines using AWS services (Lambda Functions, Step Functions .. ) in Python. - Mana effeciently large dataset. - Mana SQL database - Postgresql. - NoSQ MongoDB - Implent and maintain complex data calculation formula. - Openo collaborate with Software Engineers. - Partipate in code reviews, design discussions, and software planning. - Contbute to automation, testing, and deployment processes.- Good-to-Have - AWS Certification SN Responsibility of / Expectations from the Role 1 Design, build, and maintain data transformation pipelines using Python and Databricks. Implement and maintain complex calculation engine. 2 Open to collaborate with Frontend Engineers. 3 Participate in code reviews, design business discussions and software planning. 4 Contribute to automation, testing, and deployment processes. 5 Design, build, and maintain data transformation pipelines using PySpark and Databricks. Implement and maintain complex calculation engine. 6 Open to collaborate with Frontend Engineers. 7 Participate in code reviews, design business discussions and software planning. 8 Contribute to automation, testing, and deployment processes. Show more