Data Engineering - Senior / Lead Engineer
Paytm
Noida, Uttar Pradesh, IndiaPosted 5 months ago
Skill Required
TechnologyData EngineerEngineeringR ProgrammingCassandradebuggingHadoopSparkPythondesignScalaKafkaFlinkRedisCloudJavaHiveShell ScriptingSQLAWS
Key highlights
- 4 to 8 years of experience required in Big Data technologies
- Enviable 500 mn+ registered users and 21 mn+ merchants in ecosystem
- India's largest digital lending story
- Strong hands-on experience with Hadoop, Spark, PySpark, MapReduce, Hive required
- Opportunity to be part of India's leading digital payments and financial services company
- Work with petabytes of data daily
Role overview
Paytm, India's leading digital payments and financial services company, is seeking a Data Engineering Technical Lead to work on complex technical projects in an innovative and fast-paced environment. The role requires a strong product design sense and specialization in Hadoop and Spark technologies, focusing on growing analytics capabilities and handling petabytes of data daily.
Responsibilities
- Grow our analytics capabilities with faster, more reliable tools, handling petabytes of data every day.
- Brainstorm and create new platforms that can help in our quest to make available to cluster users in all shapes and forms, with low latency and horizontal scalability.
- Make changes to our diagnosing any problems across the entire technical stack.
- Design and develop a real-time events pipeline for Data ingestion for real-time dashboarding.
- Develop complex and efficient functions to transform raw data sources into powerful, reliable components of our data lake.
- Design & implement new components and various emerging technologies in Hadoop Eco-System, and successful execution of various projects.
- Be a brand ambassador for Paytm – Stay Hungry, Stay Humble, Stay Relevant!
- Work closely with peers in an innovative and fast-paced environment on complex technical projects.
Requirements
- 4 to 8 years of experience in Big Data technologies.
- Strong hands-on experience with Hadoop, MapReduce, Hive, Spark, PySpark etc.
- Excellent programming/debugging skills in Python/Java/Scala.
- Experience with any scripting language such as Python, Bash etc.
- Hands-on programming experience with multithreaded applications.
- Strong product design sense.
- Specialization in Hadoop and Spark technologies.
Nice to have
- Good to have experience of working with noSQL databases like Hbase, Cassandra.
- Good to have experience in Database, SQL, messaging queues like Kafka.
- Good to have experience in developing streaming applications e.g. Spark Streaming, Flink, Storm, etc.
- Good to have experience with AWS and cloud technologies such as S3.
- Experience with caching architectures like Redis etc.
Benefits
- Opportunity to make a difference and have a great time doing that.
- Challenged and encouraged to do work that is meaningful for you and for those served.
- Opportunity to work with a company that thinks seriously about what technology can do for people.
- Opportunity to be a part of India's largest digital lending story.
- Access to a unique position to democratize credit for deserving consumers & merchants.
Additional details
- Paytm is India's leading digital payments and financial services company, focused on driving consumers and merchants to its platform by offering a variety of payment use cases.
- To merchants, Paytm offers acquiring devices like Soundbox, EDC, QR and Payment Gateway where payment aggregation is done through PPI and also other banks' financial instruments.
- To further enhance merchants' business, Paytm offers merchants commerce services through advertising and Paytm Mini app store.
- Operating on this platform leverage, the company then offers credit services such as merchant loans, personal loans and BNPL, sourced by its financial partners.
- The company is successful, and successes are rooted in the collective energy and unwavering focus on the customer.