Applications Developer - ETL/Pyspark - Assistant Vice President
Citibank (Switzerland) AG
IndiaPosted 1 month ago
Skill Required
SparkETLdata engineeringEngineeringR Programmingand
Key highlights
- 8-10 years of relevant experience required
- Proficiency in PySpark and SQL required
- Design, develop, and maintain scalable data pipelines using PySpark, Talend, and Ab Initio
- Bachelor's degree/University degree or equivalent experience required
Role overview
We are seeking an enthusiastic, detail-oriented ETL Developer to join our data engineering team. In this role, you will be designing, developing, and maintaining scalable data pipelines using PySpark, Talend, and Ab Initio. You will work closely with senior developers to transform raw data into valuable business insights, ensuring optimal data quality and performance.
Responsibilities
- ETL Pipeline Development: Building and maintaining Extraction, Transformation, and Loading (ETL) workflows
- Big Data Processing: Utilize PySpark for data processing, manipulation, and analysis within big data ecosystems
- Data Extraction & Ingestion: Extract data from multiple sources including relational databases (SQL), flat files etc.
- Data Transformation: Create mapping documents and apply business logic to transform large datasets
- Performance Tuning: Assist in analyzing and optimizing existing ETL jobs and Spark scripts for better scalability and execution speed
- Testing & Documentation: Perform unit testing, validate data accuracy, and maintain technical documentation for all ETL processes
- Production Support: Help monitor scheduled daily/weekly jobs and troubleshoot data integration or quality issues
Requirements
- 8-10 years of relevant experience
- Experience in systems analysis and programming of software applications
- Programming Languages: Proficiency in PySpark and SQL
- Big Data Frameworks: Hands-on experience or strong conceptual understanding of PySpark
- ETL Tools: Familiarity with Data Integration/Big Data tools and Ab Initio components
- Scripting: Basic to intermediate knowledge of Unix/Linux Shell Scripting
- Databases: Understanding of Big Data (Hadoop) & RDBMS like Oracle, or PostgreSQL
- Ability to work under pressure and manage deadlines or unexpected changes in expectations or requirements
- Bachelor's degree/University degree or equivalent experience
Additional details
- This job description provides a high-level review of the types of work performed. Other job-related duties may be assigned as required.
- Time Type: Most Relevant Skills
- Other Relevant Skills
- Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law.
- If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review Accessibility at Citi.
- View Citi's EEO Policy Statement and the Know Your Rights poster.
- Originally posted on Himalayas