Associate Data Engineer
TaskUs
IndiaremotePosted 1 month ago
Skill Required
Associate-Data-EngineerData-EngineeringETL-DevelopmentData-Warehouse-EngineeringCloud-Data-EngineeringData-Engineering-AssociateJunior-Data-EngineerData-EngineerData EngineerBusiness AnalysisData Warehousingdata engineeringKafkaInformaticaEngineeringautomationdevelopingObservabilitySnowflakedesigninganalyticsRedshiftAirflowfintechTestNGPythondesignSparkCloudUnityETLAWSGCPandFulltime
Key highlights
- Work from Home / Fully Remote setup
- At least 2 years of experience in Data Engineering required
- Competitive industry salaries and comprehensive benefits packages
- 3 years of cloud-based analytics development preferred (AWS or GCP)
- Internal mobility and professional growth encouraged at all career stages
- Bachelor's degree in CS/IT/Engineering or 4-8 years experience in lieu of degree
Role overview
TaskUs is seeking an Associate Data Engineer to design, develop, and maintain data pipelines and data warehouses that support its analytics infrastructure and Business Intelligence reporting methodology. The role involves configuring and deploying data integration and ETL solutions, managing data quality and optimization, and collaborating with technical users and business stakeholders across the enterprise.
Responsibilities
- Assist in making accurate and meaningful data available for consumption of TaskUs Business Intelligence reporting methodology
- Ensure all work meets enterprise data delivery, business analysis, and reporting needs
- Configure and set up solutions based on pre-approved patterns to move data from operational and external environments to the business intelligence environment
- Manage data integration and ETL jobs including consolidation, aggregation, filtering, validation, data quality routines, and dimension creation
- Configure and deploy automation of jobs based on pre-approved and reusable patterns framework; execute production-level jobs considering data dependencies, schedules, validation routines, and data stream updates
- Design, develop, and verify the data model according to business requirements and continuously optimize the model
- Collaborate with technical users to define data requirements and establish business rules to be applied
- Collaborate with key business stakeholders to deliver and continually enhance the BI platform to provide relevant and accurate insights through the delivery of new datasets
- Validate and verify the data model according to business requirements and continuously optimize the model
- Perform unit and system integration testing on development projects
- Undertake peer reviews, assist with testing, and ensure documentation is current
- Monitor Error Handling and Logging tools and processes; troubleshoot configuration and data errors
- Monitor performance and raise appropriate flags
- Identify opportunities to optimize the ETL environment, and implement monitoring, quality, and validation processes to ensure data accuracy and integrity
Requirements
- At least 2 years of experience in Data Engineering
- Knowledgeable with Python, Apache Kafka, AWS Redshift, AWS Glue, AWS S3, and Pentaho Data Integration
- Strong knowledge of Data Warehousing concepts with understanding of traditional and MPP database designs, star and snowflake schemas with at least 2 years of data modeling
- At least 2 years of hands-on development experience using ETL Tools such as Pentaho, SSIS, Informatica, Talend, Fivetran or Airflow
- Knowledge on the architecture, design and implementation of MPP Databases such as Teradata, Snowflake or Redshift
- 3-year development using Cloud-based analytics solutions preferable AWS or GCP
- Knowledge of designing and implementing streaming pipelines using Apache Kafka, Apache Spark, or Segment
- Knowledgeable in Database Tuning and ETL tuning
- Ability to work effectively across internal functional areas in ambiguous situations
- Structured thinker and effective communicator
- Bachelor's/College Degree in Computer Science/Information Technology, Engineering (Computer/Telecommunication) or 4-8 years experience in place of a degree
Nice to have
- Experience of using Python in a cloud-based environment is preferred
- Knowledge on NoSQL DBs is preferred
- Knowledge, experience and exposure to AI tools is preferred but not required
Benefits
- Competitive industry salaries and comprehensive benefits packages
- Work from Home / Remote setup
- Inclusive and positive work environment
- Internal mobility and professional growth encouraged at all stages of an employee's career
- Departments dedicated to Total Rewards, Wellness, HR, and Diversity
Additional details
- TaskUs is a provider of outsourced digital services and next-generation customer experience to fast-growing technology companies
- TaskUs serves clients in social media, e-commerce, gaming, streaming media, food delivery, ride-sharing, HiTech, FinTech, and HealthTech
- TaskUs has approximately 60,000 employees globally across twenty-three locations in twelve countries including the Philippines, India, and the United States
- TaskUs operates under a 'People First' culture
- Site Location: Any TaskUs IND Site (Remote)
- Work Setup: Work from Home
- TaskUs will neither solicit money from applicants during the application process nor require any form of payment to proceed with an application
- DEI: TaskUs welcomes applicants of different backgrounds, demographics, and circumstances and is committed to providing equal access to opportunities; reasonable accommodations are available upon request
- Originally posted on Himalayas