Data Platform Architect
TaskUs
IndiaremotePosted 24 days ago
Skill Required
Data-Platform-ArchitectureData-EngineeringCloud-Data-ArchitectureLakehouse-ArchitectureSolutions-ArchitectData-Platform-ArchitectData-Infrastructure-ArchitectData-ArchitectPlatform-Architectdata engineeringAirflowEngineeringDatabricksServerlessKubernetesSnowflakedesigningRedshiftsecurityEmbedded CfintechSparkTestNGPythondesignAzureCI/CDUnityCloudjQuerydbtSQLAWSGCPFulltime
Key highlights
- Competitive industry salaries
- 8+ years of Data Engineering / Architecture experience
- Remote work availability
- Expert-level knowledge of Databricks Lakehouse and high‑performance warehouses (Snowflake/Redshift)
- High‑efficiency compute familiarity with DuckDB
- Leadership in data governance and compliance
Role overview
The Data Platform Architect at TaskUs is the lead designer and technical authority for the company’s modern data ecosystem. The role focuses on ensuring the platform delivers high performance, cost‑efficiency, and security while evolving with business needs. It is a design‑and‑direction position that sets standards, reviews engineering output, and serves as the bridge between complex technical systems and business value.
Responsibilities
- Lead architectural decisions regarding compute engine selection, open-table format implementation, and tiered storage design.
- Architect a decoupled data environment that ensures interoperability across multiple engines and prevents proprietary vendor lock-in.
- Design and oversee the implementation of automated data governance, including PII discovery, row/column-level security, and auditability.
- Define the "Definition of Done" for data pipelines, establishing coding standards, CI/CD patterns, and technical documentation requirements.
- Maintain a version‑controlled repository of all consequential technical decisions (ADR), documenting rationale, trade‑offs, and long‑term implications.
- Monitor and optimize platform performance and spend, ensuring sub‑second query speeds for massive user bases while maintaining a lean cloud footprint.
- Conduct deep‑dive code and design reviews for all data models and orchestration workflows; mentor and unblock senior engineering staff.
- Perform technical stewardship of the data platform, ensuring adherence to standards and best practices.
Requirements
- 8+ Years in Data Engineering / Architecture: Proven experience delivering production‑grade Lakehouse environments for high‑concurrency (1,000+ user) organizations.
- Modern Data Stack Fluency: Extensive experience with Databricks (Lakehouse/Unity Catalog) and high‑performance warehouses like Amazon Redshift or Snowflake.
- Open-Table Formats: Deep hands‑on expertise with Apache Iceberg or Delta Lake, including optimization strategies for partitioning and schema evolution.
- Transformation & Modeling: Mastery of dbt (Core) for complex SQL‑based modeling and PySpark or Python for sophisticated data processing.
- High‑Efficiency Compute: Familiarity with vectorized/embedded engines like DuckDB for specialized or cost‑sensitive processing tasks.
- Orchestration Mastery: Advanced experience with Apache Airflow, specifically in designing resilient, dependency‑aware DAGs in resource‑constrained environments.
- Cloud Ecosystems: Expert‑level knowledge of AWS (S3, EC2, IAM) or equivalent services in Azure/GCP, with a focus on storage‑compute separation.
- Experience with open‑source catalog implementations like Apache Polaris.
- Knowledge of Data Ops principles and automated data quality testing frameworks.
- Experience translating technical debt and architectural roadmaps for C‑level executives.
- Background in managing fixed‑resource infrastructure (e.g., EC2/VM‑based processing) vs. elastic serverless models.
- Kubernetes (K8s) deep understanding of Pods, Deployments, Services, ConfigMaps, and Secrets management.
Benefits
- Competitive industry salaries
- Comprehensive benefits packages
- People‑First culture with emphasis on well‑being
- Inclusive environment and positive community impact
- Internal mobility and professional growth opportunities
- Remote work option
Additional details
- About TaskUs: TaskUs is a provider of outsourced digital services and next‑generation customer experience to fast‑growing technology companies, helping its clients represent, protect and grow their brands.
- Leveraging a cloud‑based infrastructure, TaskUs serves clients in the fastest‑growing sectors, including social media, e-commerce, gaming, streaming media, food delivery, ride‑sharing, HiTech, FinTech, and HealthTech.
- The People First culture at TaskUs has enabled the company to expand its workforce to approximately 60,000 employees globally, with presence in twenty‑three locations across twelve countries, which include the Philippines, India, and the United States.
- TaskUs prioritizes its employees' well‑being by offering a People‑First culture reflected in various departments such as Total Rewards, Wellness, HR, and Diversity.
- TaskUs actively encourages internal mobility and professional growth at all stages of an employee's career.
- Work Mode: Remote
- TaskUs will not solicit money from applicants during the application process nor require any payment to proceed.
- DEI statement: TaskUs is committed to providing equal access to opportunities and welcoming applicants of different backgrounds, demographics, and circumstances.
- If you need reasonable accommodations in any part of the hiring process, please let us know.
- We invite you to explore all TaskUs career opportunities and apply through the provided URL.
- Originally posted on Himalayas