Posted today · be early
Data Architect Internship
Metasys
WorldwideremotePosted 1 day ago
Skill Required
Data-ArchitectData-EngineerAnalytics-EngineerData-Governance-SpecialistBusiness-Intelligence-DeveloperGenerative AIQuery OptimizationData WarehousingEngineeringR ProgrammingPostgreSQLanalyticalautomationdesigninganalyticssecurityPythondesignRedisRAGETLSQLandAIInternship
Key highlights
- Stipend: None initially
- Duration: 3 months
- Location: Remote
- Mandatory GDPR experience
- Potential for paid FTE conversion
Role overview
The Data Architect is responsible for designing and governing the end-to-end data landscape of our integrated supply chain e-commerce platform. You will create comprehensive data models, establish robust ETL pipelines to unify data from core systems (MES, WMS, OMS), and architect the infrastructure for real-time analytics, ensuring strict compliance with data privacy regulations like GDPR.
Responsibilities
- Transform raw system data into a structured asset, supporting both operational efficiency and business intelligence.
- Design and maintain comprehensive conceptual, logical, and physical data models for all data domains: e-commerce transactions, customer behavior, internal tool usage, and supply chain records.
- Architect and implement scalable ETL/ELT pipelines to efficiently aggregate, transform, and load data from disparate sources, including PostgreSQL 15 (MES, WMS, OMS modules) and internal applications.
- Define and enforce data governance policies, focusing heavily on GDPR compliance, data privacy, access control, and data quality standards.
- Design and implement the infrastructure for real-time analytics and business intelligence, ensuring data is readily available and optimized for consumption by reporting tools and the Analytics/BI module.
- Define and plan data retention, archiving, and purging strategies, ensuring long-term data management efficiency and compliance.
- Collaborate with SRE and development teams to optimize database schemas and queries for both high transactional throughput and analytical reporting performance.
- Structure the data assets required to power and train our AI layer.
- Architect the data flow and preparation layer that provides clean, contextually relevant data for LLM fine-tuning, prompt engineering, and Retrieval Augmented Generation (RAG) processes.
- Design models to capture and track AI agent interactions and outcomes for auditing, performance analysis, and continuous improvement of the multi-agent system.
Requirements
- Expert proficiency in PostgreSQL 15 (schema design, performance tuning, RLS principles) and caching technologies (Redis).
- Proven experience designing and implementing scalable data pipelines and data warehouse structures.
- Proficiency in scripting for data transformation and pipeline automation (e.g., Python, SQL).
- Mandatory experience implementing controls for GDPR and other data privacy regulations.
Nice to have
- Familiarity with data usage in Meilisearch and object storage systems (MinIO).
Benefits
- Based on your first-quarter performance, you may be offered a paid full-time opportunity, or even be absorbed directly by the client as an FTE.
Additional details
- Duration: 3 months
- Start Date: Immediate
- Location: Remote
- Stipend: None initially.
- Performance will be measured by Data Accuracy/Quality (Measurable improvement in the quality, consistency, and reliability of data used for analytics), Pipeline Efficiency (Speed, stability, and latency of ETL pipelines supporting real-time analytics requirements), and Compliance Audit (Successful implementation and auditing of data governance and GDPR policies).
- Mentorship Structure: Reports to the Solution Architect or Head of Technology, working closely with the Analytics/BI, Security, and Core Module development teams.
- Originally posted on Himalayas
