Data Architect Internship

The Data Architect is responsible for designing and governing the end-to-end data landscape of our integrated supply chain e-commerce platform. You will create comprehensive data models, establish robust ETL pipelines to unify data from core systems (MES, WMS, OMS), and architect the infrastructure for real-time analytics, ensuring strict compliance with data privacy regulations like GDPR.

Duration: 3 months

Stipend: None initially. Based on your first-quarter performance, you may be offered a paid full-time opportunity, or even be absorbed directly by the client as an FTE.

You will transform raw system data into a structured asset, supporting both operational efficiency and business intelligence.

• Data Modeling & Design: Design and maintain comprehensive conceptual, logical, and physical data models for all data domains: e-commerce transactions, customer behavior, internal tool usage, and supply chain records.

• Data Integration (ETL): Architect and implement scalable ETL/ELT pipelines to efficiently aggregate, transform, and load data from disparate sources, including PostgreSQL 15 (MES, WMS, OMS modules) and internal applications.

• Data Governance & Compliance: Define and enforce data governance policies, focusing heavily on GDPR compliance, data privacy, access control, and data quality standards.

• Analytics Infrastructure: Design and implement the infrastructure for real-time analytics and business intelligence, ensuring data is readily available and optimized for consumption by reporting tools and the Analytics/BI module.

• Retention & Archival: Define and plan data retention, archiving, and purging strategies, ensuring long-term data management efficiency and compliance.

• Database Optimization: Collaborate with SRE and development teams to optimize database schemas and queries for both high transactional throughput and analytical reporting performance.

Candidates must possess deep experience in data modeling, integration, and governance across diverse systems:

• Database Mastery: Expert proficiency in PostgreSQL 15 (schema design, performance tuning, RLS principles) and caching technologies (Redis).

• Data Warehousing/ETL: Proven experience designing and implementing scalable data pipelines and data warehouse structures.

• Programming/Scripting: Proficiency in scripting for data transformation and pipeline automation (e.g., Python, SQL).

• Compliance: Mandatory experience implementing controls for GDPR and other data privacy regulations.

• Search/Storage: Familiarity with data usage in Meilisearch and object storage systems (MinIO).

You will structure the data assets required to power and train our AI layer.

• Data for LLMs: Architect the data flow and preparation layer that provides clean, contextually relevant data for LLM fine-tuning, prompt engineering, and Retrieval Augmented Generation (RAG) processes.

• Interaction Modeling: Design models to capture and track AI agent interactions and outcomes for auditing, performance analysis, and continuous improvement of the multi-agent system.

• Data Accuracy/Quality: Measurable improvement in the quality, consistency, and reliability of data used for analytics.

• Pipeline Efficiency: Speed, stability, and latency of ETL pipelines supporting real-time analytics requirements.

• Compliance Audit: Successful implementation and auditing of data governance and GDPR policies.

Mentorship Structure: Reports to the Solution Architect or Head of Technology, working closely with the Analytics/BI, Security, and Core Module development teams.

Originally posted on Himalayas