Pentaho ETL Pipeline
Multi-source ETL into dimension tables with Pentaho, loaded to ClickHouse.
Architecture
Multi-source ETL in Pentaho — incremental load, merge, and dimensional modeling — landing in ClickHouse.
Scheduling
Infrastructure
Overview
A multi-source ETL pipeline built with Pentaho that consolidates data from MySQL, Oracle, SQL Server, PostgreSQL, and MongoDB.
Pentaho builds the dimension tables and loads the modeled data into ClickHouse for analytics.
Highlights
- Five sources: MySQL, Oracle, SQL Server, PostgreSQL, MongoDB
- Dimensional modeling in Pentaho
- ClickHouse as the analytics destination
Tech stack
More projects
View all →SMILE Platform (UNDP for Kemenkes)
National immunization logistics system in production across all of Indonesia — streaming CDC + batch analytics platform.
LidValid — Unified Data Validation Platform
Full-stack data validation platform with Tiered Validation — cheap aggregate checks across every table, then precise row-level checks only where they fail.
Dataklin — AI-Powered Data Quality & Entity Resolution
Data quality and entity-resolution platform that profiles, validates, deduplicates, and standardizes datasets before handoff — with LLM-generated rules.