Flink Streaming Pipeline + Dashboard
Real-time sales streaming pipeline: Kafka → Flink ETL → ClickHouse → Grafana dashboard.
Architecture
Real-time sales pipeline: Kafka → Flink streaming ETL → ClickHouse → Grafana dashboard.
Ingestion
Infrastructure
Overview
A real-time streaming pipeline for sales data that flows from Kafka through Apache Flink for streaming ETL, into ClickHouse for fast analytical storage, and out to a Grafana dashboard.
It demonstrates a clean, focused streaming architecture — from ingestion to a live, queryable dashboard.
Highlights
- Streaming ETL in Apache Flink
- ClickHouse for sub-second analytical queries
- Live Grafana dashboard
Tech stack
More projects
View all →SMILE Platform (UNDP for Kemenkes)
National immunization logistics system in production across all of Indonesia — streaming CDC + batch analytics platform.
LidValid — Unified Data Validation Platform
Full-stack data validation platform with Tiered Validation — cheap aggregate checks across every table, then precise row-level checks only where they fail.
Dataklin — AI-Powered Data Quality & Entity Resolution
Data quality and entity-resolution platform that profiles, validates, deduplicates, and standardizes datasets before handoff — with LLM-generated rules.