Data Engineer
Building reliable
data platforms
I build reliable, large-scale data platforms — streaming and batch pipelines that move data from source to insight.
I'm Raffi Ainul Afif — a Data Engineer currently at Badr-Interactive, based in Indonesia.
Flagship Project · Live Architecture
SMILE Platform (UNDP for Kemenkes)
National immunization logistics system in production across all of Indonesia — streaming CDC + batch analytics platform.
Architecture
Real-time CDC streaming from the OLTP database into ClickHouse, then batch pipelines build the analytics gold layer.
Orchestration
Infrastructure
Monitoring
About
Who I am
I'm a Data Engineer with a background in Data Science, Data Analysis, and Data Cleaning. I design and build end-to-end data platforms: real-time streaming pipelines, batch ETL, data warehousing, and the analytics layers on top.
My flagship work is the SMILE Platform — a national immunization logistics system running in production across every health facility in Indonesia, from Sabang to Merauke. I built its streaming pipeline (CDC → Kafka → ClickHouse) and the batch/gold-layer analytics with dbt, all orchestrated on Kubernetes.
I started in data science and analysis — CNNs, time-series forecasting, EDA on real datasets — which means I build pipelines with the end consumer of the data always in mind. I write production-quality code and I'm continually expanding into full application development.
- Currently
- Data Engineer
- @ Badr-Interactive
- Education
- Bachelor of Computer Science
- University Muhammadiyah Malang
- 2018 – 2022
- Location
- Indonesia
Experience
Where I've worked
From data entry to building national-scale streaming platforms — a path through data engineering, science, and analysis.
Data Engineer
·Badr-InteractiveCurrentOct 2025 – Present
Contract · Depok, Indonesia
Technology company delivering digital solutions for government and enterprise clients.
- Part of the SMILE platform — a national immunization logistics system owned by Kemenkes, in production across all health facilities in Indonesia — built with UNDP and cross-functional teams.
- Built the streaming pipeline on the OLTP side: AWS RDS MySQL → Debezium (CDC) → Kafka → RisingWave (streaming ETL) → Amazon S3 → ClickHouse.
- Built batch pipelines on the ClickHouse side for the gold layer, with analytics modeled in dbt.
- Orchestrated workflows with Jenkins and Dagster; entire environment runs on Kubernetes and is monitored with Grafana.
- Maintain the Kubernetes cluster and ensure data reliability, consistency, and readiness for downstream analytics.
AWS RDSDebeziumApache KafkaRisingWaveAmazon S3ClickHousedbtJenkinsDagsterKubernetesGrafanaData Engineer
·XeraticNov 2023 – Feb 2025
Full-time · Tangerang, Indonesia
A company founded in the IT sector, specifically focused on data.
- Built end-to-end ETL workflows with Python, Airflow, and SQL into a centralized data warehouse.
- Led data migration from AWS Athena to Alibaba MaxCompute — 300+ tables across warehouses and datamarts.
- Validated and refactored 300+ dashboards (Tableau & Metabase) for consistency, performance, and accuracy.
- Implemented Change Data Capture (CDC) with Debezium and Kafka to stream real-time data and reduce latency.
- Contributed to an OCR-based bank statement extraction system for one of Indonesia's largest banks, automating PDF ingestion.
- Enhanced streaming workflows with ksqlDB and Apache Flink to improve data freshness for analytics and reporting.
PythonApache AirflowSQLAWS AthenaAlibaba MaxComputeDebeziumKafkaksqlDBApache FlinkTableauMetabaseData Analyst / Data Scientist
·PT Telkom IndonesiaJun 2023 – Aug 2023
Internship · Jakarta, Indonesia
- Analyzed 10,000+ e-commerce transactions to uncover customer purchasing patterns.
- Built interactive Streamlit dashboards to streamline weekly reporting.
- Developed machine learning models to identify customer segments with 85%+ accuracy.
PythonStreamlitMachine LearningSQLData Scientist
·Home Credit IndonesiaMay 2023 – Jun 2023
Virtual Internship · Rakamin Academy · Jakarta, Indonesia
- Completed data scientist tasks: credit data analysis and visualization.
- Built credit-risk machine learning models.
PythonMachine LearningData Scientist
·ID/X PartnersFeb 2023 – Mar 2023
Virtual Internship · Rakamin Academy · Jakarta, Indonesia
- Conducted end-to-end analysis on financial credit data.
- Built ML models that reduced risk misclassification by 30%.
- Created dashboards supporting key stakeholder presentations.
PythonMachine LearningData Entry Intern
·Dinas Sosial Kabupaten MalangMay 2021 – Jun 2021
Internship · Malang, Indonesia
- Designed and implemented a CRUD system for KUBE, managing 1,000+ household records.
- Reduced manual data-entry time by 50% through process digitalization.
Skills
What I do
A data engineer's toolkit, grounded in a data science and analysis background.
Data Engineer
Streaming & batch pipelines, data warehousing, orchestration on Kubernetes.
Data Scientist
CNN image classification, time-series forecasting, predictive modeling.
Data Analyst
SQL analysis, EDA, dashboards that turn raw data into decisions.
Data Cleaning
Validation tooling, source-to-target reconciliation, quality checks.
Languages
Streaming & Messaging
Batch & Processing
Storage & Databases
Cloud & Infra
Data Science & Analysis
Selected Work
Featured projects
A few of the data platforms and pipelines I'm most proud of.
Tech Stack
Tools I work with
The technologies that show up across my projects — from ingestion to dashboards.
Contact
Let's build something with data.
Open to data engineering roles and freelance projects. The fastest way to reach me is email — I usually reply within a day.