All work
10Data Engineering

Real-Time Fraud Detection

End-to-end real-time fraud detection pipeline: Flask UI → RabbitMQ → Kafka → Flink → ClickHouse → Grafana.

Architecture

Real-time fraud detection: transactions flow from a UI through a streaming fraud engine into an analytics store and live dashboard.

Flask UITransaction form
RabbitMQMessage queue
Apache KafkaEvent streaming
Apache FlinkFraud engine
ClickHousevia Kafka Connect
GrafanaLive dashboard

Integration

Java ConsumerKafka Connect

Infrastructure

Docker

Overview

A real-time fraud detection pipeline that scores transactions as they happen and surfaces results on a live dashboard.

Transactions enter through a Flask UI, are queued via RabbitMQ, streamed through Kafka, processed and scored in Apache Flink, then stored in ClickHouse and visualized in Grafana — a complete streaming architecture from ingestion to insight.

Highlights

  • Full streaming path: Flask → RabbitMQ → Kafka → Flink → ClickHouse → Grafana
  • Real-time transaction scoring with low-latency processing in Flink
  • Live monitoring dashboards in Grafana

Tech stack

FlaskRabbitMQKafkaApache FlinkClickHouseGrafana