Skip to content
Abdelkarim Ain
Menu

Projects

data engineering · in progress · 2026

Streaming Anomaly Platform

A replayable streaming pipeline that detects unusual behavior in high-volume event data and explains each alert.

Year
2026
Status
wip
Role
Sole developer
  • Python
  • Kafka
  • Apache Spark
  • PostgreSQL
  • FastAPI
  • Astro
  • Docker

Project brief

Replace this brief with the real domain, dataset, and motivation once the project exists.

Problem

What high-volume event stream needs faster or more trustworthy anomaly detection?

System design

Document ingestion, schema validation, windowed features, storage, model serving, alert delivery, and the dashboard that makes the result understandable.

Evaluation

Add throughput, end-to-end latency, precision/recall, false-positive analysis, and a comparison with a simple baseline.

Engineering notes

Explain how the system handles late events, malformed records, replay, monitoring, and local development.

Comments

Signed in with GitHub. Discussion is stored as a GitHub issue.