🌊 Data Pipeline Choreography

Build data pipelines and watch data flow like water

Component Library

Data Sources

📡
IoT Sensors
source
🌐
REST API
source
📊
Database CDC
source

Stream Processing

⚡
Kafka
streaming
🌊
Apache Flink
streaming
🔄
Transformation
processing

Storage

🏞️
Data Lake
storage
🏛️
Data Warehouse
storage
⚡
Redis Cache
storage

Analytics

📈
Analytics Engine
analytics
🤖
ML Model
analytics
📊
Dashboard
analytics
🌊

Build Your First Pipeline

✨ Drag components from the left sidebar onto this canvas

🔗 Connect nodes by dragging from one edge to another

▶️ Click "Run Pipeline" to see water flowing

🌊 Watch animations - thicker streams = higher throughput

💙 Blue water = clean data, brown = quality issues

React Flow

🎯 Challenge Progress

Add data source
Add streaming platform (Kafka)
Add transformation step
Add storage layer
Connect analytics engine

💡 Tips

  • Drag components from left sidebar
  • Connect nodes by dragging edges
  • Thicker connections = higher throughput
  • Blue streams = clean data quality
  • Brown streams = data quality issues
  • Click Run to see animated flow