Kafka Streams lets you process data in real-time directly within Kafka. No separate cluster needed.
flowchart LR
IN[Input Topic] --> KS[Kafka Streams App]
KS --> |filter| F[Filtered]
KS --> |aggregate| A[Aggregated]
KS --> |join| J[Joined]
F --> OUT1[Output Topic 1]
A --> OUT2[Output Topic 2]
J --> OUT3[Output Topic 3]
style KS fill:#E8F5E9,stroke:#2E7D32,stroke-width:2px
style IN fill:#FFF3E0,stroke:#E65100
style OUT1 fill:#E3F2FD,stroke:#1565C0
style OUT2 fill:#E3F2FD,stroke:#1565C0
style OUT3 fill:#E3F2FD,stroke:#1565C0
Key Concepts
- KStream: Unbounded stream of records
- KTable: Changelog stream (latest value per key)
- GlobalKTable: Replicated across all instances
References
Discover more from C4: Container, Code, Cloud & Context
Subscribe to get the latest posts sent to your email.