Stateful Stream Processing

Stateful stream processing retains information across events to calculate results that one event alone cannot determine. Examples include a running total, deduplication history, or the active state of a user session.

The state must have defined ownership, retention, and recovery behavior. Partitioning determines which worker maintains each key’s state, while checkpoints or changelogs can help restore it after a crash or a reassignment of processing work.