What are watermarks in stream processing, and how do they help handle out-of-order and late-arriving data?

Sample answer preview

Watermarks are a mechanism that stream processing engines use to track the progress of event time and determine when it is safe to close windows and emit results. They solve one of the hardest problems in streaming: handling events that arrive out of order or late.