How do you approach unifying batch and streaming data processing within a single architecture? What are the trade-offs between Lambda and Kappa architectures?

Sample answer preview

Unifying batch and streaming processing is one of the most important architectural decisions for modern data platforms. The goal is to provide consistent, timely data to consumers without maintaining two completely separate codebases and infrastructure stacks.