Batch vs Streaming

Batch Processing: Data is collected over some time and processed all at once. It's great when dealing with large volumes of data that don't need immediate processing.

Consider analyzing sales data at the end of each day, week, or month.

Stream Processing: Instead of waiting to accumulate, data is processed immediately as it comes in. It's used for tasks that need real-time processing, like monitoring stock prices or social media feeds.

Another example: Credit card alerts

Redis Pub/Sub is one of the techniques. However, the problem is that the data is not persistent and cannot be played back.