Speaker(s):

Understanding exactly-once processing and windowing in streaming pipelines

Aug-25 17:40-18:00
Add to Calendar 08/25/2020 5:40 PM 08/25/2020 6:00 PM America/Los_Angeles AS24: Understanding exactly-once processing and windowing in streaming pipelines

In this session, we will explore different windowing strategies, and the impact on dropping (or not) late data. We will use a unit test with a synthetic stream, and then we will apply different windows and will make a grouping calculation (aggregation) to check how different windows group data in different ways, and how the parameters of the windows affect how data is grouped in windows.


In this session, we will explore different windowing strategies, and the impact on dropping (or not) late data. We will use a unit test with a synthetic stream, and then we will apply different windows and will make a grouping calculation (aggregation) to check how different windows group data in different ways, and how the parameters of the windows affect how data is grouped in windows.