Speaker(s):

How the sausage gets made: Dataflow under the covers

Jul-18 14:00-14:50 in 203
Add to Calendar 07/18/2022 2:00 PM 07/18/2022 2:50 PM America/Los_Angeles AS24: How the sausage gets made: Dataflow under the covers

The team that builds the Dataflow runner likes to say it “just works”. But how does it really work? How does it decide to autoscale? What happens on failures? Where is state data stored? Can I have infinite state data? What goes into Dataflow’s latency? What’s the checkpoint logic?

These and other questions to be answered in this session!

203

The team that builds the Dataflow runner likes to say it “just works”. But how does it really work? How does it decide to autoscale? What happens on failures? Where is state data stored? Can I have infinite state data? What goes into Dataflow’s latency? What’s the checkpoint logic?

These and other questions to be answered in this session!