Splittable DoFns in Python: a hands-on workshop

Jul-20 12:30-15:00 in 202
Add to Calendar 07/20/2022 12:30 PM 07/20/2022 3:00 PM America/Los_Angeles AS24: Splittable DoFns in Python: a hands-on workshop

In this workshop we will review the concept of Splittable DoFns and we will write two I/O connectors using this kind of DoFns: one in batch (for reading large files in a given format), and one for streaming (for reading from Kafka topics). We will run some examples on Google Cloud Dataflow after implementing these connectors from scratch during the workshop. All the code will be written in Python.

202

In this workshop we will review the concept of Splittable DoFns and we will write two I/O connectors using this kind of DoFns: one in batch (for reading large files in a given format), and one for streaming (for reading from Kafka topics). We will run some examples on Google Cloud Dataflow after implementing these connectors from scratch during the workshop. All the code will be written in Python.