Revisiting Splittable DoFn in KafkaIO


Speaker(s):
Steven van Rossum

Revisiting Splittable DoFn in KafkaIO

By Steven van Rossum
Jul-9 15:00-15:50 in Palisades
Add to Calendar 07/09/2025 3:00 PM 07/09/2025 3:50 PM BS25: Revisiting Splittable DoFn in KafkaIO

SDF and IO are tricky subjects, doubly so for SDF IO. This session dives deeper into the SDF read transform in KafkaIO and will highlight a few crucial performance issues that have been addressed in recent releases of Apache Beam. The session is aimed at IO contributors with the goal to emphasize the subtle nuances in SDF and IO code that can make or break performance.

Palisades

SDF and IO are tricky subjects, doubly so for SDF IO. This session dives deeper into the SDF read transform in KafkaIO and will highlight a few crucial performance issues that have been addressed in recent releases of Apache Beam. The session is aimed at IO contributors with the goal to emphasize the subtle nuances in SDF and IO code that can make or break performance.