Introduction to Beam YAML


Speaker(s):
Jeff Kinard

Introduction to Beam YAML

By Jeff Kinard
Sep-4 14:30-14:55 in Walker Canyon
Add to Calendar 09/04/2024 2:30 PM 09/04/2024 2:55 PM America/Los_Angeles AS24: Introduction to Beam YAML

The purpose of this session will be to introduce Beam YAML and its core capabilities. These include, but are not limited to:

  • Basic syntax for declaring pipeline spec and pipeline options
  • Mapping transforms and UDF’s
  • Simple aggregations
  • Other turnkey transforms (LogForTesting, IO’s, etc.)

The session will wrap up with some use-case examples and how to run the YAML pipelines on Google Cloud Dataflow.

 Walker Canyon

  Download slides

The purpose of this session will be to introduce Beam YAML and its core capabilities. These include, but are not limited to:

  • Basic syntax for declaring pipeline spec and pipeline options
  • Mapping transforms and UDF’s
  • Simple aggregations
  • Other turnkey transforms (LogForTesting, IO’s, etc.)

The session will wrap up with some use-case examples and how to run the YAML pipelines on Google Cloud Dataflow.