Managing dependencies of Python pipelines

Jun-13 16:15-16:40 in Upper Bay
Add to Calendar 06/13/2023 4:15 PM 06/13/2023 4:40 PM America/Los_Angeles AS24: Managing dependencies of Python pipelines

In this talk we will discuss approaches to configure software dependencies of Apache Beam Python pipelines, how to avoid rough edges during pipeline submission, and how to debug issues pertaining to dependency management when they occur.

We will also touch on lessons learned from managing dependencies of Apache Beam Python SDK itself.

Upper Bay

In this talk we will discuss approaches to configure software dependencies of Apache Beam Python pipelines, how to avoid rough edges during pipeline submission, and how to debug issues pertaining to dependency management when they occur.

We will also touch on lessons learned from managing dependencies of Apache Beam Python SDK itself.