Cross-language JdbcIO enabled by Beam portable schemas


Speaker(s):
Yi Hu

Cross-language JdbcIO enabled by Beam portable schemas

By Yi Hu
Jun-13 14:30-14:55 in Upper Bay
Add to Calendar 06/13/2023 2:30 PM 06/13/2023 2:55 PM America/Los_Angeles AS24: Cross-language JdbcIO enabled by Beam portable schemas

The cross-language framework of Apache Beam enables the utilization of Beam transforms across SDKs. This provides an efficient way to process data with the native Java database connectivity (JDBC) interface using the increasingly popular Beam Python SDK. Since Beam v2.42.0, Beam Python SDK’s JdbcIO and the underlying Beam portable schemas have received significant improvement in both feature and performance. This talk shares the experience of the development and use cases enabled by these improvements.

 Upper Bay

  Download slides

The cross-language framework of Apache Beam enables the utilization of Beam transforms across SDKs. This provides an efficient way to process data with the native Java database connectivity (JDBC) interface using the increasingly popular Beam Python SDK. Since Beam v2.42.0, Beam Python SDK’s JdbcIO and the underlying Beam portable schemas have received significant improvement in both feature and performance. This talk shares the experience of the development and use cases enabled by these improvements.