Cross-language JdbcIO enabled by Beam portable schemas

The cross-language framework of Apache Beam enables the utilization of Beam transforms across SDKs. This provides an efficient way to process data with the native Java database connectivity (JDBC) interface using the increasingly popular Beam Python SDK. Since Beam v2.42.0, Beam Python SDK’s JdbcIO and the underlying Beam portable schemas have received significant improvement in both feature and performance. This talk shares the experience of the development and use cases enabled by these improvements.