Feature Powered by Apache Beam - Beyond Lambda


Speaker(s):
Kobe Feng

Feature Powered by Apache Beam - Beyond Lambda

By Kobe Feng
Aug-28 18:00-18:20
Add to Calendar 08/28/2020 6:00 PM 08/28/2020 6:20 PM America/Los_Angeles AS24: Feature Powered by Apache Beam - Beyond Lambda

To unify feature extraction and selection in online and offline, to speedup E2E iteration for model training, evaluation and serving, to support different types (streaming, runtime, batch) of features, etc. eBay leverages Apache Beam for their streaming feature SDK as a foundation to integrate with Kafka, Hadoop, Flink, Airflow and others in eBay.

To unify feature extraction and selection in online and offline, to speedup E2E iteration for model training, evaluation and serving, to support different types (streaming, runtime, batch) of features, etc. eBay leverages Apache Beam for their streaming feature SDK as a foundation to integrate with Kafka, Hadoop, Flink, Airflow and others in eBay.