Playing the Long Game - Transforming Ricardo's Data Infrastructure with Apache Beam


Speaker(s):
Tobias Kaymak

Playing the Long Game - Transforming Ricardo's Data Infrastructure with Apache Beam

By Tobias Kaymak
Jul-19 16:45-17:10 in 202
Add to Calendar 07/19/2022 4:45 PM 07/19/2022 5:10 PM America/Los_Angeles AS24: Playing the Long Game - Transforming Ricardo's Data Infrastructure with Apache Beam

The Data Intelligence Team at Ricardo, Switzerland’s largest online marketplace, is a long-time Apache Beam user.

Starting on-premise, we transitioned from running our own Apache Flink cluster on Kubernetes with over 40 streaming pipelines written in Apache Beam’s Java SDK to Cloud Dataflow. This talk describes the obstacles and discusses our learnings along the way.

 202

  Download slides

The Data Intelligence Team at Ricardo, Switzerland’s largest online marketplace, is a long-time Apache Beam user.

Starting on-premise, we transitioned from running our own Apache Flink cluster on Kubernetes with over 40 streaming pipelines written in Apache Beam’s Java SDK to Cloud Dataflow. This talk describes the obstacles and discusses our learnings along the way.