Trust, But Verify: Petabyte scale validations using Beam & Dataflow

Migrating massive, mission-critical databases across heterogeneous systems is inherently terrifying because customers don’t just hope for a successful migration — they demand 100% data integrity. In this talk, we will explore why Cloud Spanner chose Apache beam & Dataflow to implement scaled out data validation for customers migrating to Spanner. We will dig into how beam helps simplifies executing complex data processing at scale, and how Dataflow reduces time-to-market by providing a stable, scaled out beam runner.