Unbreakable & Supercharged Beam Apps with Scala + ZIO

Jun-13 16:15-16:40 in Horizon
Add to Calendar 06/13/2023 4:15 PM 06/13/2023 4:40 PM America/Los_Angeles AS24: Unbreakable & Supercharged Beam Apps with Scala + ZIO

Google Cloud Dataflow with Beam is at the core of how Credit Karma recommends the best offers for its 120M+ users worldwide. Using Scala with ZIO, we will demonstrate with code examples how to easily solve common production challenges including:

  • controlling misbehaving Tensorflow & PMML models

  • transient job failures and Dataflow bugs,

  • running multiple parallel jobs

  • detecting anomalous jobs

  • preventing errors at the petabyte scale

  • speculative jobs for optimizing operation

  • and more

Horizon

Google Cloud Dataflow with Beam is at the core of how Credit Karma recommends the best offers for its 120M+ users worldwide. Using Scala with ZIO, we will demonstrate with code examples how to easily solve common production challenges including:

  • controlling misbehaving Tensorflow & PMML models

  • transient job failures and Dataflow bugs,

  • running multiple parallel jobs

  • detecting anomalous jobs

  • preventing errors at the petabyte scale

  • speculative jobs for optimizing operation

  • and more