Scalable Prompt Optimization in Apache Beam LLM Workflows


Speaker(s):
Tomi Ajakaiye

Scalable Prompt Optimization in Apache Beam LLM Workflows

By Tomi Ajakaiye
Jul-9 12:30-12:55 in Horizon Hall
Add to Calendar 07/09/2025 12:30 PM 07/09/2025 12:55 PM BS25: Scalable Prompt Optimization in Apache Beam LLM Workflows

As Large Language Models (LLMs) become integral to data pipelines, optimizing prompts at scale is critical for consistency, cost control, and performance. In this session, you’ll learn how to embed prompt-tuning and dynamic prompt-generation into an LLM workflow that is executed as Apache Beam pipeline.

Horizon Hall

As Large Language Models (LLMs) become integral to data pipelines, optimizing prompts at scale is critical for consistency, cost control, and performance. In this session, you’ll learn how to embed prompt-tuning and dynamic prompt-generation into an LLM workflow that is executed as Apache Beam pipeline.