Prompt Management, Tracing, and Evals: The New Table Stakes for GenAI Ops
Data Engineering Podcast

Prompt Management, Tracing, and Evals: The New Table Stakes for GenAI Ops

15 tháng 2, 202650 phút

Summary In this episode of the Data Engineering Podcast, Aman Agarwal, creator of OpenLit, discusses the operational groundwork required to run LLM-powered applications reliably and cost-effectively. He highlights common blind spots that teams face, including opaque model behavior, runaway token costs, and brittle prompt management, and explains how OpenTelemetry-native observability can turn these black-box interactions into stepwise, debuggable traces across models, tools, and data stores. Aman showcases OpenLit's approach to open standards, vendor-neutral integrations, and practical features such as fleet-managed OTEL collectors, zero-code Kubernetes instrumentation, prompt and secret management, and evaluation workflows. They also explore experimentation patterns, routing across m...

Phát tập này

Tập này chưa có bản ghi

Bạn vẫn có thể nghe trong trình phát. Với các tập có bản ghi, chạm vào bất kỳ từ nào để xem nghĩa.