Prompt Management, Tracing, and Evals: The New Table Stakes for GenAI Ops
Data Engineering Podcast

Prompt Management, Tracing, and Evals: The New Table Stakes for GenAI Ops

15 فبراير 202650 دقيقة

Summary In this episode of the Data Engineering Podcast, Aman Agarwal, creator of OpenLit, discusses the operational groundwork required to run LLM-powered applications reliably and cost-effectively. He highlights common blind spots that teams face, including opaque model behavior, runaway token costs, and brittle prompt management, and explains how OpenTelemetry-native observability can turn these black-box interactions into stepwise, debuggable traces across models, tools, and data stores. Aman showcases OpenLit's approach to open standards, vendor-neutral integrations, and practical features such as fleet-managed OTEL collectors, zero-code Kubernetes instrumentation, prompt and secret management, and evaluation workflows. They also explore experimentation patterns, routing across m...

تشغيل الحلقة

لا يوجد نص لهذه الحلقة بعد

يمكنك الاستماع إليها في المشغّل. في الحلقات التي لها نص، يمكنك النقر على أي كلمة لترى معناها.