
Who watches the agents? Observability, evals, and guardrails at scale | Grafana Labs’ Devin Cheevers
- Interview
- Technology
When an agent takes thousands of actions a day, someone has to keep watch over what it’s doing. Grafana Labs director of product Devin Cheevers saw how much can slip past unnoticed when a one-line timestamp added to an agent’s system prompt wiped out its cache hit rate with the LLM provider. Recorded on site at Grafana’s ObservabilityCON in San Francisco, host Andrew Zigler sits down with Devin to talk through why vibes don’t scale once more teams contribute to an agent, and how evals let domain experts define what good looks like. Devin also shares w...
Opens the player: the full transcript, every word clickable, with translation and flashcards.
Is this episode right for you?
B2 · Upper-intermediate
Comfortable if you already follow TV news
- 79% of the words are B1 or easier.
- 195 words a minute: natural, fairly fast speech.
- 151 harder words (B2 and up) in the whole episode.
Try it: tap any word
Real sentences from the start of this episode. Every word is marked with its level.
, . ,
our regular interviews live. So a Friday interview landing in your feed is something new. And
Tap a word to see its meaning in your language.
Do you know these words?
8 harder words from this episode. Tap one to see what it means, then mark it.
Mark a few words and we'll tell you how this episode fits your level.
Is this episode right for you?
B2 · Upper-intermediate
Comfortable if you already follow TV news
- 79% of the words are B1 or easier.
- 195 words a minute: natural, fairly fast speech.
- 151 harder words (B2 and up) in the whole episode.
Transcript
The opening of the episode. The whole transcript is in the player.
harder words (B2+)
Hey everyone, Andrew here. If you've been listening a while, you know Tuesdays are where our regular interviews live. So a Friday interview landing in your feed is something new. And that's on purpose. We're bringing back our Friday episodes, but this time with a twist. We take Dev Interrupted on the road. We're going to conferences, we set up on site,
and we're sitting down with the builders and engineering leaders who are actually there. Today's episode was recorded at ObservabilityCon, Graphana Labs conference. And we got more from the floor coming your way too. The conversations are a blast and they look fantastic.
So if you want the full experience, be sure to watch them on YouTube. And one last thing, if you like Dev Interrupted and you want it at your conference, let us know. We'd love to make it happen.
That was the opening. The rest of the episode (34 min) is in the player: every word clickable, with translation, saved words and flashcards.
Continue in the playerAutomatically generated from the audio. May contain errors. Audio belongs to its publisher and is played from their feed. Rights holders can request removal — copyright & takedown policy