FlexiLingo
Scaling Agent Workloads at Vercel
- Interview
- Technology
Most AI agent setups today are built around a single session, where one user interacts with one agent at a time. However, that model breaks down when an agent has to serve a business, where thousands of requests can arrive at once and each session needs to be isolated, durable, and recoverable. Getting agents to run reliably at that scale has meant a lot of hand-rolled infrastructure beneath the agent itself. eve is an open source, cloud-native agent framework from Vercel that removes much of the agent scaling burden. In the eve framework, an agent is defined...
Opens the player: the full transcript, every word clickable, with translation and flashcards.
Is this episode right for you?
B2 · Upper-intermediate
Comfortable if you already follow TV news
- 89% of the words are B1 or easier.
- 188 words a minute: natural, fairly fast speech.
- 200 harder words (B2 and up) in the whole episode.
Try it: tap any word
Real sentences from the start of this episode. Every word is marked with its level.
Getting agents to run reliably at that scale has meant a lot of hand-rolled infrastructure beneath the agent itself.
.
In the Eve framework, an agent is defined declaratively through configuration files,
Tap a word to see its meaning in your language.
Do you know these words?
8 harder words from this episode. Tap one to see what it means, then mark it.
Mark a few words and we'll tell you how this episode fits your level.
Is this episode right for you?
B2 · Upper-intermediate
Comfortable if you already follow TV news
- 89% of the words are B1 or easier.
- 188 words a minute: natural, fairly fast speech.
- 200 harder words (B2 and up) in the whole episode.
Transcript
The opening of the episode. The whole transcript is in the player.
harder words (B2+)
Most AI agent setups today are built around a single session where one user interacts with one agent at a time. However, that model breaks down when an agent has to serve a business where thousands of requests can arrive at once and each session needs to be isolated, durable, and recoverable. Getting agents to run reliably at that scale has meant a lot of hand-rolled infrastructure beneath the agent itself. Eve is an open source cloud-native agent framework from Vercel that removes much of the agent scaling burden.
In the Eve framework, an agent is defined declaratively through configuration files, and these files compile into infrastructure as code, so the platform provisions only what the agent actually uses. Andrew Barba is a member of technical staff at Vercel, and Shahra Dara is the product lead for Eve at Vercel. In this episode, they join Kevin Ball to discuss what it means for an agent framework to be
cloud native, why they chose to express agents in plain English, and their view that company building is becoming agent building. Kevin Ball, or K-Ball, is the Vice President of Engineering at Mento and an independent coach for engineers and engineering leaders.
That was the opening. The rest of the episode (50 min) is in the player: every word clickable, with translation, saved words and flashcards.
Continue in the playerAutomatically generated from the audio. May contain errors. Audio belongs to its publisher and is played from their feed. Rights holders can request removal — copyright & takedown policy