Scaling Agent Workloads at Vercel

Most AI agent setups today are built around a single session where one user interacts with one agent at a time. However, that model breaks down when an agent has to serve a business where thousands of requests can arrive at once and each session needs to be isolated, durable, and recoverable. Getting agents to run reliably at that scale has meant a lot of hand-rolled infrastructure beneath the agent itself. Eve is an open source cloud-native agent framework from Vercel that removes much of the agent scaling burden.

In the Eve framework, an agent is defined declaratively through configuration files, and these files compile into infrastructure as code, so the platform provisions only what the agent actually uses. Andrew Barba is a member of technical staff at Vercel, and Shahra Dara is the product lead for Eve at Vercel. In this episode, they join Kevin Ball to discuss what it means for an agent framework to be