Managing AI Coding Costs at Scale
Software Engineering Daily

Managing AI Coding Costs at Scale

B1IntermediateOctober 27, 20261 hr 1 min
  • Interview
  • Technology

Over the past couple of years, companies raced to get their employees using AI, often encouraging them to lean on it as much as possible. However, as AI coding tools spread through engineering teams, many companies watched their AI bills explode. That kind of runaway cost growth can threaten a business, so the new challenge is capturing the productivity gains from AI without the spending spiraling out of control. Databricks is a data and AI company that hit this problem early, running AI tools across thousands of its own engineers. Rather than clamp down on usage, the...

Play episode

Opens the player: the full transcript, every word clickable, with translation and flashcards.

Try it: tap any word

Real sentences from the start of this episode. Every word is marked with its level.

Sentence 10 of 12 · 0:39

Rather than clamp down on usage, the team built a set of practical ways to manage the

,

request to the cheapest model that can still do the job well.

Tap a word to see its meaning in your language.

Do you know these words?

8 harder words from this episode. Tap one to see what it means, then mark it.

Mark a few words and we'll tell you how this episode fits your level.

Is this episode right for you?

B1

B1 · Intermediate

Fine if you can follow simple news

A1 23%A2 37%B1 21%B2 18%C1 2%
  • 80% of the words are B1 or easier.
  • 208 words a minute: natural, fairly fast speech.
  • 313 harder words (B2 and up) in the whole episode.

Transcript

The opening of the episode. The whole transcript is in the player.

0:00

Over the past couple of years, companies race to get their employees using AI, often encouraging them to lean on it as much as possible. However, as AI coding tools spread through engineering teams, many companies watched their AI bills explode.

0:16

That kind of runaway cost growth can threaten a business, so the new challenge is capturing the productivity gains from AI without the spending spiraling out of control. Databricks is a data and AI company that hit this problem early, running AI tools across thousands of its own engineers.

0:35

Rather than clamp down on usage, the team built a set of practical ways to manage the cost, from taking advantage of steadily falling model prices to automatically routing each request to the cheapest model that can still do the job well. Patrick Wendell is a co-founder of Databricks, where he leads engineering teams and has

That was the opening. The rest of the episode (60 min) is in the player: every word clickable, with translation, saved words and flashcards.

Continue in the player

Automatically generated from the audio. May contain errors. Audio belongs to its publisher and is played from their feed. Rights holders can request removal — copyright & takedown policy