The AI Rankings Just Got Reshuffled
The AI Daily Brief: Artificial Intelligence News and Analysis

The AI Rankings Just Got Reshuffled

C1AdvancedOctober 29, 202627 min
  • News bulletin
  • Technology

A major overhaul of AI’s most-watched benchmark is reshuffling the model rankings and revealing a wider gap between open and closed models. NLW examines what the new tests reveal about real-world capabilities—and how much those rankings should matter when choosing your AI tools. In the headlines: Google unveils Gemini 4 Carbon, Microsoft and Google report surging cloud revenue, and Nvidia faces broader antitrust scrutiny. Listen to the new How We Got Here with NLW: ⁠⁠⁠⁠https://podcasts.apple.com/us/podcast/how-we-got-here-with-nlw/id6822359990⁠⁠⁠⁠ ⁠⁠⁠⁠https://open.spotify.com/show/7h55KSq0XwIjdWzwF2zgNV?si=cb76360051ec48a0⁠⁠⁠⁠ L...

Play episode

Opens the player: the full transcript, every word clickable, with translation and flashcards.

Try it: tap any word

Real sentences from the start of this episode. Every word is marked with its level.

Sentence 4 of 11 · 0:25

And as AI models become more significant, the benchmarks that tell us how they perform relative to one another consequently get more important.

, ,

as well as a new leader for the benchmark, which comes, believe it or not, from Google.

Hear this sentence

Tap a word to see its meaning in your language.

Do you know these words?

8 harder words from this episode. Tap one to see what it means, then mark it.

  • B20:25
  • B25:54
  • B27:32
  • B210:21
  • B215:24
  • B219:42
  • B221:20
  • B225:18

Mark a few words and we'll tell you how this episode fits your level.

Is this episode right for you?

C1

C1 · Advanced

Fast, dense and idiomatic

A1 14%A2 32%B1 33%B2 16%C1 4%
  • 80% of the words are B1 or easier.
  • 195 words a minute: natural, fairly fast speech.
  • 220 harder words (B2 and up) in the whole episode.

Transcript

The opening of the episode. The whole transcript is in the player.

0:00

So frequently on this show, you will hear me ramble off a bunch of numbers that are supposed to tell you something significant about a new model that has just come out. And more often than not, those benchmark numbers are in some ways related to artificial analysis, the company that has become the leading provider of the overarching benchmark that people use to judge AI models. And as AI models become more significant, the benchmarks that tell us how they perform relative to one another consequently get more important. Today, we are looking at a major update to artificial analysis's intelligence index,

0:30

as well as a new leader for the benchmark, which comes, believe it or not, from Google. The AI Daily Brief is a daily podcast and video about the most important news and discussions in AI. All right, friends, quick announcements before we dive in. First of all, thank you to today's sponsors, KPMG, CData, Granola, and Blitzy.

0:53

To get an ad-free version of the show, go to patreon.com slash AI Daily Brief, or you can subscribe to our podcast. And if you want to learn more about sponsoring the show, send us a note at sponsors at AIDailyBrief.ai. On AIDailyBrief.ai, you can also find links to

That was the opening. The rest of the episode (26 min) is in the player: every word clickable, with translation, saved words and flashcards.

Continue in the player

Automatically generated from the audio. May contain errors. Audio belongs to its publisher and is played from their feed. Rights holders can request removal — copyright & takedown policy