On AI Evals, TAR vs. LLMs and What Will be Different Next Year - Aron Ahmadia (VP Applied Science, Relativity)
Technically Legal - A Legal Technology and Innovation Podcast

On AI Evals, TAR vs. LLMs and What Will be Different Next Year - Aron Ahmadia (VP Applied Science, Relativity)

B2中高级2026年9月17日41分钟
  • 访谈
  • 科技

In advance of this year's RelFest in Chicago, Aron Ahmadia, Vice President of Applied Science at Relativity, joins the podcast to discuss AI evaluation, AI benchmarking and the transition from traditional Technology Assisted Review (TAR) to generative AI in legal document review and eDiscovery. The conversation covers the daily operations of a global AI team, the concept of "evaluation as a product," and the methodology behind testing large language models (LLMs) for legal tasks. Aron also discusses a recent study that compared the accuracy and efficiency of TAR and human document review against Relativity's generative AI tool, aiR for...

播放本集

打开播放器:完整文字稿,每个单词都可点击,附翻译和单词卡。

试一试:点任意单词

来自本集开头的真实句子,每个单词都标出了难度级别。

第 1 句,共 12 句 · 0:00

electronic discovery and legal document review generally.

点一个单词,用你的语言查看释义。

这些单词你认识吗?

本集中 8 个较难的单词。点一个查看释义,然后标记一下。

标记几个单词,我们会告诉你这一集是否适合你的水平。

这一集适合你吗?

B2

B2 · 中高级

能看懂电视新闻就会觉得轻松

A1 27%A2 33%B1 20%B2 17%C1 3%
  • 80% 的单词在 B1 或更简单的水平。
  • 每分钟 192 词:自然语速,偏快。
  • 整集共有 152 个较难的单词(B2 及以上)。

文字稿

本集开头部分。完整文字稿在播放器中。

0:00

This is Tech-to- electronic discovery and legal document review generally. So let me take you back to 1994. An imagine 12-year-old boy sitting in a small two-partner PI law firm, he's manually networking independent copies of DOS computers to install windows for

0:49

work groups. What this kid doesn't know yet back in 1994 is that this is his first step into a three-decade journey into legal technology. Fast forward to today and that same person is helping architect the future of AI for one of the biggest legal tech companies in the world. My guest today is Dr. Aaron Amadea. He's

1:07

the Vice President of Applied Science and Relativity. Like many people on the show, he had a background that wasn't necessarily legal before he ended up in the legal industry. Before leading AI Relativity, Dr. Amadea under PhD in Applied Math

以上是开头部分。 本集其余部分(41 分钟)在播放器中:每个单词都可点击,附翻译、生词收藏和单词卡。

在播放器中继续

由音频自动生成,可能存在错误。 音频版权归其发布者所有,并从其订阅源播放。版权所有者可申请删除 — 版权与删除政策