An LLM Evaluation Framework for High-Stakes AI
Software Engineering Institute (SEI) Podcast Series

An LLM Evaluation Framework for High-Stakes AI

۲۱ خرداد ۱۴۰۵۱۶ دقیقه

Experimentation and validation of LLM performance is critical when building LLM-driven systems that must reliably deliver a service, from customer service chat bots to intelligence analysis tools. To help teams meet the need for rigorous evaluation methods, a research team in the SEI's AI Division led by Violet Turri has developed the Evaluating Large Language Models (ELM) library, which is built on best practices for LLM evaluation and benchmarking. In the latest episode from the Carnegie Mellon University Software Engineering Institute, Turri sits down with Katie Robinson, a design researcher also in the SEI's AI division, to discuss the EL...

پخش قسمت

این قسمت هنوز متن ندارد

می‌توانید در پلیر گوشش کنید. در قسمت‌هایی که متن دارند، با زدن روی هر کلمه معنی‌اش را می‌بینید.