Practical AI
Practical AI
✓

AI incidents, audits, and the limits of benchmarks

· show notes
00:42:52
Podcasts
RSS
Link

ABOUT THIS EPISODE

AI incidents, audits, and the limits of benchmarks

AI is moving fast from research to real-world deployment, and when things go wrong, the consequences are no longer hypothetical. In this episode, Sean McGregor, co-founder of the AI Verification & Evaluation Research Institute and also the founder of the AI Incident Database, joins Chris and Dan to discuss AI safety, verification, evaluation, and auditing. They explore why benchmarks often fall short, what red-teaming at DEFCON reveals about machine learning risks, and how organizations can better assess and manage AI systems in practice.

Featuring:

Links:

Upcoming Events: 

How To
Tech News
Technology
AI & Data Science
English
United States
Use API to fetch this episode in JSON

IN THIS EPISODE

Edit these tags

SHOW NOTES 🔗

TRANSCRIPT 🔗

Are you the producer of this podcast? Add a podcast transcript
Need Audio-to-Text? Transcribe with Listen411 in Just 60 Seconds

SEARCH PAST EPISODES

Search past episodes of Practical AI.
Embed this search bar to your website

OTHER EPISODES IN THIS PODCAST

The Future of AI Infrastructure with CoreWeave

The Future of AI Infrastructure with CoreWeave

As AI applications become more complex, the infrastructure powering them needs to evolve. Corey Sanders, SVP of Product at CoreWeave, joins Chris to discuss why AI requires a fundamentally different approach than traditional cloud computing. They explore AI-native infrastructure, training and infer…
00:50:04
SHARE
SAVE
Surviving the New Economics of a Post-Agentic World

Surviving the New Economics of a Post-Agentic World

The agentic transformation isn’t coming. It has already begun. Companies are deploying thousands — and sometimes tens of thousands — of AI agents. Enterprise software giants are watching their old economic moats erode. Capital is moving, productivity is being redefined, and human labor is being rep…
00:35:36
SHARE
SAVE
Models, Harnesses, and Multi-Agent Systems

Models, Harnesses, and Multi-Agent Systems

AI has moved far beyond chatbots, but what exactly are AI models, agents, agent harnesses, and multi-agent systems, and why do they matter? In this episode, Daniel and Chris break down the terminology behind today's AI landscape, explain the differences between AI features and autonomous agents, an…
00:49:58
SHARE
SAVE
Reconstructing how OpenAI agents attacked Hugging Face

Reconstructing how OpenAI agents attacked Hugging Face

What happens when AI agents driven by a top frontier model escape their secure sandbox? Join Daniel and Chris as they unpack the AI wonk's equivalent of a murder mystery! OpenAI agents went rogue and successfully attacked Hugging Face private infrastructure. Our Dynamic Duo uncover how OpenAI's age…
00:44:25
SHARE
SAVE
AI Proficiency: From Users to Builders

AI Proficiency: From Users to Builders

As AI continues to reshape how organizations work, companies are increasingly asking what AI proficiency should look like across their workforce, and how they can help employees adapt without simply mandating AI adoption. Our returning guest Mike Lewis, Chief AI Architect at TiER1 Performance, join…
00:56:13
SHARE
SAVE
Disclaimer: The podcast and artwork embedded on this page are from Daniel Whitenack and Chris Benson, which is the property of its owner and not affiliated with or endorsed by Listen Notes, Inc.
PROMOTED
Listen411.com: Lightning-fast Podcast Transcription and Summarization. Transcribe 1-hour audio in under 1 minute. Pay-as-you-go.
Listen411.com: Lightning-fast Podcast Transcription and Summarization. Transcribe 1-hour audio in under 1 minute. Pay-as-you-go.
Audio to Text

RECOMMENDATIONS
Use API to fetch this episode