ABOUT THIS EPISODE
Mercor economics researcher Aden Barton discusses benchmark testing for AI capabilities, revealing that models now outperform human accountants on specialized tasks, while 90% of US workforce time remains completely unrepresented in existing benchmarks. Check out our sponsor Lovable: https://lovable.dev. Turn ideas into software people love.
MTS is a live news and interview show covering technology, business, politics, and culture as it happens.
Follow MTS:
X | https://twitter.com/MTSlive
YouTube | https://www.youtube.com/@mtsituation
Spotify | https://open.spotify.com/show/4HUNNmV1pjV7CW6Lphm1rM
Apple | https://podcasts.apple.com/us/podcast/mts/id1891088763
Substack | https://mtslive.substack.com/
Interested in sponsoring the show? sponsors@mts.now
--
Brought to you by:
Mongo DB - Anyone can prototype an agent. Learn how to get them into production on September 30th in New York - register at https://www.mongodb.com/events/mongodb-local/nyc
Lovable - Turn ideas into software people love with Lovable. Start today at https://lovable.dev/
Larridin - Finally prove what your AI investment is worth. Head to https://larridin.com/ today to start measuring your AI’s bottom line.
Neon (by Databricks) - Get up to $100K in credits for your startup at https://neon.com/mts
ElevenLabs - AI that communicates at human level across every channel and modality. https://elevenlabs.io/mts
Arena - Measuring AI performance in the real world. https://arena.ai/
Kong - The AI connectivity platform. Connect APIs, LLMs, agents, and systems with serious security and governance. https://konghq.com
Today’s stream is sponsored by VCX, the public ticker for private tech. Head over to http://getvcx.com to learn more
Blitzy - Autonomous software development for enterprise codebases. Ship 5x faster. https://blitzy.com
AdQuick - Make your brand a billboard. Out-of-home advertising as easy to scale as digital. https://adquick.com
Chargebee - Billing and monetization infrastructure for the AI era. https://www.chargebee.com/
--
Timestamps:
(00:00) Introduction
(00:31) Mercor's AI Benchmark Research
(01:37) AI Outperforming Human Accountants
(02:52) Task Automation vs Full Jobs
(03:53) Why AI Benchmarks Fail
(07:54) Automation versus Human Augmentation
(09:04) Unmeasured Work in US Economy
(11:09) Measuring Real Productivity Impact
--
Note: This podcast is not investment, legal, or tax advice, and is intended for informational and entertainment purposes only. Hosts and guests may hold positions in the companies and securities discussed; do your own research before acting on anything you hear.
