ABOUT THIS EPISODE
Former Anthropic pre-training researcher and Core Automation co-founder Rohan Anil explains how compute islands allow decentralized GPU clusters to train frontier AI models without colocation. He details why current scaling hits test-time learning bottlenecks, how butterfly mixing handles asynchronous training noise, and sets a 2027 timeline for models that continuously learn on the fly. Check out our sponsor Lovable: https://lovable.dev. Turn ideas into software people love.
MTS is a live news and interview show covering technology, business, politics, and culture as it happens.
Follow MTS:
X | https://twitter.com/MTSlive
YouTube | https://www.youtube.com/@mtsituation
Spotify | https://open.spotify.com/show/4HUNNmV1pjV7CW6Lphm1rM
Apple | https://podcasts.apple.com/us/podcast/mts/id1891088763
Substack | https://mtslive.substack.com/
Interested in sponsoring the show? sponsors@mts.now
–
Brought to you by:
Mongo DB - Anyone can prototype an agent. Learn how to get them into production on September 30th in New York - register at https://www.mongodb.com/events/mongodb-local/nyc
Lovable - Turn ideas into software people love with Lovable. Start today at https://lovable.dev/
Larridin - Finally prove what your AI investment is worth. Head to https://larridin.com/ today to start measuring your AI’s bottom line.
Neon (by Databricks) - Get up to $100K in credits for your startup at https://neon.com/mts
ElevenLabs - AI that communicates at human level across every channel and modality. https://elevenlabs.io/mts
Arena - Measuring AI performance in the real world. https://arena.ai/
Kong - The AI connectivity platform. Connect APIs, LLMs, agents, and systems with serious security and governance. https://konghq.com
Today’s stream is sponsored by VCX, the public ticker for private tech. Head over to http://getvcx.com to learn more
Blitzy - Autonomous software development for enterprise codebases. Ship 5x faster. https://blitzy.com
AdQuick - Make your brand a billboard. Out-of-home advertising as easy to scale as digital. https://adquick.com
Chargebee - Billing and monetization infrastructure for the AI era. https://www.chargebee.com/
–
Timestamps:
(00:00) Introduction
(00:50) Leaving Anthropic for Core Auto
(01:51) Training on Compute Islands
(07:50) Labs Designing Their Own Chips
(09:24) How Butterfly Mixing Works
(11:38) Training Frontier Models in Space
(15:44) Real Bottlenecks to AGI Timelines
(17:55) Alignment Risks of Continual Learning
–
Note: This podcast is not investment, legal, or tax advice, and is intended for informational and entertainment purposes only. Hosts and guests may hold positions in the companies and securities discussed; do your own research before acting on anything you hear.
