درباره این اپیزود
GPU scarcity has forced AI teams into a world their infrastructure was never built for — reserving capacity across multiple providers, geographies, and SKUs and watching 30 to 40 percent of expensive allocations sit idle. In this episode, Zongheng Yang, co-founder and CEO of SkyPilot, joins the hosts to unpack why being multi-cloud stopped being optional for AI teams and what it actually takes to manage compute efficiently once you have it.
Before founding SkyPilot, Zongheng was a speech researcher at Google Brain and a co-author on Tacotron, a PhD student at UC Berkeley's Sky Computing Lab (the birthplace of Ray, Spark, and VLM), and a contributor to the early open-weight model Vicuna. He and his co-founders built SkyPilot to solve their own problem as AI researchers: compute scattered across multiple clouds being impossible to fully utilize. Four years and 14 million downloads later, SkyPilot has become an open source standard for orchestrating AI compute across providers, with more than 280 contributors and customers including Nubank, Abridge, and Hippocratic AI running production workloads on it.
Zongheng breaks down why decades-old solutions like Kubernetes and Slurm quickly buckle under the combinatorial complexity of multiple clouds, multiple GPU SKUs, and multiple research teams competing for the same fleet. He explains why idle GPUs, not just scarce ones, are the bigger hidden cost — a team spending $100 million a year can lose $15 to $30 million to poor utilization alone — why SkyPilot bet on open source and the Apache 2.0 license from day one, and why he thinks the winning bet right now is to start building for a compute-abundant world rather than hoarding capacity for a scarce one.
In this episode, you will learn:
Why multi-cloud went from a nice-to-have to a necessity for AI teams almost overnight
What breaks when a team moves from one cluster to managing dozens across providers
Why idle GPUs can cost frontier teams tens of millions of dollars a year
The difference between getting compute and knowing how to use it well
Why SkyPilot's founders bet on open source and the Apache 2.0 license from the start
What changes for AI teams once compute stops being the constraint
If you're building or scaling an AI team's infrastructure, this conversation will change how you think about the true cost of underutilized compute.
