SemiAnalysis Weekly
SemiAnalysis Weekly
✓

Ep. 033 - ClusterMAX 3.0 Is Here! Neoclouds Ranked (Neoclouds, GPUs) | Sam Harshe, Pratt Bhatt, Jordan Nanos

01:08:36
Podcasts
RSS
Link

ABOUT THIS EPISODE

ClusterMAX 3.0 is here. Sam Harshe (@sharshe02) and Pratt Bhatt (@PrathmeshBhat19) join Jordan Nanos (@jordannanos) after months of testing 77 GPU clouds. Some moved up, some moved down.

Health checks, cache hit rates, NCCL recipes, agentic coding on clusters, a Linux kernel bug, neocloud security, SLAs and financing, NVIDIA's backstops, five-year-old H100s, and hosted RL training.

Read the full ClusterMAX 3.0 report: https://newsletter.semianalysis.com/p/clustermax-30-the-industry-standard
ClusterMAX inquiries: clustermax@semianalysis.com


0:00 Cold Open

1:32 The Rankings

6:58 Health Checks

13:26 Endpoint Cache Misses

16:40 Networking and NCCL

22:52 Vibe-Coded Infra

31:27 Bug Hunting

38:36 Security

45:43 Financing Neoclouds

56:33 Hosted Training and RL

Technology
Business
English
United States
Use API to fetch this episode in JSON

IN THIS EPISODE

Edit these tags

TRANSCRIPT 🔗

Are you the producer of this podcast? Add a podcast transcript
Need Audio-to-Text? Transcribe with Listen411 in Just 60 Seconds

SEARCH PAST EPISODES

Search past episodes of SemiAnalysis Weekly.
Embed this search bar to your website

OTHER EPISODES IN THIS PODCAST

Ep. 030 - Long Live the Short King: Why 4-HI HBM Wins (Memory) | Myron Xie, Jordan Nanos

Ep. 030 - Long Live the Short King: Why 4-HI HBM Wins (Memory) | Myron Xie, Jordan Nanos

NVIDIA previewed Rubin Ultra at 1TB of HBM per package. The part that ships will carry 192GB. Myron Xie and Jordan Nanos get into how the design fell that far, why the reason is supply and not performance, and why shipping less memory per chip might be the right call anyway. For the first time in…
00:38:52
SHARE
SAVE
Ep. 032 - 300 Datacenter Bans, 3 Projects Delayed: Moratoriums Explained (Datacenter, Energy) | Maya Barkin, Reyk Knühtsen, Jordan Nanos

Ep. 032 - 300 Datacenter Bans, 3 Projects Delayed: Moratoriums Explained (Datacenter, Energy) | Maya Barkin, Reyk Knühtsen, Jordan Nanos

More than 300 towns, cities, and counties have voted to pause data centers in the past 18 months. Maya Barkin (@mayabarkin) and Reyk Knühtsen (@robotknower) from the SemiAnalysis Data Center, Energy, and Industrials team join Jordan Nanos (@jordannanos) to explain what a moratorium actually is, how…
00:53:30
SHARE
SAVE
Ep. 031 - EMERGENCY EPISODE: Are We Doomed? | Jordan Nanos, Doug O'Laughlin, Max Kan, Joey Brookhart

Ep. 031 - EMERGENCY EPISODE: Are We Doomed? | Jordan Nanos, Doug O'Laughlin, Max Kan, Joey Brookhart

Emergency episode. Doug O'Laughlin (@Fabknowledge) , Joey Brookhart (@SaasquatchC), and Max Kan (@maxkan) join Jordan (@JordanNanos) to talk through Dario's "We Must Pace the Frontier" blog and the responses from Sam Altman and David Sacks. Does pacing actually mean less compute, or a lot…
01:02:09
SHARE
SAVE
Ep. 029 - Modular Data Centers Cut Build Time to 12 Months (Datacenter, Energy) | Nico Bontigui, Jordan Nanos, Nigel Chiang, Eric Wen

Ep. 029 - Modular Data Centers Cut Build Time to 12 Months (Datacenter, Energy) | Nico Bontigui, Jordan Nanos, Nigel Chiang, Eric Wen

Traditional data center builds ran 18 to 24 months, sometimes past three years. Modular construction cuts that to 12. Jordan Nanos (@JordanNanos) sits down with Eric Wen, Nigel Chiang, and Nico Bontigui to map what modular actually means, from MEP heavy skids to full containerized builds. They bre…
00:46:44
SHARE
SAVE
Disclaimer: The podcast and artwork embedded on this page are from Jordan Nanos, Doug O'Laughlin, which is the property of its owner and not affiliated with or endorsed by Listen Notes, Inc.
PROMOTED
Listen411.com: Lightning-fast Podcast Transcription and Summarization. Transcribe 1-hour audio in under 1 minute. Pay-as-you-go.
Listen411.com: Lightning-fast Podcast Transcription and Summarization. Transcribe 1-hour audio in under 1 minute. Pay-as-you-go.
Audio to Text

RECOMMENDATIONS
Use API to fetch this episode