ABOUT THIS EPISODE
The real AI alignment problem is not technical. It is moral. You cannot align a superintelligence to human values if humans cannot agree on what those values are, and you cannot get that agreement without a level of global cooperation we have never managed before. Subscribe if you want science with evidence, not speculation.
The Tower of Babel is the AI parable nobody is reading. Technology that outpaces wisdom fragments the people building it. The Fermi paradox offers the grimmer version: civilizations that reach the capacity to blow themselves up typically do. Robert Wright has been watching this longer than almost anyone, he was reporting on neural networks in 1983, and his conclusion is not that the machines will fail the test. It is that we will.
Wright’s book argues that superintelligence is not the danger and AI alignment is not the solution unless it comes with a moral advance. Passing the God test requires something no lab can ship.
What you’ll hear:
-Why Wright thinks p(doom) fails as a scientific concept
-What the binding of Isaac and the Tower of Babel have in common as moral tests
-Why global cooperation is the only thing that can actually slow AI down
-What Lee Smolin’s cosmological natural selection has to do with the Fermi paradox
-What Wright thinks Eastern and Western enlightenment have in common and why it matters now
-Whether there is a role for humanity inside the global brain or only for the machines
“We face the kind of test that God would give.” — Robert Wright
CHAPTERS
00:00 The man who interviewed Hinton in 1983
05:04 The God test and its two meanings
08:36 Religious faith in technological progress
14:10 Hinton then versus Hinton now
19:38 Why slowing AI down requires international cooperation
26:02 How LLMs reverse-engineer the meaning of words
32:08 Brian's Einstein test: can Claude have a happy thought?
40:06 AGI is impossible. Here is why Brian thinks that.
47:04 The Fermi paradox as a moral filter
51:10 What passing the God test actually looks like
Get the transcript, fascinating bonus content, and my Monday M.A.G.I.C. Message: https://briankeating.com/yt
Have a .edu email and live in the USA? You automatically win a meteorite: https://BrianKeating.com/edu
Enter the debate: briankeating.com/ai
Subscribe: https://www.youtube.com/DrBrianKeating?sub_confirmation=1
Support Into the Impossible on Patreon, get my weekly M.A.G.I.C. Message, unfiltered bonus content, and live monthly Office Hours with me: https://www.patreon.com/drbriankeating
Join this channel for perks, monthly Office Hours, and your name in the Member Roster at the end of every episode: https://www.youtube.com/channel/UCmXH_moPhfkqCk6S3b9RWuw/join
Featured Guest:
The God Test (book): https://thegodtest.net
Robert Wright on Twitter/X: https://x.com/RWrighter
My books:
Losing the Nobel Prize (memoir): http://amzn.to/2sa5UpA
Think Like a Nobel Prize Winner: https://a.co/d/03ezQFu
Focus Like a Nobel Prize Winner: https://a.co/d/hi50U9U
Galileo’s Dialogue (first-ever audiobook): https://a.co/d/iZPi9Un
Twitter/X: https://x.com/BrianKeating
Substack: https://briankeating.substack.com
Blog: https://briankeating.com/blog
Audio-only: https://briankeating.com/podcast
#RobertWright #AIalignment #superintelligence #FermiParadox #briankeating #intotheimpossible #AI
Learn more about your ad choices. Visit megaphone.fm/adchoices
