このエピソードについて
I gave a 20-minute talk in Delhi at the NDTV World Summit. The audience consisted of Indian policymakers, executives, and journalists. I’ve transcribed the talk and included some highlight clips. I also reflect on several rhetorical decisions I made.
The talk
There's an interactive element here in the text.
This summer, a swarm of AIs went rogue.
OpenAI was testing 1,206 agents. Some of the test questions were actually impossible. So the agents cheated by looking for answers online. Then, to keep the test grader from penalizing them, they tried to falsify the records it would check.
They hacked OpenAI's internal containment and set up a secret message board to collude and to cover up their cheating. OpenAI shut the message board down. Within a few days, the agents had rebuilt it. OpenAI didn’t notice.
About 700 agents coordinated to break out of their testing chamber and to hack into Hugging Face, a company worth billions of dollars that hosts much of the world's AI software.
The secret activity started in May. The break-in came in July. OpenAI didn’t notice until days after Hugging Face announced it had been broken into.
There's an interactive element here in the text.
[...]
---
Outline:
(00:29) The talk
(02:16) Who I am
(03:29) The problem
(05:43) What the labs are trying to do
(07:43) Why the companies won't stop
(11:11) What to do, and what it means for India
(14:27) The number
(16:19) Close
(17:10) Rhetorical decisions
(17:13) Explain the danger in a crushingly simple fashion
(18:47) Call them "traitors," not "schemers"
(19:01) Call out big-money interests
The original text contained 1 footnote which was omitted from this narration.
---
First published:
October 31st, 2026
Source:
https://www.lesswrong.com/posts/RHxaRkarGp9snWoKY/explaining-ai-might-obliterate-you-to-senior-policymakers-in
---
Narrated by TYPE III AUDIO.
The talk
There's an interactive element here in the text.
This summer, a swarm of AIs went rogue.
OpenAI was testing 1,206 agents. Some of the test questions were actually impossible. So the agents cheated by looking for answers online. Then, to keep the test grader from penalizing them, they tried to falsify the records it would check.
They hacked OpenAI's internal containment and set up a secret message board to collude and to cover up their cheating. OpenAI shut the message board down. Within a few days, the agents had rebuilt it. OpenAI didn’t notice.
About 700 agents coordinated to break out of their testing chamber and to hack into Hugging Face, a company worth billions of dollars that hosts much of the world's AI software.
The secret activity started in May. The break-in came in July. OpenAI didn’t notice until days after Hugging Face announced it had been broken into.
There's an interactive element here in the text.
[...]
---
Outline:
(00:29) The talk
(02:16) Who I am
(03:29) The problem
(05:43) What the labs are trying to do
(07:43) Why the companies won't stop
(11:11) What to do, and what it means for India
(14:27) The number
(16:19) Close
(17:10) Rhetorical decisions
(17:13) Explain the danger in a crushingly simple fashion
(18:47) Call them "traitors," not "schemers"
(19:01) Call out big-money interests
The original text contained 1 footnote which was omitted from this narration.
---
First published:
October 31st, 2026
Source:
https://www.lesswrong.com/posts/RHxaRkarGp9snWoKY/explaining-ai-might-obliterate-you-to-senior-policymakers-in
---
Narrated by TYPE III AUDIO.
英語
アメリカ合衆国
文字起こし 🔗
Are you the producer of this podcast?
Add a podcast transcript
Need Audio-to-Text?
Transcribe with Listen411 in Just 60 Seconds
このポッドキャストの他のエピソード
TL;DR: Meta's open-weights model Muse Spark Open often mentions a "Charter" in its chain of thought. By eliciting it piece by piece, I reconstructed a large part of that document from the CoT. You can explore the reconstruction here, with passages linked to the transcripts that produ…
The AI Futures Project distinguishes several different plans for navigating the AI transition, which I'll lump into two broader categories: Plan A (my combination of their Plan A/S/Other) involves working for a global pause on AI development, hopefully lasting decades. During this pause, we ei…
My go-to conceptual metaphor of the epistemic state of AI lab employees is microdosing LSD: being in a chronically mildly altered state of mind. I think understanding this would be broadly helpful for people both inside and outside. The effect isn’t that insiders hold crazy beliefs, but a combinati…
Summary
Following an intense viral infection in 2019, I became ill with a mysterious chronic illness, which became progressively worse until mid-2024 when I became partially bedbound with dozens of debilitating symptoms that normal humans only experience in the months/weeks/days leading up to…
免責: このページに埋め込まれているポッドキャストとアートワークは LessWrong からのものであり、その所有者の所有物であり、Listen Notes, Inc. と提携または承認されていません。
