ОБ ЭТОМ ЭПИЗОДЕ
If you are helping build something that might kill everyone, maybe stop doing that.
Ideally, when you do stop, tell everyone else to also stop building it.
That is certainly the obvious, first-level thing to do. You need a damn good reason to decide that no, actually you should keep building the thing that might kill everyone.
Scott Alexander is worried too many people are insisting upon this too loudly. He comes out against a strategy focused on getting people to stop. I disagree. I think many of the claims, arguments and rhetoric in Scott's post are quite poor by the standards that Scott Alexander would apply to himself.
Scott clearly continues to support advocacy for a global pause, or what he calls Plan A. His objection is to those advocating primarily or exclusively for SURA, which stands for ‘stop unilaterally and raise awareness.’ The practical differences here are smaller than they may at first appear.
This post first lays out my understanding of Scott Alexander's core claims, then gives my core reactions to those claims, then goes over various questions in detail along with gathering the resulting discussions.
Table of Contents
Outline:
(01:20) Scott Alexander's Core Claims
(05:06) My High Level Responses To Scott's Core Claims
(08:08) Briefly on Alignment
(10:11) Probabilities and How They Work
(13:25) Building a Thing That Might Kill Everyone is Deontologically Evil
(20:38) People Quitting Major Labs While Raising Alarms Obviously Works
(24:39) On AI Forecasting
(27:31) Advancing Capabilities Burns Timeline
(29:34) But China
(33:23) Ethical People Can Disagree With You
(34:45) There Are More Than Two Outcomes
(38:01) Efforts Are Complementary, Not Mutually Exclusive
(40:23) If Anyone Builds It, Everyone Dies
(41:55) Vaniver is Not Convinced
(46:19) There Is No Consensus That We Should Exclusively Focus on Plan A
(56:01) It's Not the Incentives, It's You
(58:08) Anthropic Is Not Optimally Pursuing These Plans
(01:04:00) Against Against Sura
The original text contained 2 footnotes which were omitted from this narration.
---
First published:
November 2nd, 2026
Source:
https://www.lesswrong.com/posts/ziMP83D2JYWRQ5jtu/scott-alexander-s-against-sura-seems-deeply-confused
---
Narrated by TYPE III AUDIO.
Ideally, when you do stop, tell everyone else to also stop building it.
That is certainly the obvious, first-level thing to do. You need a damn good reason to decide that no, actually you should keep building the thing that might kill everyone.
Scott Alexander is worried too many people are insisting upon this too loudly. He comes out against a strategy focused on getting people to stop. I disagree. I think many of the claims, arguments and rhetoric in Scott's post are quite poor by the standards that Scott Alexander would apply to himself.
Scott clearly continues to support advocacy for a global pause, or what he calls Plan A. His objection is to those advocating primarily or exclusively for SURA, which stands for ‘stop unilaterally and raise awareness.’ The practical differences here are smaller than they may at first appear.
This post first lays out my understanding of Scott Alexander's core claims, then gives my core reactions to those claims, then goes over various questions in detail along with gathering the resulting discussions.
Table of Contents
- [...]
Outline:
(01:20) Scott Alexander's Core Claims
(05:06) My High Level Responses To Scott's Core Claims
(08:08) Briefly on Alignment
(10:11) Probabilities and How They Work
(13:25) Building a Thing That Might Kill Everyone is Deontologically Evil
(20:38) People Quitting Major Labs While Raising Alarms Obviously Works
(24:39) On AI Forecasting
(27:31) Advancing Capabilities Burns Timeline
(29:34) But China
(33:23) Ethical People Can Disagree With You
(34:45) There Are More Than Two Outcomes
(38:01) Efforts Are Complementary, Not Mutually Exclusive
(40:23) If Anyone Builds It, Everyone Dies
(41:55) Vaniver is Not Convinced
(46:19) There Is No Consensus That We Should Exclusively Focus on Plan A
(56:01) It's Not the Incentives, It's You
(58:08) Anthropic Is Not Optimally Pursuing These Plans
(01:04:00) Against Against Sura
The original text contained 2 footnotes which were omitted from this narration.
---
First published:
November 2nd, 2026
Source:
https://www.lesswrong.com/posts/ziMP83D2JYWRQ5jtu/scott-alexander-s-against-sura-seems-deeply-confused
---
Narrated by TYPE III AUDIO.
английский
США
РАСШИФРОВКА 🔗
Are you the producer of this podcast?
Add a podcast transcript
Need Audio-to-Text?
Transcribe with Listen411 in Just 60 Seconds
ПОИСК ПРОШЛЫХ ЭПИЗОДОВ
Искать прошлые эпизоды LessWrong (Curated & Popular).
ДРУГИЕ ЭПИЗОДЫ В ЭТОМ ПОДКАсте
On October 29th, 2026, the New York Times reported that Jensen Huang had a ‘close relationship’ with Alice Huang, an executive U.S. officials had concluded was a Chinese spy. The story had six reporters on the byline, and was sourced to "people briefed on the surveillance." Whether or no…
How do you get a friend to leave an abusive relationship? If you talk to people who work at women's shelters, they will tell you, but there is something resigned about the way they do it: they know that it's too difficult an ask. Those who can do it reliably are often people who are unluc…
Science is caught between Law and Chaos. On the side of Law:
Things should make explicit sense to your deliberate reasoning ("system-two"). If you just have a "vibe" about how things work, that's bad. Measure everything. Use numbers whenever possible. You want things to b…
Space is big. You just won't believe how vastly, hugely, mind-bogglingly big it is. I mean, you may think it's a long way down the road to the chemist's, but that's just peanuts to space. — The Hitchhiker's Guide to the Galaxy When we say "space is big", it's…
In February 2020, LessWrong hosted Coronavirus: Justified Practical Advice Thread . It was a gathering place for people to share and debate small pieces of the overall survival policy and let the wisdom of crowds lead to better outcomes than anyone could get alone. In that spirit, I notice The Gre…
Отказ от ответственности: Подкаст и иллюстрации, встроенные в эту страницу, взяты из LessWrong, который является собственностью его владельца и не связан или не одобрен Listen Notes, Inc.
ИЗМЕНИТЬ
Спасибо, что помогаете поддерживать базу подкастов актуальной.