O TYM ODCINKU
Summary: Scott Alexander's Against SURA post is arguing against a strawman version of unilateral pauses. He admits as much deep into the post. I think his conclusions fail against stronger pause plans for conditional or limited unilateral pauses, where training resumes if the pause does not cause others to pause, and where personnel are redirected toward work on alignment and product, rather than simply fired. In addition, Scott's post is incorrect about the simplicity of the game theory involved: getting companies to agree to conditional pauses is not strictly easier than convincing them to pause, as the former requires companies to (promise to) take actions based on ambiguous, game-theoretically-informed evidence. That is not the kind of evidence companies tend to act on.
The good version of unilateral pausing is good
Here is the good version of unilateral pausing:
Outline:
(00:57) The good version of unilateral pausing is good
(04:50) Scott thinks the good version of unilateral pausing is good, or at least exempts it from criticism
(06:28) Oversimplified game theory is bad, and you should feel bad
(07:51) "Some definition" hides dragons
(10:17) Promises can be harder than actions
(11:52) How many frontier labs are there?
(12:20) Definitional fairness is less important than survival
---
First published:
November 3rd, 2026
Source:
https://www.lesswrong.com/posts/enzpS72uDmomiWN7a/against-strawmanning-unilateral-pauses
---
Narrated by TYPE III AUDIO.
The good version of unilateral pausing is good
Here is the good version of unilateral pausing:
- Capability pause: Some frontier lab (let's call them OpenAI or Anthropic) says they have stopped capability research, either just all frontier training runs or both all frontier training runs and all low-scale capability-focused research.
- Internal definition: The company gets to pause on its own terms, which is much easier than a generally coordinated pause since they can define the pause in terms of the [...]
Outline:
(00:57) The good version of unilateral pausing is good
(04:50) Scott thinks the good version of unilateral pausing is good, or at least exempts it from criticism
(06:28) Oversimplified game theory is bad, and you should feel bad
(07:51) "Some definition" hides dragons
(10:17) Promises can be harder than actions
(11:52) How many frontier labs are there?
(12:20) Definitional fairness is less important than survival
---
First published:
November 3rd, 2026
Source:
https://www.lesswrong.com/posts/enzpS72uDmomiWN7a/against-strawmanning-unilateral-pauses
---
Narrated by TYPE III AUDIO.
Język angielski
Stany Zjednoczone
TRANSKRYPCJA 🔗
Are you the producer of this podcast?
Add a podcast transcript
Need Audio-to-Text?
Transcribe with Listen411 in Just 60 Seconds
WYSZUKAJ MINIONE ODCINKI
Wyszukaj minione odcinki LessWrong (Curated & Popular).
INNE ODCINKI W TYM PODCASCIE
TL;DR: Meta's open-weights model Muse Spark Open often mentions a "Charter" in its chain of thought. By eliciting it piece by piece, I reconstructed a large part of that document from the CoT. You can explore the reconstruction here, with passages linked to the transcripts that produ…
My go-to conceptual metaphor of the epistemic state of AI lab employees is microdosing LSD: being in a chronically mildly altered state of mind. I think understanding this would be broadly helpful for people both inside and outside. The effect isn’t that insiders hold crazy beliefs, but a combinati…
Summary
Following an intense viral infection in 2019, I became ill with a mysterious chronic illness, which became progressively worse until mid-2024 when I became partially bedbound with dozens of debilitating symptoms that normal humans only experience in the months/weeks/days leading up to…
I gave a 20-minute talk in Delhi at the NDTV World Summit. The audience consisted of Indian policymakers, executives, and journalists. I’ve transcribed the talk and included some highlight clips. I also reflect on several rhetorical decisions I made. The talk There's an interactive element her…
The AI Futures Project distinguishes several different plans for navigating the AI transition, which I'll lump into two broader categories: Plan A (my combination of their Plan A/S/Other) involves working for a global pause on AI development, hopefully lasting decades. During this pause, we ei…
Zastrzeżenie: Podcast i grafika osadzone na tej stronie pochodzą z LessWrong, który jest własnością jego właściciela i nie jest powiązany ani wspierany przez Listen Notes, Inc.
EDYTUJ
Dziękujemy za pomoc w aktualizowaniu podcastowej bazy danych.