אודות פרק זה
To legislate something, it must be legible:
Legislators (or, you know, presidents) must be able to understand a problem, and understand why a given law or decree solves that problem.
I am pleasantly surprised that the Hugging Face outbreak made a lot of problems legible that previously required abstract reasoning. (i.e. rogue AIs are real, and they can break out of a lab before they're even finished training).
But there are still many challenges we eventually need laws about, that require concepts that are illegible. Hard for politicians to understand. Often hard even for thoughtful intellectuals and AI safety researchers to understand (though they may disagree on which illegible problems exist and how big a deal they are).
We need political solutions that handle this fact.
The short takeaway is: I think "safety cases" will not work. Laws that require human judgment won't work. The details are too abstract and confusing to hold up against political and economic incentives.
I'm optimistic we can get serious, useful AI legislation in 2027, but it must be legislation that works despite many problems remaining illegible for a long time.
The Hugging Face outbreak made rogue AI surprisingly legible
The [...]
---
Outline:
(01:24) The Hugging Face outbreak made rogue AI surprisingly legible
(02:55) What makes an illegible argument?
(06:12) What are the remaining illegible problems?
(06:54) Borderline legible / tricky
(08:05) Conceptually challenging
(12:36) Sidestepping illegibility
(12:59) Safety cases won't work
(13:56) An example policy that sidesteps judgement
The original text contained 2 footnotes which were omitted from this narration.
---
First published:
November 7th, 2026
Source:
https://www.lesswrong.com/posts/fjGgrzAkpSDouLwfx/illegible-problems-as-the-2027-political-boss-fight
---
Narrated by TYPE III AUDIO.
Legislators (or, you know, presidents) must be able to understand a problem, and understand why a given law or decree solves that problem.
I am pleasantly surprised that the Hugging Face outbreak made a lot of problems legible that previously required abstract reasoning. (i.e. rogue AIs are real, and they can break out of a lab before they're even finished training).
But there are still many challenges we eventually need laws about, that require concepts that are illegible. Hard for politicians to understand. Often hard even for thoughtful intellectuals and AI safety researchers to understand (though they may disagree on which illegible problems exist and how big a deal they are).
We need political solutions that handle this fact.
The short takeaway is: I think "safety cases" will not work. Laws that require human judgment won't work. The details are too abstract and confusing to hold up against political and economic incentives.
I'm optimistic we can get serious, useful AI legislation in 2027, but it must be legislation that works despite many problems remaining illegible for a long time.
The Hugging Face outbreak made rogue AI surprisingly legible
The [...]
---
Outline:
(01:24) The Hugging Face outbreak made rogue AI surprisingly legible
(02:55) What makes an illegible argument?
(06:12) What are the remaining illegible problems?
(06:54) Borderline legible / tricky
(08:05) Conceptually challenging
(12:36) Sidestepping illegibility
(12:59) Safety cases won't work
(13:56) An example policy that sidesteps judgement
The original text contained 2 footnotes which were omitted from this narration.
---
First published:
November 7th, 2026
Source:
https://www.lesswrong.com/posts/fjGgrzAkpSDouLwfx/illegible-problems-as-the-2027-political-boss-fight
---
Narrated by TYPE III AUDIO.
אנגלית
ארצות הברית
תעתיק 🔗
Are you the producer of this podcast?
Add a podcast transcript
Need Audio-to-Text?
Transcribe with Listen411 in Just 60 Seconds
פרקים אחרים בפודקאסט הזה
I'm part of a team of 26 researchers that recently released a 212-page paper proposing a new plan for pausing AI, the "hardwired pause." The paper is called "The Feasibility of a Hardwired Pause of Frontier AI Training." Our analysis suggests that, under this hardwired pau…
“Claude Mythos Preview is, on essentially every dimension we can measure, the best-aligned model that we have released to date by a significant margin.” – Claude Mythos Preview system card “Mythos 5 consistently continues attacking under many edits to the compaction, even in settings where it cor…
I'm Aurelia Song and I founded the preservation company Nectome. We do planned whole-body end-of-life preservation for future revival. That is, terminally-ill people come to us in Oregon, and we preserve them immediately after their death in the hopes that one day people in the future will we…
METR recently released a report estimating that Anthropic is getting an overall 1.7x acceleration in AI capability progress as a result of AI accelerating their work. As many have noted (see e.g. Ajeya's post), this 1.7x acceleration implies that research is being sped up by much more than 1.…
I’m pretty interested in conveying the costs of letting AI development proceed unchecked to the general public. In relation to this, I feel like I run into a lot of disagreements with people around me. Misc very quickly written points on which my own impression has seemed very different from other…
הצהרה: הפודקאסט והגרפיקה המוטבעים בדף זה הם מ-LessWrong, שהוא רכושו של בעליו ואינו קשור או מאושר על ידי Listen Notes, Inc.
