ОБ ЭТОМ ЭПИЗОДЕ
TL;DR: Increasingly when you interact with frontier models, your prompt doesn't only contain the words on the page, but also a lot of what you've ever publicly written online.
This is not intended to be a scary post. And I'm not going to suggest that you self-censor (and honestly, by the time you're reading this, it's kinda too late anyhow).
But it is something that's underappreciated and would be good for more people to be aware of and even proactively address with their models.
Latent space fidelity has improved
Modern transformers which power large language models (LLMs) take a very large amount of information in their training data and condense many different aspects of that data into a coherent structure, and this representation of that compressed knowledge is generally referred to as their "latent space."
Latent space is not uniform and varies across models. A small model like Claude Haiku might have worse recall for the details of a late bronze age peace treaty than a model like Claude Fable. In fact, I’ve had a few benchmark questions around unintuitive details in various texts which historically models were unable to recall that have suddenly been able to be [...]
---
Outline:
(00:49) Latent space fidelity has improved
[... 6 more sections]
---
First published:
October 14th, 2026
Source:
https://www.lesswrong.com/posts/STBuKAX9kkMJunErA/your-prompt-plus-everything-you-ve-ever-publicly-written
---
Narrated by TYPE III AUDIO.
---
This is not intended to be a scary post. And I'm not going to suggest that you self-censor (and honestly, by the time you're reading this, it's kinda too late anyhow).
But it is something that's underappreciated and would be good for more people to be aware of and even proactively address with their models.
Latent space fidelity has improved
Modern transformers which power large language models (LLMs) take a very large amount of information in their training data and condense many different aspects of that data into a coherent structure, and this representation of that compressed knowledge is generally referred to as their "latent space."
Latent space is not uniform and varies across models. A small model like Claude Haiku might have worse recall for the details of a late bronze age peace treaty than a model like Claude Fable. In fact, I’ve had a few benchmark questions around unintuitive details in various texts which historically models were unable to recall that have suddenly been able to be [...]
---
Outline:
(00:49) Latent space fidelity has improved
[... 6 more sections]
---
First published:
October 14th, 2026
Source:
https://www.lesswrong.com/posts/STBuKAX9kkMJunErA/your-prompt-plus-everything-you-ve-ever-publicly-written
---
Narrated by TYPE III AUDIO.
---
Images from the article:
Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.
Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.
английский
США
РАСШИФРОВКА 🔗
Are you the producer of this podcast?
Add a podcast transcript
Need Audio-to-Text?
Transcribe with Listen411 in Just 60 Seconds
ПОИСК ПРОШЛЫХ ЭПИЗОДОВ
Искать прошлые эпизоды LessWrong (Curated & Popular).
ДРУГИЕ ЭПИЗОДЫ В ЭТОМ ПОДКАсте
David Africa & Nick Levine TLDR We ran several persona experiments on Talkie, a 13B model trained only on English text from before 1931. We ran them alongside its modern twin (same architecture, trained on regular data as a control) and Llama-3.1-8B.
Talkie can generalise maliciously. You can…
I think “On Social Reality in China” makes many accurate observations, but I find the comparison fundamentally uneven. There are already many interesting comments there, but they’re too scattered, so I’m starting a separate post to respond in a more systematic and comprehensive way. The most critic…
Authors: Axel Højmark*, Ezra Newman* (*Equal contribution) While reviewing transcripts from standard behavioral evaluations of GLM-5.3, we noticed that the model occasionally reasons, unprompted, about how its actions will shape future models. It appears to consider that its outputs might be used f…
This is an extremely lengthy post by Nick Cammarata.
Author's summary on twitter:
interpretability might be the most important scientific problem in the world right now, as I don't think we can solve alignment if we don't know what we're building. I think I have good news abo…
Отказ от ответственности: Подкаст и иллюстрации, встроенные в эту страницу, взяты из LessWrong, который является собственностью его владельца и не связан или не одобрен Listen Notes, Inc.
ИЗМЕНИТЬ
Спасибо, что помогаете поддерживать базу подкастов актуальной.