Discussion: Challenges with Unsupervised LLM Knowledge Discovery
TL;DR: Contrast-consistent search (CCS) seemed exciting to us and we were keen to apply it. At this point, we think it is unlikely to be directly helpful for implementations of alignment strategies (>95%). Instead of finding knowledge, it seems to find the most prominent feature. We are less sure a…
AF - Discussion: Challenges with Unsupervised LLM Knowledge Discovery by Seb Farquhar
Welcome to The Nonlinear Library, where we use Text-to-Speech software to convert the best writing from the Rationalist and EA communities into audio. This is: Discussion: Challenges with Unsupervised LLM Knowledge Discovery, published by Seb Farquhar on December 18, 2023 on The AI Alignment Forum.…
AF - Discussion: Challenges with Unsupervised LLM Knowledge Discovery by Seb Farquhar
Link to original articleWelcome to The Nonlinear Library, where we use Text-to-Speech software to convert the best writing from the Rationalist and EA communities into audio. This is: Discussion: Challenges with Unsupervised LLM Knowledge Discovery, published by Seb Farquhar on December 18, 2023 on…
“Chain of Thought Monitorability: A New and Fragile Opportunity for AI Safety” by Tomek Korbak, Mikita Balesni, Vlad Mikulik, Rohin Shah
Twitter | Paper PDF Seven years ago, OpenAI five had just been released, and many people in the AI safety community expected AIs to be opaque RL agents. Luckily, we ended up with reasoning models that speak their thoughts clearly enough for us to follow along (most of the time). In a new multi-org …
"Gemma Needs Help" by Anna Soligo
This work was done with William Saunders and Vlad Mikulik as part of the Anthropic Fellows programme. The full write-up is available here. Thanks to Arthur Conmy, Neel Nanda, Josh Engels, Dillon Plunkett, Tim Hua and many others for their input. If you repeatedly tell Gemma 27B its answer is wrong,…
CÔNG CỤ TÌM KIẾM PODCAST
Bạn có thể sử dụng trang web của chúng tôi để tìm kiếm các podcast3,837,450và các tập197,882,542theo người, địa điểm hoặc chủ đề.
Đầu tư vào tri thức luôn mang lại lợi ích lớn nhất, vì vậy tôi nghe podcast.
‐ Benjamin "Llamacorn" Franklin
CHỈNH SỬA
Cảm ơn bạn đã giúp cơ sở dữ liệu podcast luôn cập nhật.