Discussion: Challenges with Unsupervised LLM Knowledge Discovery
TL;DR: Contrast-consistent search (CCS) seemed exciting to us and we were keen to apply it. At this point, we think it is unlikely to be directly helpful for implementations of alignment strategies (>95%). Instead of finding knowledge, it seems to find the most prominent feature. We are less sure a…
AF - Discussion: Challenges with Unsupervised LLM Knowledge Discovery by Seb Farquhar
Welcome to The Nonlinear Library, where we use Text-to-Speech software to convert the best writing from the Rationalist and EA communities into audio. This is: Discussion: Challenges with Unsupervised LLM Knowledge Discovery, published by Seb Farquhar on December 18, 2023 on The AI Alignment Forum.…
AF - Discussion: Challenges with Unsupervised LLM Knowledge Discovery by Seb Farquhar
Link to original articleWelcome to The Nonlinear Library, where we use Text-to-Speech software to convert the best writing from the Rationalist and EA communities into audio. This is: Discussion: Challenges with Unsupervised LLM Knowledge Discovery, published by Seb Farquhar on December 18, 2023 on…
“Chain of Thought Monitorability: A New and Fragile Opportunity for AI Safety” by Tomek Korbak, Mikita Balesni, Vlad Mikulik, Rohin Shah
Twitter | Paper PDF Seven years ago, OpenAI five had just been released, and many people in the AI safety community expected AIs to be opaque RL agents. Luckily, we ended up with reasoning models that speak their thoughts clearly enough for us to follow along (most of the time). In a new multi-org …
"Gemma Needs Help" by Anna Soligo
This work was done with William Saunders and Vlad Mikulik as part of the Anthropic Fellows programme. The full write-up is available here. Thanks to Arthur Conmy, Neel Nanda, Josh Engels, Dillon Plunkett, Tim Hua and many others for their input. If you repeatedly tell Gemma 27B its answer is wrong,…
موتور جستجوی پادکست
می توانید از وب سایت ما برای جستجوی پادکست های3,837,450و قسمت های197,882,542بر اساس افراد، مکان ها یا موضوعات استفاده کنید.
سرمایهگذاری روی دانش بیشترین بازده را دارد؛ پس پادکست گوش میدهم.
‐ Benjamin "Llamacorn" Franklin
ویرایش
از کمک شما برای بروز نگهداشتن پایگاهدادههای پادکست سپاسگزاریم