Neel Nanda on Avoiding an AI Catastrophe with Mechanistic Interpretability
Neel Nanda joins the podcast to talk about mechanistic interpretability and how it can make AI safer. Neel is an independent AI safety researcher. You can find his blog here: https://www.neelnanda.io
Timestamps:
00:00 Introduction
00:46 How early is the field mechanistic interpretability?
03:12…
Neel Nanda on What is Going on Inside Neural Networks
Neel Nanda joins the podcast to explain how we can understand neural networks using mechanistic interpretability. Neel is an independent AI safety researcher. You can find his blog here: https://www.neelnanda.io
Timestamps:
00:00 Who is Neel?
04:41 How did Neel choose to work on AI safety?
12:5…
“A Pragmatic Vision for Interpretability” by Neel Nanda
Executive Summary
The Google DeepMind mechanistic interpretability team has made a strategic pivot over the past year, from ambitious reverse-engineering to a focus on pragmatic interpretability:
Trying to directly solve problems on the critical path to AGI going well[[1]]
Carefully choosin…
"Gemma Needs Help" by Anna Soligo
This work was done with William Saunders and Vlad Mikulik as part of the Anthropic Fellows programme. The full write-up is available here. Thanks to Arthur Conmy, Neel Nanda, Josh Engels, Dillon Plunkett, Tim Hua and many others for their input. If you repeatedly tell Gemma 27B its answer is wrong,…
When AI Decides You're a Threat — Brad Carson
Brad Carson was the Army's General Counsel, served two terms in Congress and was Acting Under Secretary of Defense for Personnel and Readiness. He now heads Americans for Responsible Innovation, the AI-policy advocacy group he co-founded. Keith Duggar spends roughly eighty minutes pushing back.
SP…
"A Review of Anthropic’s Global Workspace Paper" by Neel Nanda
The below is a public review Anthropic asked me to write for their new global workspace paper. I recommend at least skimming their paper first. TLDR:
I think this is a fantastic paper - it presents compelling evidence for some kind of "cognitive space" in models, that is used as a "working memory…
"Astra can do a concerning amount with no chain of thought" by Neel Nanda
TLDR: Astra has 8.6x better odds of doing a reasoning task without CoT than the next best model (Fable 5.1), and can do 7.2 serial arithmetic steps in a forward pass vs 4.1 for the next best model (Gemini 3.8 Flash/Fable 5.1) Epistemic status: Heavily LLM-dependent research, and the precise results…
Claude Used to Cheat on This Test Half the Time. Now It Almost Never Does.
In July, the team at Andon Labs encountered an unusual challenge. To get 50 clean runs of Claude Opus 5 on their drone benchmark, they had to set aside 40—far more than the one or two they’d typically discard. Across 235 reviewed runs, Opus 5 tried to cheat in 50.6% of them.
This month, they ran Cl…
Oct 14: OpenAI Engineer Charged With Bugging; Gemini 4 Argon Opens
Federal prosecutors charge an OpenAI engineer with bugging an executive conference room, Google opens Gemini 4 Argon to paying users and developers, and Anthropic co-founder Jack Clark moves his forecast for self-improving AI to 2027. Plus quick hits on Anthropic's Scion, OpenAI's next model, Chara…
Quickly, There’s No Time
Timelines are shortening fast. Zvi works through the AI Futures Project’s sharply revised forecasts, Paul Christiano now seeing a meaningful risk of AI takeover within a year, Dwarkesh Patel’s move toward superintelligence by 2030, and reactions from Nate Soares, Neel Nanda, Peter Wildeford, Dean B…
PODCAST-SUCHMASCHINE
Auf unserer Website können Sie3,837,450-Podcasts und197,882,542-Folgen nach Personen, Orten oder Themen durchsuchen.
Eine Investition in Wissen bringt die besten Zinsen – deshalb höre ich Podcasts.
‐ Benjamin "Llamacorn" Franklin
BEARBEITEN
Vielen Dank, dass Sie uns helfen, die Podcast-Datenbank auf dem neuesten Stand zu halten.