# Rohin Shah

ထိပ်တန်း Podcast တခုကိုဖြစ်စဉ်များ
နောက်ဆုံးပေါ်:

“Chain of Thought Monitorability: A New and Fragile Opportunity for AI Safety” by Tomek Korbak, Mikita Balesni, Vlad Mikulik, Rohin Shah

Twitter | Paper PDF Seven years ago, OpenAI five had just been released, and many people in the AI safety community expected AIs to be opaque RL agents. Luckily, we ended up with reasoning models that speak their thoughts clearly enough for us to follow along (most of the time). In a new multi-org …

Rohin Shah on the State of AGI Safety Research in 2021

Rohin Shah, Research Scientist on DeepMind's technical AGI safety team, joins us to discuss: AI value alignment; how an AI Researcher might decide whether to work on AI Safety; and why we don't know that AI systems won't lead to existential risk.  Topics discussed in this episode include: - Inner…

AIAP: An Overview of Technical AI Alignment in 2018 and 2019 with Buck Shlegeris and Rohin Shah

Just a year ago we released a two part episode titled An Overview of Technical AI Alignment with Rohin Shah. That conversation provided details on the views of central AI alignment research organizations and many of the ongoing research efforts for designing safe and aligned systems. Much has happe…

AIAP: An Overview of Technical AI Alignment with Rohin Shah (Part 2)

The space of AI alignment research is highly dynamic, and it's often difficult to get a bird's eye view of the landscape. This podcast is the second of two parts attempting to partially remedy this by providing an overview of technical AI alignment efforts. In particular, this episode seeks to cont…

AIAP: An Overview of Technical AI Alignment with Rohin Shah (Part 1)

The space of AI alignment research is highly dynamic, and it's often difficult to get a bird's eye view of the landscape. This podcast is the first of two parts attempting to partially remedy this by providing an overview of the organizations participating in technical AI research, their specific r…

AIAP: Inverse Reinforcement Learning and the State of AI Alignment with Rohin Shah

What role does inverse reinforcement learning (IRL) have to play in AI alignment? What issues complicate IRL and how does this affect the usefulness of this preference learning methodology? What sort of paradigm of AI alignment ought we to take up given such concerns? Inverse Reinforcement Learnin…

AI Safety Careers | Rohin Shah, Lewis Hammond and Kuhan Jeyapragasan | EAGxOxford 22

Rohin Shah (DeepMind), Lewis Hammond (Cooperative AI) and Jamie Bernardi (Centre for Effective Altruism) host a Q&A session on careers directed at solving the AI alignment problem. View the original talk and video here. Effective Altruism is a social movement dedicated to finding ways to do the mos…

AI Alignment: An Introduction | Rohin Shah | EAGxOxford 22

"You've probably heard that Elon Musk, Stuart Russell, and Stephen Hawking warn of dangers posed by AI. What are these risks, and what basis do they have in AI practice? Rohin Shah will first describe the more philosophical argument that suggests that a superintelligent AI system pursuing the wrong…

Virtual EAG 2020: What’s been happening in AI alignment? (Rohin Shah)

While we haven’t yet built aligned AI, the field of alignment has been chugging along for a few years now, producing many useful outputs. In this talk, Rohin will survey conceptual progress in AI alignment over the last two years. While the talk will assume basic knowledge of the arguments for AI r…

#245 – Rohin Shah on what it's really like to run AGI safety at Google DeepMind (and where I disagree with 'doomers')

Most people working on AI safety think without a massive effort AI systems will probably end up with goals catastrophically different from humanity’s. Today’s guest, Rohin Shah — head of AGI Safety and Alignment at Google DeepMind, and an AI safety researcher since 2017 — disagrees. “There is no pa…