The Replication Crisis Changed Psychology. Did It Fix It? | Brian Nosek

Brian Nosek is the cofounder and Executive Director of the Center for Open Science. He co-developed the Implicit Association Test, a method that advanced the study of implicit bias. He then co-founded three non-profit organizations: Project Implicit to advance research about implicit bias, the Society for the Improvement of Psychological Science to improve the research culture in his home discipline, and the Center for Open Science (COS) to improve rigor, transparency, integrity, and reproducibility across research disciplines. He led the Reproducibility Project in Psychology, a replication of 100 studies from psychology, as well as multiple other replication projects, along with policy reforms such as open science badges, and the investigation of prediction markets for study replication.

CONTACT RANDY:

Feedback: metasciencematters@gmail.com

EPISODE LINKS:

Estimating the reproducibility of psychological science (Reproducibility Project in Psychology led by Brian Nosek):

https://www.science.org/doi/10.1126/science.aac4716

False-Positive Psychology: Undisclosed Flexibility in Data Collection and Analysis Allows Presenting Anything as Significant:

https://journals.sagepub.com/doi/10.1177/0956797611417632

What is replication?:

https://journals.plos.org/plosbiology/article?id=10.1371/journal.pbio.3000691

Metascience conference:

https://metascience.info/

International Conference on the Science of Science and Innovation:

https://icssi.org/

International Congress on Peer Review and Scientific Publication:

https://peerreviewcongress.org/

MetaROR:

https://metaror.org/

OUTLINE:

0:00 - Introduction

2:56 - Brian's origin story as a psychologist

6:35 - Initial interest in metascience 

10:57 - "Scientific Utopia," starting the Reproducibility Project in Psychology, and major fraud cases

17:57 - How did the Reproducibility Project in Psychology come together?

23:40 - Results of the Reproducibility Project in Psychology

27:03 - Response from the field, institutional changes

30:39 - Advice for high school/undergrad listeners

34:03 - Outro