Reproducibility Crisis and Credibility Revolution

What's wrong with Psychology, anyway?

This chapter considers various factors that have been responsible for the comparatively slow development of psychology into a cumulative empirical science. Special attention is devoted to correctable methodological mistakes, the over-reliance upon …

When Great Minds Think Unalike: Inside Science's 'Replication Crisis'

A podcast about replication crisis

When is science (un)reliable?

In this course, we will explore the so‐called “reproducibility crisis” that has struck fields from psychology and economics to ecology and cancer biology. You will learn statistical principles at the heart of the reproducibility crisis, how disregard …

Why Most Discovered True Associations Are Inflated

Newly discovered true (non-null) associations often have inflated effects compared with the true effect sizes. I discuss here the main reasons for this inflation. First, theoretical considerations prove that when true discovery is claimed based on …

Why psychologists must change the way they analyze their data: The case of psi: Comment on Bem (2011).

Does psi exist? D. J. Bem (2011) conducted 9 studies with over 1,000 participants in an attempt to demonstrate that future events retroactively affect people's responses. Here we discuss several limitations of Bem's experiments on psi; in particular, …

Why Psychologists’ Food Fight Matters

“Important findings” haven’t been replicated, and science may have to change its ways.

Why Summaries of Research on Psychological Theories are Often Uninterpretable

Null hypothesis testing of correlational predictions from weak substantive theories in soft psychology is subject to the influence of ten obfuscating factors whose effects are usually (1) sizeable, (2) opposed, (3) variable, and (4) unknown. The net …

You are not so smart

Psychology is working on the hardest problems in all of science. Physics, astronomy, geology — those are easy, by comparison. Understanding consciousness, willpower, ideology, social change – there’s a larger-than-Large-Hadron-Collider level of …