Open Science

We have to break up

Three mostly positive developments in academic psychology—the cognitive revolution, the virtual requirement for multiple study reports in our top journals, and the prioritization of mediational evidence in our data—have had the unintended effect of …

We Knew the Future All Along: Scientific Hypothesizing Is Much More Accurate Than Other Forms of Precognition-A Satire in One Part

A critique about Daryl Bem's (2011) paper and reproducibility

Welcoming Quality in Non-Significance and Replication Work, but Moving Beyond the p-Value: Announcing New Editorial Policies for Quantitative Research in JOAA

The self-correcting nature of psychological and educational science has been seriously questioned. Recent special issues of Perspectives on Psychological Science and Psychology of Aesthetics, Creativity, and the Arts have roundly condemned current …

What does research reproducibility mean?

The language and conceptual framework of “research reproducibility” are nonstandard and unsettled across the sciences. In this Perspective, we review an array of explicit and implicit definitions of reproducibility and related terminology, and …

What should a preregistration contain?

A large amount of variation exists in beliefs about the purpose and benefits of preregistration, making it difficult to implement and evaluate, and limiting its usefulness. Additionally, no single resource exists to describe what a preregistration …

What You See Is What You Get? Enhancing Methodological Transparency in Management Research

We review the literature on evidence-based best practices on how to enhance methodological transparency, which is the degree of detail and disclosure about the specific steps, decisions, and judgment calls made during a scientific study. We …

What's wrong with Psychology, anyway?

This chapter considers various factors that have been responsible for the comparatively slow development of psychology into a cumulative empirical science. Special attention is devoted to correctable methodological mistakes, the over-reliance upon …

When is science (un)reliable?

In this course, we will explore the so‐called “reproducibility crisis” that has struck fields from psychology and economics to ecology and cancer biology. You will learn statistical principles at the heart of the reproducibility crisis, how disregard …

Why and How to Use Pre-Analysis Plans

We describe what is a pre-analysis plan (PAP) and why you should use one. We emphasize the potential political uses of PAPs and, in particular, how the PAP is in this respect a uniquely powerful tool for increasing the likelihood that evidence …

Why Most Discovered True Associations Are Inflated

Newly discovered true (non-null) associations often have inflated effects compared with the true effect sizes. I discuss here the main reasons for this inflation. First, theoretical considerations prove that when true discovery is claimed based on …