Open Science

Psychology's Replication Crisis and the Grant Culture: Righting the Ship

The past several years have been a time for soul searching in psychology, as we have gradually come to grips with the reality that some of our cherished findings are less robust than we had assumed. Nevertheless, the replication crisis highlights the …

Psychology’s Credibility Revolution

In 2011, Daryl Bem published a paper that seemed to demonstrate evidence for extra sensory perception (ESP). Four years later, the Open Science Collaboration failed to replicate 67 of 100 published psychological studies. These results and others have …

Publication bias and the canonization of false facts.

Science is facing a “replication crisis” in which many experimental findings cannot be replicated and are likely to be false. Does this imply that many scientific facts are false as well? To find out, we explore the process by which a claim becomes …

Publication bias and the limited strength model of self-control: has the evidence for ego depletion been overestimated?

Few models of self-control have generated as much scientific interest as has the limited strength model. One of the entailments of this model, the depletion effect, is the expectation that acts of self-control will be less effective when they follow …

Publication Bias in Psychology: A Diagnosis Based on the Correlation between Effect Size and Sample Size

Background: The p value obtained from a significance test provides no information about the magnitude or importance of the underlying phenomenon. Therefore, additional reporting of effect size is often recommended. Effect sizes are theoretically …

Publication bias in the social sciences: Unlocking the file drawer

We studied publication bias in the social sciences by analyzing a known population of conducted studies—221 in total—in which there is a full accounting of what is published and unpublished. We leveraged Time-sharing Experiments in the Social …

Publication Prejudices: An Experimental Study of Confirmatory Bias in the Peer Review System

Confirmatory bias is the tendency to emphasize and believe experiences which support one's views and to ignore or discredit those which do not. The effects of this tendency have been repeatedly documented in clinical research. However, its …

Publication pressure and scientific misconduct in medical scientists

There is increasing evidence that scientific misconduct is more common than previously thought. Strong emphasis on scientific productivity may increase the sense of publication pressure. We administered a nationwide survey to Flemish biomedical …

Quality Uncertainty Erodes Trust in Science

When consumers of science (readers and reviewers) lack relevant details about the study design, data, and analyses, they cannot adequately evaluate the strength of a scientific study. Lack of transparency is common in science, and is encouraged by …

Quantitative Emerging Practices and Methods in Psychology

Recently, a reporter in the Chronicle of Higher Education wrote that “psychology is having an uneasy moment” (Zamudio-Suarez, 2016). The “uneasy moment” to which she referred is a movementof field self-criticism that has gained incredible steam and …