Reproducibility Crisis and Credibility Revolution

The crisis of confidence in social psychology.

Notes that social psychologists' early enthusiasm has been replaced by serious doubts about the future of their field. Difficulties in conducting research, unfulfilled expectations about research payoffs, and outside pressures had all contributed to …

The effect of horizontal eye movements on free recall: A preregistered adversarial collaboration.

A growing body of research has suggested that horizontal saccadic eye movements facilitate the retrieval of episodic memories in free recall and recognition memory tasks. Nevertheless, a minority of studies have failed to replicate this effect. This …

The empirical benefits of conceptual rigor: Systematic articulation of conceptual hypotheses can reduce the risk of non-replicable results (and facilitate novel discoveries too)

Most discussions of rigor and replication focus on empirical practices (methods used to collect and analyze data). Typically overlooked is the role of conceptual practices: the methods scientists use to arrive at and articulate research hypotheses in …

The Empirical March: Making Science Better at Self-Correction

Psychology has been criticized recently for a range of research quality issues. The current article organizes these problems around the actions of the individual researcher and the existing norms of the field. Proposed solutions align the incentives …

The existence of publication bias and risk factors for its occurrence.

Publication bias is the tendency on the parts of investigators, reviewers, and editors to submit or accept manuscripts for publication based on the direction or strength of the study findings. Much of what has been learned about publication bias …

The Experiment Experiment

A few years back, a famous psychologist published a series of studies that found people could predict the future — not all the time, but more often than if they were guessing by chance alone.The paper left psychologists with two options. "Either we …

The file drawer problem and tolerance for null results.

For any given research area, one cannot tell how many studies have been conducted but never reported. The extreme view of the "file drawer problem" is that journals are filled with the 5% of the studies that show Type I errors, while the file drawers …

The frequency of excess success for articles in Psychological Science.

Recent controversies have questioned the quality of scientific practice in the field of psychology, but these concerns are often based on anecdotes and seemingly isolated cases. To gain a broader perspective, this article applies an objective test …

The Generalizability of Survey Experiments

Survey experiments have become a central methodology across the social sciences. Researchers can combine experiments’ causal power with the generalizability of population-based samples. Yet, due to the expense of population-based samples, much …

The GRIM Test: A Simple Technique Detects Numerous Anomalies in the Reporting of Results in Psychology

We present a simple mathematical technique that we call granularity-related inconsistency of means (GRIM) for verifying the summary statistics of research reports in psychology. This technique evaluates whether the reported means of integer data such …