Reproducibility Crisis and Credibility Revolution

Emerging Scientific Research Practices

This course aims to introduce students to current controversies and new developments in recommended scientific practices. The course is meant to help students think critically about how to conduct better empirical research and how to draw …

Empirical Evaluation of Very Large Treatment Effects of Medical Interventions

Context Most medical interventions have modest effects, but occasionally some clinical trials may find very large effects for benefits or harms. Objective To evaluate the frequency and features of very large effects in medicine. Data Sources Cochrane …

Enabling Open-Science Initiatives in Clinical Psychology and Psychiatry Without Sacrificing Patients’ Privacy: Current Practices and Future Challenges

The psychological and psychiatric communities are generating data on an ever-increasing scale. To ensure that society reaps the greatest utility in research and clinical care from such rich resources, there is significant interest in wide-scale, open …

Enhancing transparency of the research process to increase accuracy of findings: A guide for relationship researchers

The purpose of this paper is to extend to the field of relationship science, recent discussions and suggested changes in open research practises. We demonstrate different ways that greater transparency of the research process in our field will …

Estimating the reproducibility of psychological science

Reproducibility is a defining feature of science, but the extent to which it characterizes current research is unknown. We conducted replications of 100 experimental and correlational studies published in three psychology journals using high-powered …

Everything Hertz

A podcast about open science and psychology

Excess Success for Psychology Articles in the Journal Science

This article describes a systematic analysis of the relationship between empirical data and theoretical conclusions for a set of experimental psychology articles published in the journal Science between 2005–2012. When the success rate of a set of …

Expectations for Replications: Are Yours Realistic?

Failures to replicate published psychological research findings have contributed to a "crisis of confidence." Several reasons for these failures have been proposed, the most notable being questionable research practices and data fraud. We examine …

Facts Are More Important Than Novelty: Replication in the Education Sciences

Despite increased attention to methodological rigor in education research, the field has focused heavily on experimental design and not on the merit of replicating important results. The present study analyzed the complete publication history of the …

Faking Science: A True Story of Academic Fraud

A book about Academic Fraud