Transparency

Graduate Research Methods

Completion of this course will provide a foundation for the practice of science. We will wrestle with the fundamental issues for designing and executing a program of research, and in the interpretation and reporting of research results. The class is …

How to classify, detect, and manage univariate and multivariate outliers, with emphasis on pre-registration

Researchers often lack knowledge about how to deal with outliers when analyzing their data. Even more frequently, researchers do not pre-specify how they plan to manage outliers. In this paper we aim to improve research practices by outlining what …

How to Produce, Identify, and Motivate Robust Psychological Science: A Roadmap and a Response to Vize et al.

Some wish to mandate preregistration as a response to the replication crisis, while I and others caution that such mandates inadvertently cause harm and distract from more critical reforms. In this article, after briefly critiquing a recently …

Improving (Our) Science

The goal of science is to accumulate knowledge about nature. There are scientific values guiding how scientists should work, and scientific practices guiding how scientists do work. This course will examine the discrepancy between scientific values …

Is There a Free Lunch in Inference?

The field of psychology, including cognitive science, is vexed by a crisis of confidence. Although the causes and solutions are varied, we focus here on a common logical problem in inference. The default mode of inference is significance testing, …

Likelihood of Null Effects of Large NHLBI Clinical Trials Has Increased over Time

Background: We explore whether the number of null results in large National Heart Lung, and Blood Institute (NHLBI) funded trials has increased over time. Methods: We identified all large NHLBI supported RCTs between 1970 and 2012 evaluating drugs or …

Medical Product Industry Ties to Patient Advocacy Organizations’ Executive Leadership

Patient advocacy organizations (PAOs) advance patient interests through promotion of disease awareness, engagement with policymakers, and partnership with medical product manufacturers in research and development.1 However, there are concerns that, …

Moving Toward Transparent, Open, and Reproducible Prevention Science: Introduction to the Special Issue

This editorial serves as a brief introduction to this special issue of Prevention Science, entitled “Transparency, Openness, and Reproducibility: Implications for the Field of Prevention Science.” The overall goal of this special issue is to …

Open and Reproducible Research in Psychology

Psychological research is in the midst of what has been called the “replication crisis”, in which questions have been raised about the validity of even seminal research findings. How can we tell if the research we’re reading and doing is rigorous and …

Opening open science to all: Demystifying reproducibility and transparency practices in linguistic research

In recent years, numerous fields of research have seen a push for increased reproducibility and transparency practices. As a result, specific transparency practices have emerged, such as open access publishing, preregistration, sharing data, …