Open Science

Choosing prediction over explanation in psychology: Lessons from machine learning.

Psychology has historically been concerned, first and foremost, with explaining the causal mechanisms that give rise to behavior. Randomized, tightly controlled experiments are enshrined as the gold standard of psychological research, and there are …

Ciência aberta e reprodutível

Esta disciplina destina-se a alunos em níveis de Mestrado e Doutorado do Programade Pós-Graduação em Ciências da Saúde: Cardiologia e Ciências Cardiovasculares e outros programas de pós-graduação. A disciplina está estruturada para promover discussão …

Comparing Analysis Blinding With Preregistration in the Many-Analysts Religion Project

In psychology, preregistration is the most widely used method to ensure the confirmatory status of analyses. However, the method has disadvantages: Not only is it perceived as effortful and time-consuming, but reasonable deviations from the analysis …

Conservative tests under satisficing models of publication bias.

Publication bias leads consumers of research to observe a selected sample of statistical estimates calculated by producers of research. We calculate critical values for statistical significance that could help to adjust after the fact for the …

Constraints on generality statements are needed to define direct replication

Whether or not a replication attempt counts as “direct” often cannot be determined definitively after the fact as a result of flexibility in how procedural differences are interpreted. Specifying constraints on generality in original articles can …

Continuously Cumulating Meta-Analysis and Replicability

The current crisis in scientific psychology about whether our findings are irreproducible was presaged years ago by Tversky and Kahneman (1971), who noted that even sophisticated researchers believe in the fallacious Law of Small Numbers—erroneous …

Correcting for Bias in Psychology: A Comparison of Meta-Analytic Methods

Publication bias and questionable research practices in primary research can lead to badly overestimated effects in meta-analysis. Methodologists have proposed a variety of statistical approaches to correct for such overestimation. However, it is not …

Course materials | Project TIER

Learn about courses, in a wide range of fields at a variety of institutions, where principles and resources from Project TIER have been used to teach transparent research methods.

Crisis research, fast and slow

A blog about the crisis of research

Crowdsourced research: Many hands make tight work

Crowdsourcing research can balance discussions, validate findings and better inform policy, say Raphael Silberzahn and Eric L. Uhlmann.