Replicability

A Replication Crisis in Methodological Research?

Statisticians have been keen to critique statistical aspects of the “replication crisis” in other scientific disciplines. But new statistical tools are often published and promoted without any thought to replicability. This needs to change, argue …

Challenges and opportunities in preregistration of coordinated data analysis: A tutorial and template

The credibility revolution in social science has led to the recommendation and adoption of practices to increase the replicability of scientific findings. Many of the recommended practices, such as replication and preregistration, present unique …

Incorporating ecological momentary assessment into multimethod investigations of cognitive aging: Promise and practical considerations

Ecological momentary assessment (EMA) represents a promising approach to study cognitive aging. In contrast to laboratory-based studies, EMA involves the repeated sampling of experiences in daily life contexts, enabling investigators to gain access …

Opening open science to all: Demystifying reproducibility and transparency practices in linguistic research

In recent years, numerous fields of research have seen a push for increased reproducibility and transparency practices. As a result, specific transparency practices have emerged, such as open access publishing, preregistration, sharing data, …

Preregistration of Analyses of Preexisting Data

The preregistration of a study’s hypotheses, methods, and data-analyses steps is becoming a popular psychological research practice. To date, most of the discussion on study preregistration has focused on the preregistration of studies that include …

Preregistration of Studies with Existing Data

Preregistration of research plans is becoming an increasingly popular and common tool to enhance the transparency of a study’s methodology. In a preregistration, researchers document their research plans and register them to a public repository prior …

Re-run, Repeat, Reproduce, Reuse, Replicate: Transforming Code into Scientific Contributions

Scientific code is different from production software. Scientific code, by producing results that are then analyzed and interpreted, participates in the elaboration of scientific conclusions. This imposes specific constraints on the code that are …

Sources of nonreplicability in aging ethnoracial health disparities research

The older adult population in the U.S. is becoming increasingly diverse across a constellation of factors including ethnoracial group, socioeconomic status, and immigration status. However, our understanding of the consequences of this diversity for …

The Meaningfulness of Effect Sizes in Psychological Research: Differences Between Sub-Disciplines and the Impact of Potential Biases

Effect sizes are the currency of psychological research. They quantify the results of a study to answer the research question and are used to calculate statistical power. The interpretation of effect sizes—when is an effect small, medium, or …

The trustworthiness of the cumulative knowledge in industrial/organizational psychology: The current state of affairs and a path forward

The goal of industrial/organizational (IO) psychology, is to build and organize trustworthy knowledge about people-related phenomena in the workplace. Unfortunately, as with other scientific disciplines, our discipline may be experiencing a “crisis …