3ie

Capture In support of recent efforts by social scientists to address the ‘ reproducibility crisis’, the Journal of Development Effectiveness (JDEff) recently devoted a special issue on replication research studies in its last issue of 2019. Most journals continue to favor new research rather than replication work and to publish research whose data and codes have not been tested.

[This post is cross-published on FHI 360’s*** R&E Search for Evidence blog***] There are many debates about the definitions and distinctions for replication research, particularly for internal replication research, which is conducted using the original dataset from an article or study. The debaters are concerned about what kinds of replication exercises are appropriate and about how (and whether) to make determinations of “success” and “failure” for a replication.

[This post is based on a presentation by Annette Brown at the*** Workshop on Reproducibility and Integrity in Scientific Research, held at the University of Canterbury, New Zealand, on October 26, 2018. It is cross-published on FHI 360’s R&E Search for Evidence blog***] Two weeks ago, on Halloween, I wrote a post about how to conduct a replication study using an approach that emphasizes which tests might be run in order to avoid the perception of a witch hunt.

[This post is based on a presentation by Annette Brown at the Workshop on Reproducibility and Integrity in Scientific Research, held at the University of Canterbury, New Zealand, on October 26, 2018. It is cross-published on FHI 360’s R&E Search for Evidence blog] Last week I was treated to a great workshop titled “Reproducibility and Integrity in Scientific Research” at the University of Canterbury where I presented my article (joint with Benjamin D.

Academia has been abuzz in recent years with new initiatives focusing on research transparency, replication and reproducibility of research. Notable in this regard are the Berkeley Initiative for Transparency in the Social Sciences, and the Reproducibility Initiative which PLOS and Science Exchange are involved, but there are many others. Psychology and political science have had a number of new initiatives that are shaking up the scientific research and publication process.

What’s the International Initiative for Impact Evaluation ( 3ie) doing in the replication business? 3ie is mostly known in the development community as a funder of impact evaluations and systematic reviews. But our leadership always envisioned a role for replication research within 3ie’s mandate to provide high quality evidence for policymaking.