AoI*: “The Robustness Reproducibility of the American Economic Review” by Campbell et al. (2024)

[*AoI = “Articles of Interest” is a feature of TRN where we report abstracts of recent research related to replication and research integrity.]

ABSTRACT (taken from the article)

“We estimate the robustness reproducibility of key results from 17 non-experimental AER papers published in 2013 (8 papers) and 2022/23 (9 papers). We find that many of the results are not robust, with no improvement over time. The fraction of significant robustness tests (p<0.05) varies between 17% and 88% across the papers with a mean of 46%. The mean relative t/z-value of the robustness tests varies between 35% and 87% with a mean of 63%, suggesting selective reporting of analytical specifications that exaggerate statistical significance. A sample of economists (n=359) overestimates robustness reproducibility, but predictions are correlated with observed reproducibility.”

REFERENCE

Campbell, Douglas et al. (2024) : The Robustness Reproducibility of the American Economic Review, I4R Discussion Paper Series, No. 124, Institute for Replication (I4R), s.l.

Share this:

• Click to share on X (Opens in new window) X
• Click to share on Facebook (Opens in new window) Facebook

Like Loading…