Replication Network Blog

AoI*: “Mass Reproducibility and Replicability: A New Hope” by Brodeur et al. (2024)

April 10, 2024 | By The Replication Network

Tags: GUEST BLOGS 110 reproductions/replications economics Journals Many analysts Open Science political science Re-analysis replication Reproduction

[*AoI = “Articles of Interest” is a feature of TRN where we report abstracts of recent research related to replication and research integrity.] ABSTRACT (taken from the article) “This study pushes our understanding of research reliability by producing and replicating claims from 110 papers in leading economic and political science journals.

COUPÉ: I Tried to Replicate a Paper with ChatGPT 4. Here is What I Learned.

April 8, 2024 | By The Replication Network

Tags: GUEST BLOGS AI ChatGPT Econometrics OLS Python replication Stata

Recent research suggests ChatGPT ‘ aced the test of understanding in college economics’, ChatGPT ‘ is effective in stock selection ’ , that it “ can predict future interest rate decisions” and that using ChatGPT “ can yield more accurate predictions and enhance the performance of quantitative trading strategies’. ChatGPT 4 also does econometrics: when I submitted the dataset and description of one of my econometric case studies, ChatGPT was able to ‘read’ the document, run the regressions and correctly interpret the estimates.

AoI*: “What Is the False Discovery Rate in Empirical Research?” by Engsted (2024)

April 4, 2024 | By The Replication Network

Tags: GUEST BLOGS Bayesian analysis Econ Journal Watch economics False Discovery Rate Hypothesis testing null hypothesis significance testing p-value Prior probabilities replication crisis

[*AoI = “Articles of Interest” is a feature of TRN where we report abstracts of recent research related to replication and research integrity.] ABSTRACT (taken from*** the article***) “A scientific discovery in empirical research, e.g., establishing a causal relationship between two variables, is typically based on rejecting a statistical null hypothesis of no relationship.

AoI*: “Estimating the Extent of Selective Reporting: An Application to Economics” by Bruns et al. (2024)

February 27, 2024 | By The Replication Network

Tags: GUEST BLOGS Meta-analyses p-values Publication selection Selective reporting

[*AoI = “Articles of Interest” is a feature of TRN where we report abstracts of recent research related to replication and research integrity.] ABSTRACT (taken from the article) “Using a sample of 70,399 published p-values from 192 meta-analyses, we empirically estimate the counterfactual distribution of p-values in the absence of any biases.

AoI*: “Reproduction and Replication at Scale” by Brodeur et al. (2024)

January 27, 2024 | By The Replication Network

Tags: GUEST BLOGS Nature Human Behavior replication Replication Games Replication Initiative Reproduction

[*AoI = “Articles of Interest” is a feature of TRN where we report excerpts of recent research related to replication and research integrity.] EXCERPTS (taken from the article) “We are thrilled to announce that we are broadening our focus to new disciplines through a collaboration with Nature Human Behaviour. As part of this collaboration, we will be reproducing and replicating as many studies as possible of those that are published in Nature Human Behaviour (from 2023 and going forward), including in the fields of anthropology, epidemiology, economics, management, politics and psychology.

AoI*: “Promoting Reproducibility and Replicability in Political Science” by Brodeur et al. (2024)

January 24, 2024 | By The Replication Network

Tags: GUEST BLOGS Journal policies political science Replicability Reproducibility

[*AoI = “Articles of Interest” is a feature of TRN where we report abstracts of recent research related to replication and research integrity.] ABSTRACT (taken from the article) “This article reviews and summarizes current reproduction and replication practices in political science. We first provide definitions for reproducibility and replicability. We then review data availability policies for 28 leading political science journals and present the results from a survey of editors about their willingness to publish comments and replications.

AoI*: “Do Pre-Registration and Pre-Analysis Plans Reduce p-Hacking and Publication Bias? Evidence from 15,992 Test Statistics and Suggestions for Improvement” by Brodeur et al. (2023)

January 10, 2024 | By The Replication Network

Tags: GUEST BLOGS economics p-hacking Pre-Analysis plans Pre-registration publication bias

[*AoI = “Articles of Interest” is a feature of TRN where we report excerpts of recent research related to replication and research integrity.] EXCERPTS (taken from the article) “Pre-registration is regarded as an important contributor to research credibility. We investigate this by analyzing the pattern of test statistics from the universe of randomized controlled trials (RCT) studies published in 15 leading economics journals.

AoI*: “Conventional Wisdom, Meta-Analysis, and Research Revision in Economics” by Gechert et al. (2023)

December 27, 2023 | By The Replication Network

Tags: GUEST BLOGS Conventional wisdom maer-net Meta-analysis publication bias

[*AoI = “Articles of Interest” is a feature of TRN where we report excerpts of recent research related to replication and research integrity.] EXCERPT (taken from the article) “The purpose of this study is to compare the findings of influential meta-analyses to the ‘conventional wisdom’ about the same economic question or issue.

REED: Doing Meta-Analyses with PCCs? Here’s Something You Might Not Know

December 15, 2023 | By The Replication Network

Tags: GUEST BLOGS Bias Chris Doucouliagos Inverse variance weighting maer-net Meta-analysis Partial Correlation Coefficients PCC Robbie van Aert Tom Stanley Variance Weighted Least Squares

[This blog first appeared at the MAER-Net Blog under the title “Something I Recently Learned About PCCs That Maybe You Also Didn’t Know”, see here] While TRN is primarily dedicated to replications in economics, I also do research on meta-analysis. As such, I try to attend the Meta-Analysis in Economics Research Network (MAER-Net) Colloquium every year.

AoI*: “Prosocial motives underlie scientific censorship by scientists: A perspective and research agenda” by Clark et al. (2023)

November 28, 2023 | By The Replication Network

Tags: GUEST BLOGS Peer scholars Prosocial concerns Science Scientific censorship Self-protection

[*AoI = “Articles of Interest” is a feature of TRN where we report abstracts of recent research related to replication and research integrity.] ABSTRACT (taken from the article) “Science is among humanity’s greatest achievements, yet scientific censorship is rarely studied empirically. We explore the social, psychological, and institutional causes and consequences of scientific censorship (defined as actions aimed at obstructing particular scientific ideas from reaching an audience for reasons other than low scientific quality).

Replication Network Blog

Recent Blog Posts

Help us improve the FORRT website