Publications, Preprints, Policy Briefs, Op-Eds, Shiny Apps, Data & R-packages


Academic peer-reviewed publications


Citation Chart
Details on Google Scholar

This page showcases the diverse scholarly and public-facing outputs produced by FORRT and its community—including peer-reviewed publications, preprints, policy briefs, opinion pieces, interactive apps, datasets, and open-source tools. It reflects our ongoing efforts to contribute to scientific discourse, inform policy, and promote open, inclusive, and transparent research practices. Whether you’re a researcher, educator, or policymaker, this hub provides access to FORRT’s evolving body of work. Dive in to discover, cite, or collaborate.


Published 2026

No room at the inn? The case for dedicated replication journals

Reed, W. R., Röseler, L., Saam, M., & Wallrich, L.
Journal of Behavioral and Experimental Economics

Replication is widely recognized as essential for scientific self-correction, yet published replications remain exceedingly rare in both economics and psychology. At the same time, large-scale collaborative replication efforts and growing attention to research transparency have revealed widespread reproducibility failures across empirical research. This article reviews evidence on the scarcity of published replications, examines why traditional journals continue to resist publishing them, and evaluates the “first-best” proposal that journals should publish replications of their own articles. It then surveys alternative models that journals have adopted, such as dedicated replication sections and special replication issues, and considers their limitations in overcoming structural barriers to replication. Because these approaches have not meaningfully expanded the publication of replications, the article argues that dedicated replication journals offer an essential and complementary solution. By providing a stable, credible, and visible home for replication work, these journals supply critical infrastructure for the self-correcting function of science.

Cite:
Reed, W. R., Röseler, L., Saam, M., and Wallrich, L. (2026). No room at the inn? The case for dedicated replication journals. Journal of Behavioral and Experimental Economics, 120, 102502. https://doi.org/10.1016/j.socec.2025.102502
Published 2025

Mapping Open Science Communities in Psychology: A Systematic Narrative Review

Skubera Magda, Korbmacher Max, Evans Thomas Rhys, Azevedo Flavio and Pennington Charlotte R.
Royal Society Open Science

We have written a manuscript, entitled International Initiatives to Enhance Awareness and Uptake of Open Research in Psychology: A Systematic Mapping Review, which outlines the global landscape of Open Science initiatives within psychology. This postprint provides a systematic review of 187 initiatives, categorized into procedural, structural, and community-based changes.

Cite:
Skubera, M., Korbmacher, M., Evans, T. R., Azevedo, F., and Pennington, C. R. (2025). International initiatives to enhance awareness and uptake of open research in psychology: a systematic mapping review. R. Soc. Open Sci., 12, 241726. https://doi.org/10.1098/rsos.241726
Published 2025

A Community Model for Rigorous and Inclusive Scholarship

Röseler, L., Wallrich, L., Adler, S., Oppong Boakye, P., Evans, T. R., Goltermann, J., Haven, T., Horstmann, J., Korbmacher, M., Müller, M., Verheyen, S., Visser, I., & Azevedo, F.
Replication Research

Reproducibility and replicability are vital for trustworthy, cumulative research, yet remain undervalued in most areas of academic publishing. Replication Research (R2) is a Diamond Open Access journal dedicated to publishing high-quality reproductions, replications, and related methodological work across disciplines. With robust standards for transparency, open peer review, and social responsibility, R2 offers practical guidance and support for authors. We aim to rebalance research culture by valuing diligence and robustness alongside innovation, thereby increasing confidence in research findings. We invite researchers to contribute to and benefit from an open, community-driven journal designed to elevate the status and impact of replications (repeated studies of published findings with different data) and reproductions (repeated tests of published findings with the same data). In this editorial, we introduce the aims, policies, and scope of Replication Research, outlining how the journal will operate and the values that guide it.

Cite:
Röseler, L., Wallrich, L., Adler, S., Oppong Boakye, P., Evans, T. R., Goltermann, J., Haven, T., Horstmann, J., Korbmacher, M., Müller, M., Verheyen, S., Visser, I., & Azevedo, F. (2025). A Community Model for Rigorous and Inclusive Scholarship: Inaugural Editorial of Replication Research (R2). Replication Research, 1. https://doi.org/10.17879/replicationresearch-2025-9022
Published 2025

Bridging Neurodiversity and Open Scholarship: How Shared Values Can Guide Best Practices for Research Integrity, Social Justice, and Principled Education

Phan, J. M., Middleton, S. L., Azevedo, F., Iley, B. J., Grose-Hodge, M., Tyler, S. L., Kapp, S. K., Yeung, S. K., Shaw, J. J., Hartmann, H., & FORRT.
Journal of Social Issues

Not all people conform to socially constructed norms, nor should they have to. Neurodiversity, the natural variation in human brains and cognition, is fundamental to understanding human behavior, yet neurodivergent individuals in academia are often stigmatized, undervalued, or pressured to mask their differences. This position statement, authored predominantly by neurodivergent scholars, explores how aligning the values of the neurodiversity movement with practices of Open Scholarship (OSch) can foster greater research integrity, rigor, social responsibility and justice, diversity, equity, inclusivity, and accessibility in academia. We review systemic barriers faced by neurodivergent researchers—from disclosure dilemmas and hidden curriculum expectations to intersectional disadvantages—and identify how OSch principles (transparency, accessibility, collaboration) can help mitigate these challenges. Drawing on lived experiences and current research, we propose concrete reforms, including adopting universal design in scholarly communication, promoting participatory research methods, and enacting supportive policies (e.g., flexible work arrangements, inclusive codes of conduct). By leveraging shared values of openness and neuro-inclusion, academia can become more just and epistemically equitable. Our recommendations chart a path toward an academic culture where neurodivergent scholars can thrive openly, to the benefit of scientific rigor and social justice alike.

Cite:
Phan, J. M., et al. (2025). Bridging neurodiversity and open scholarship: How shared values can guide best practices for research integrity, social justice, and principled education. Journal of Social Issues, 81(4), e70035. https://doi.org/10.1111/josi.70035
Published 2024

An annotated introductory reading list for neurodiversity

Mirela Zaneva, Tao Coll-MartĂ­n, Yseult HĂ©jja-Brichard, Tamara Kalandadze, Andrea Kis, Alicja Koperska, Marie Adrienne Robles Manalili, … Alyssa Hillary Zisk
eLife

Since its inception, the concept of neurodiversity has been defined in a number of different ways, which can cause confusion among those hoping to educate themselves about the topic. To address such barriers, we present an annotated reading list that was developed collaboratively by a neurodiverse group of researchers.

Cite:
Zaneva, M., et al. (2024). An annotated introductory reading list for neurodiversity. eLife, 13, e102467. https://doi.org/10.7554/eLife.102467
Published 2024

The Replication Database: Documenting the Replicability of Psychological Science

Röseler, L., Kaiser, L., Doetsch, C., Klett, N., Seida, C., SchĂĽtz, A., Aczel, B., … & Zhang, Y.
Journal of Open Psychology Data

We have written a manuscript about documenting and tracking replication efforts. In psychological science, replicability is critical for affirming the validity of scientific findings. Addressing this crucial gap, we present the Replication Database, a novel platform hosting >1,200 original findings paired with replication findings.

Cite:
Röseler, L., et al. (2024). The replication database: Documenting the replicability of psychological science. Journal of Open Psychology Data, 12(8), 1–23. https://doi.org/10.5334/jopd.101
Published 2023

The Impact of Open Scholarship on Students’ Learning Outcomes (Scoping Review)

Pownall, M., Azevedo, F., König, L. M., Slack, H. R., Evans, T. R., Flack, Z., … & FORRT.
Royal Society Open Science

We have written a manuscript entitled Teaching open and reproducible scholarship: a critical review of the evidence base for current pedagogical methods and their outcomes. This manuscript describes the available (empirical) evidence of the impact (and importance) of integrating open scholarship into higher education.

Cite:
Pownall, M., et al. (2023). Teaching open and reproducible scholarship: A critical review of the evidence base for current pedagogical methods and their outcomes. Royal Society Open Science, 10(5), 221255. https://doi.org/10.1098/rsos.221255
Published 2023

Improvements since the Replication Crisis: The Structural, Procedural, and Community Changes

Korbmacher, M., Azevedo, F., Pennington, C. R., Hartmann, H., Pownall, M., Schmidt, K., … & Evans, T.
Communications Psychology

We have written a manuscript entitled The replication crisis has led to positive structural, procedural, and community changes. This manuscript reviews how research structures, procedures and communities have changed in response to the replication crisis, showing that the replication ‘crisis’ has been a positive credibility revolution.

Cite:
Korbmacher, M., et al. (2023). The replication crisis has led to positive structural, procedural, and community changes. Communications Psychology, 1, 3. https://doi.org/10.1038/s44271-023-00003-2
Published 2023

Participatory Research Primer

Gourdon-Kanhukamwe, A., Kalandadze, T., Yeung, S., Azevedo, F., Iley, B. J., Phan, J. M., … Elsherif, M. M.
The Cognitive Psychology Bulletin

We have written a manuscript entitled Opening up understanding of neurodiversity: A call for applying participatory and open scholarship practices. This manuscript gives a brief overview of what participatory research methods are and why they are important for promoting neurodiversity in academia.

Cite:
Gourdon-Kanhukamwe, A., et al. (2023). Opening up understanding of neurodiversity: A call for applying participatory and open scholarship practices. The Cognitive Psychology Bulletin, 8, 23-27. https://doi.org/10.53841/bpscog.2023.1.8.23
Published 2022

FORRT’s Glossary

Parsons, S., Azevedo, F., Elsherif, M. M., Guay, S., Shahim, O. N., Govaart, G. H., … Aczel, B.
Nature Human Behaviour

In response to the varied and plural new terminology introduced by the open scholarship movement, we have produced a community and consensus-based Glossary to facilitate education and effective communication. This manuscript presents the beta 0.1 version of our glossary.

Cite:
Parsons, S., et al. (2022). A community-sourced glossary of open scholarship terms. Nature Human Behaviour, 6(3), 312-318. https://doi.org/10.1038/s41562-021-01269-4
Published 2021

The Role of Pedagogical Communities

Azevedo, F., Liu, M., Pennington, C. R., Pownall, M., Evans, T. R., Parsons, S., … & FORRT.
BMC Research Notes

We have written a manuscript entitled Towards a culture of open scholarship: The role of pedagogical communities describing the need to integrate open scholarship principles into research training within higher education.

Cite:
Azevedo, F., et al. (2021). Towards a culture of open scholarship: The role of pedagogical communities. BMC Research Notes, 15(1), 1-5. https://doi.org/10.1186/s13104-022-05944-1
Published 2021

FORRT’s Lesson Plans

Pownall, M., Azevedo, F., Aldoh, A., Elsherif, M. M., Vasilev, M. R., Pennington, C. R., … Parsons, S.
Scholarship of Teaching and Learning in Psychology

We compiled lesson plans and activities, and categorized them based on their theme, learning outcome, and method of delivery, which are made publicly available.

Cite:
Pownall, M., et al. (2021). Embedding open and reproducible science into teaching: A bank of lesson plans and resources. Scholarship of Teaching and Learning in Psychology. https://doi.org/10.1037/stl0000307

Preprints


Preprint 2025

In Pursuit of Citational Justice: A Toolkit for Equitable Scholarship

Sauvé, S. A., Middleton, S. L., Gellersen, H., & Azevedo, F.
MetaArxiv

This paper unpacks the concept of citation politics and its role in sustaining epistemic hierarchies within scholarly communities. We introduce a comprehensive and openly accessible Citational Justice Toolkit.

Cite:
Sauvé, S. A., Middleton, S. L., Gellersen, H., and Azevedo, F. (2025). In pursuit of citational justice: A toolkit for equitable scholarship. MetaArXiv. https://doi.org/10.31222/osf.io/qjecy_v2
Preprint 2022

Neurodiversity & Open Scholarship in Academia

Elsherif, M. M., Middleton, S. L., Phan, J. M., Azevedo, F., Iley, B. J., Grose-Hodge, M., … Dokovova, M.
MetaArxiv

We have written a manuscript entitled Bridging Neurodiversity and Open Scholarship: How Shared Values Can Guide Best Practices for Research Integrity, Social Justice, and Principled Education explaining that Neurodiversity is fundamental to the understanding of human behaviour and cognition.

Cite:
Elsherif, M. M., et al. (2022). Bridging neurodiversity and open scholarship: How shared values can guide best practices for research integrity, social justice, and principled education. MetaArXiv. https://doi.org/10.31222/osf.io/k7a9p
preprint 2019

FORRT’s Manifesto

Azevedo, F., Parsons, S., Micheli, L., Strand, J., Rinke, E., … & FORRT
OSF Preprints

We have written a manuscript entitled Introducing a Framework for Open and Reproducible Research Training (FORRT) describing the importance of integrating open scholarship into higher education.

Cite:
Azevedo, F., et al. (2019). Introducing a framework for open and reproducible research training (FORRT). OSF Preprints. https://doi.org/10.31219/osf.io/bnh7p

Op-Eds and Other Media

Op-Ed 2024

Unveiling the Truth in Science

Azevedo, F., Hartmann, H., Röseler, L., Wallrich, L., & Micheli, L.
Official PLOS Blog

For the Official PLoS Blog, on creating a comprehensive, dynamic database cataloging scientific claims and subsequent replication attempts across various disciplines of social, cognitive, and behavioral sciences.

Cite:
Azevedo, F., et al. (2024). Unveiling the truth in science. The Official PLOS Blog. https://theplosblog.plos.org/2024/02/unveiling-the-truth-in-science-the-quest-for-reliable-knowledge/
Op-Ed 2023

Open Scholarship Pedagogical Communities

Azevedo, F.
The Psychologist

For The Psychologist, on open scholarship pedagogical communities.

Cite:
Azevedo, F. (2023). Open scholarship pedagogical communities. The Psychologist. https://www.bps.org.uk/psychologist/open-scholarship-pedagogical-communities
Letter 2023

Letter to UNESCO’s Principles of Open Science Monitoring

FORRT
UNESCO

The Letter to UNESCO’s Principles of Open Science Monitoring.

Cite:
FORRT. (2023). Letter to UNESCO’s Principles of Open Science Monitoring. UNESCO. https://www.unesco.org/education/letter-to-unescos-principles-of-open-science-monitoring
Op-Ed 2022

Navigating Academia as Neurodivergent Researchers

Azevedo, F., Middleton, S., Mai Phan, J., Kapp, S., Gourdon-Kanhukamwe, A., Iley, B., Elsherif, M., & Shaw, J. J.
APS Observer

For the Observer, of the Association for Psychological Science, on Navigating Academia as Neurodivergent Researchers.

Cite:
Azevedo, F., et al. (2022). Navigating academia as neurodivergent researchers: Promoting neurodiversity within open scholarship. APS Observer. https://www.psychologicalscience.org/observer/gs-navigating-academia-as-neurodivergent-researchers
Op-Ed 2022

What is ‘Open Science’? And why does it need a glossary?

Azevedo, F., Baum, M., Hartmann, H., Micheli, L., Spitzer, L., & Wingen, T.
In-Mind Magazine

For In-Mind Magazine, on What is Open Science and Why Does It Need a Glossary.

Cite:
Azevedo, F., et al. (2022). What is ‘Open Science’? And why does it need a glossary? In-Mind Magazine. https://de.in-mind.org/blog/post/was-ist-offene-wissenschaft-und-warum-braucht-sie-ein-woerterbuch
Op-Ed 2022

Educating in the Open Scholarship Era

Azevedo, F.
Center for Open Science Blog

For the Center of Open Science Blog, on Integrating Open and Reproducible Science Principles into Higher Education.

Cite:
Azevedo, F. (2022). Educating in the open scholarship era. Center for Open Science (COS). https://www.cos.io/blog/educating-in-the-open-scholarship-eara

Policy Briefs


Policy Brief 2023

Open Scholarship in QAA Briefing

Azevedo, F., DeBruine, L., Evans, T. R.
QAA / UKRN

FORRT was asked by the UK’s Quality Assurance Agency for Higher Education (QAA) to produce a short briefing note in collaboration with the UK Reproducibility Network (UKRN).

Cite:
Azevedo, F., DeBruine, L., and Evans, T. R. (2023). Open scholarship in QAA briefing. QAA/UKRN. https://www.qaa.ac.uk/forrt-open-scholarship-in-qaa-briefing
Policy Brief 2021

Building Community (UK Parliament)

Azevedo, F., Liu, M., Pennington, C. R., … & FORRT.
UK Parliament Science & Technology

FORRT responded to the call from the UK House of Commons Science and Technology Committee for evidence on reproducibility and research integrity.

Cite:
Azevedo, F., et al. (2021). Towards a culture of open scholarship: The role of pedagogical communities. UK Parliament Science & Technology Committee, Report No. RRE0080. https://www.parliament.uk/documents/science-and-technology-committee/2021-22/21-22-0080/
Policy Brief 2020

Briefing Note for Degree Accrediting Societies

Parsons, S., Azevedo, F., & FORRT
UKRN / BPS

We have written to UKRN (UK’s Reproducibility Network) and the British Psychological Society (BPS) a short note on our organization and goals.

Cite:
Parsons, S., Azevedo, F., and FORRT (2020). Briefing note for degree accrediting societies. Framework for Open and Reproducible Research Training. https://forrt.org/

FORRT affiliated projects


Published 2025

A scoping review on metrics to quantify reproducibility

Heyard Rachel, Pawel Samuel, Frese Joris, … and Zellers Stephanie
Royal Society Open Science

Since no standardized approach to measuring reproducibility exists, a diverse set of metrics has emerged and a comprehensive overview is needed. We conducted a scoping review to identify large-scale replication projects that used metrics and methodological papers that proposed or discussed metrics.

Cite:
Heyard, R., et al. (2025). A scoping review on metrics to quantify reproducibility: a multitude of questions leads to a multitude of metrics. R. Soc. Open Sci., 12, 242076. https://doi.org/10.1098/rsos.242076
Published 2024

The Potential of Preregistration in Psychology

van den Akker, O. R., Bakker, M., van Assen, M. A. L. M., … Wicherts, J. M.
Psychological Methods

We used an extensive protocol to assess the producibility of preregistrations and the consistency between preregistrations and their corresponding papers for 300 psychology studies.

Cite:
van den Akker, O. R., et al. (2024). The potential of preregistration in psychology: Assessing preregistration producibility and preregistration-study consistency. Psychological Methods. https://doi.org/10.1037/met0000687

Work in Progress


Work in Progress In Prep

Open Social Psychology

Rahal, R.-M.
Open Educational Resource

Social psychology is built on a strong set of classical research paradigms and findings… This book is dedicated to tracing some of these changes, and to offering a version of record of the changing perceptions and interpretations of classic social psychology.

Cite:
Rahal, R.-M. (in preparation). Open Social Psychology. https://forrt.org/open-social-psychology/

Ongoing Projects

We are currently preparing additional manuscripts on a range of topics. To find out more about what we’re working on and how you can contribute, visit our Get Involved page.

Stay updated

Subscribe to our newsletter from FORRT to get the latest news about our initiatives.

JUST-OS Open in new tab