Periodic Reporting for period 1 - iRISE (improving Reproducibility In SciencE)
Berichtszeitraum: 2023-09-01 bis 2025-02-28
iRISE proposes to provide theoretical and empirical evidence of the effectiveness of specific interventions to improve reproducibility. It will develop a framework for a robust, evidence-based road map for the development, assessment and implementation of interventions targeting a range of research practices and stakeholders. iRISE brings together qualitative and quantitative expertise, from academia and SMEs, including meta-science, statistics, economics, artificial intelligence, research ethics and integrity, quality assurance, and project management. iRISE proposes the development of a general framework for diagnosing and addressing reproducibility problems using analytical and computational modelling, simulations and meta-studies. Data on existing interventions will be systematically curated and evaluated, and stakeholders will be consulted to collaboratively identify practices and tools that should be prioritised for implementation. iRISE proposes to conduct empirical studies of both technical and practice-based solutions to increase reproducibility. Across all iRISE activities, the influences of research culture will be investigated, with a focus on mainstreaming systematic integration of equity, diversity and inclusion (EDI) practices. A comprehensive Stakeholder Forum will be engaged to provide advice, and iRISE will commit to open and reproducible practices. The different types of evidence generated will be integrated into an open knowledge base to support the community in decision-making to identify, test, and implement effective and feasible solutions for reproducibility. The members of iRISE have made pivotal scientific and policy contributions relating to robustness, rigour and reproducibility in the past and have the skills and tools to succeed in this ambitious project that has potential scientific, economic and societal gains both in Europe and beyond.
iRISE has made substantial progress towards scientific, societal, and economic impact. It has delivered a structured understanding of reproducibility, its measurement, and the causes of irreproducibility. iRISE is currently assessing how applicable reproducibility measures are in real-world settings and has introduced a common language for the reproducibility community, including discussions around EDI. It is also carrying out cost-benefit analyses of interventions aimed at improving reproducibility.
We have developed iRISE-SOLES, an online tool that systematically identifies and summarises interventions to improve reproducibility, supporting evidence-based decision-making. This tool is publicly available and designed to be an evolving resource for researchers and policymakers.
iRISE enhances research reproducibility and integrity by embedding EDI principles through semi-structured frameworks. It addresses systemic barriers within academia to improve diversity and supports equitable funding and hiring practices, fostering a more innovative and inclusive research workforce.
The project advances reproducibility by identifying and prioritising effective interventions through expert consultations and focus groups. It engages a wide range of stakeholders to build a collaborative research culture and helps optimise resource allocation by guiding funding towards the most impactful interventions.
iRISE is conducting ongoing intervention trials to generate evidence on the effectiveness of different strategies for improving reproducibility. Early pilot data have been collected and are under analysis, providing the foundation for future improvements in research practices.
The project supports the practical implementation of reproducibility interventions through the development of the iRISE Framework and supporting Implementation Guides. It promotes transparent, open approaches and ensures that interventions are evidence-based and easily adoptable. iRISE has also established a Stakeholder Forum to strengthen collaboration across different sectors of the research community. By maintaining an open knowledge base and a strong social media presence, the project is raising awareness and fostering lasting improvements in research reproducibility.
We have developed iRISE-SOLES, an online tool that systematically identifies and summarises interventions to improve reproducibility, supporting evidence-based decision-making. This tool is publicly available and designed to be an evolving resource for researchers and policymakers.
iRISE enhances research reproducibility and integrity by embedding EDI principles through semi-structured frameworks. It addresses systemic barriers within academia to improve diversity and supports equitable funding and hiring practices, fostering a more innovative and inclusive research workforce.
The project advances reproducibility by identifying and prioritising effective interventions through expert consultations and focus groups. It engages a wide range of stakeholders to build a collaborative research culture and helps optimise resource allocation by guiding funding towards the most impactful interventions.
iRISE is conducting ongoing intervention trials to generate evidence on the effectiveness of different strategies for improving reproducibility. Early pilot data have been collected and are under analysis, providing the foundation for future improvements in research practices.
The project supports the practical implementation of reproducibility interventions through the development of the iRISE Framework and supporting Implementation Guides. It promotes transparent, open approaches and ensures that interventions are evidence-based and easily adoptable. iRISE has also established a Stakeholder Forum to strengthen collaboration across different sectors of the research community. By maintaining an open knowledge base and a strong social media presence, the project is raising awareness and fostering lasting improvements in research reproducibility.
iRISE has provided conceptual and methodological tools, including the iRISE glossary, which clarifies terms like "reproducibility", "replicability", and related key EDI concepts. Through comprehensive evaluation of the literature, we have identified 49 (potential) causes of irreproducibility and reviewed 50 measures of reproducibility, some of which are now being tested in real-world settings and linked to economic models. We also developed iRISE-SOLES (Systematic Online Living Evidence Summary), a systematically curated living summary of existing evidence on reproducibility interventions. iRISE-SOLES combines expert input and AI to summarise interventions. Users can identify evidence gaps through an online dashboard to support evidence-based decision-making across a broad range of stakeholders including researchers and policymakers.
To strengthen research culture, iRISE is embedding EDI principles into research practices by developing an assessment framework and examining how diversity in research teams impacts scientific integrity. This work lays the foundation for more inclusive and high-quality research across disciplines.
Engaging closely with stakeholders, iRISE is using Delphi processes and focus groups to prioritise practical tools such as methodological training and data management improvements, aiming to build a sustainable, stakeholder-driven model for enhancing research practices.
Furthermore, iRISE is running several intervention studies to test strategies for boosting reproducibility, including the use of automated screening tools, computational reproducibility checks, the EQIPD quality system, and statistical interventions. These studies will inform future approaches to improving research quality.
Finally, iRISE performs data management, communication, and knowledge sharing through an Open Knowledge Base, an active social media presence, and the coordination of a Stakeholder Forum to ensure continuous community engagement.
To strengthen research culture, iRISE is embedding EDI principles into research practices by developing an assessment framework and examining how diversity in research teams impacts scientific integrity. This work lays the foundation for more inclusive and high-quality research across disciplines.
Engaging closely with stakeholders, iRISE is using Delphi processes and focus groups to prioritise practical tools such as methodological training and data management improvements, aiming to build a sustainable, stakeholder-driven model for enhancing research practices.
Furthermore, iRISE is running several intervention studies to test strategies for boosting reproducibility, including the use of automated screening tools, computational reproducibility checks, the EQIPD quality system, and statistical interventions. These studies will inform future approaches to improving research quality.
Finally, iRISE performs data management, communication, and knowledge sharing through an Open Knowledge Base, an active social media presence, and the coordination of a Stakeholder Forum to ensure continuous community engagement.