Periodic Reporting for period 1 - GraspOS (GraspOS: next Generation Research Assessment to Promote Open Science)
Okres sprawozdawczy: 2023-01-01 do 2023-12-31
GraspOS is a 3-year Horizon Europe research project that sets out the ambitious goal to develop, assess and put into operation an open and trusted federated infrastructure offering data, tools, services and guidance pivotal in underpinning policy reforms for Open Science-aware and responsible research assessment across various levels—ranging from individual researchers and groups to institutions, organizations, and countries. The recognition of the imperative for reform in research assessment is underscored by the burgeoning popularity of initiatives like CoARA in recent years.
The project sets the following overall objectives:
- Deliver an Open Science Assessment Framework as a toolkit to assist tailoring and applying in practice new generation, OS-aware Responsible Research Assessment (RRA) approaches
- Develop and deliver EOSC-integrated tools and services to support the implementation of new generation, OS-aware RRA approaches
- Develop an EOSC-integrated, Federated Open Metrics Infrastructure to offer data, tools, and services.
- Empower and bring together different stakeholder communities to co-design, showcase, validate, and evaluate OS-aware RRA indicators, tools, services and infrastructure in real-world pilots.
The progress towards these objectives during the first reporting period is elaborated in the Technical Report (Part B) document.
GraspOS key results include:
- The Open Science Assessment Framework (OSAF), a collaborative guide for responsible research assessment that aligns to Open Science practices and ensures that Open Science activities of researchers and research organisations are taken into consideration in assessment events.
- A set of Assessment Portfolios to support the collection of inputs for research assessment and an online Assessment Registry to facilitate publishing protocols developed for responsible research assessments.
- A set of metadata enrichment tools and services for enhancing missing attributes, semantics, context, and novel indicator values on research outputs and enriching the links among them with appropriate semantics.
- A set of monitoring tools and services offering indicators, contextual factors, qualitative information (e.g. narratives), and relevant evidence to support assessment processes and relevant types of analysis.
- A Federated Open Research Assessment Infrastructure that offers APIs to provide easy access to data assets coming from well-established providers of scholarly metadata, which are valuable for the implementation of OS-aware RRA processes, aiming to also facilitate the development and provision of enrichment, monitoring, and other added-value services on top of these assets, paving the way for the creation of a research assessment data space.
- A Community of Practice of responsible research assessment experts from relevant networks, to facilitate knowledge sharing and capacity building.
- A set of carefully designed Training material relevant to the subjects of research assessment and Open Science.
Finally, the project has initiated nine pilots encompassing a diverse array of use cases spanning various levels, scopes, and values. These pilots serve as platforms to showcase and practically test the assessment framework, infrastructure, tools, and services developed within the project. Furthermore, they adhere to a co-design approach, enabling stakeholders to provide feedback on implementation and ensure alignment with real-world needs and requirements.
The project sets the following overall objectives:
- Deliver an Open Science Assessment Framework as a toolkit to assist tailoring and applying in practice new generation, OS-aware Responsible Research Assessment (RRA) approaches
- Develop and deliver EOSC-integrated tools and services to support the implementation of new generation, OS-aware RRA approaches
- Develop an EOSC-integrated, Federated Open Metrics Infrastructure to offer data, tools, and services.
- Empower and bring together different stakeholder communities to co-design, showcase, validate, and evaluate OS-aware RRA indicators, tools, services and infrastructure in real-world pilots.
The progress towards these objectives during the first reporting period is elaborated in the Technical Report (Part B) document.
GraspOS key results include:
- The Open Science Assessment Framework (OSAF), a collaborative guide for responsible research assessment that aligns to Open Science practices and ensures that Open Science activities of researchers and research organisations are taken into consideration in assessment events.
- A set of Assessment Portfolios to support the collection of inputs for research assessment and an online Assessment Registry to facilitate publishing protocols developed for responsible research assessments.
- A set of metadata enrichment tools and services for enhancing missing attributes, semantics, context, and novel indicator values on research outputs and enriching the links among them with appropriate semantics.
- A set of monitoring tools and services offering indicators, contextual factors, qualitative information (e.g. narratives), and relevant evidence to support assessment processes and relevant types of analysis.
- A Federated Open Research Assessment Infrastructure that offers APIs to provide easy access to data assets coming from well-established providers of scholarly metadata, which are valuable for the implementation of OS-aware RRA processes, aiming to also facilitate the development and provision of enrichment, monitoring, and other added-value services on top of these assets, paving the way for the creation of a research assessment data space.
- A Community of Practice of responsible research assessment experts from relevant networks, to facilitate knowledge sharing and capacity building.
- A set of carefully designed Training material relevant to the subjects of research assessment and Open Science.
Finally, the project has initiated nine pilots encompassing a diverse array of use cases spanning various levels, scopes, and values. These pilots serve as platforms to showcase and practically test the assessment framework, infrastructure, tools, and services developed within the project. Furthermore, they adhere to a co-design approach, enabling stakeholders to provide feedback on implementation and ensure alignment with real-world needs and requirements.
During the first year, the partners of GraspOS have conducted a broad range of activities which lay the groundwork for the rest of the project. The most important achievements were the following:
- The design and development of an alpha version of the OSAF framework that can help in the operationalisation of Open-Science-aware responsible research assessment (OS-aware RRA). This result was supported by a landscape analysis of the respective domain (D2.1) engagement activities with the nine GraspOS pilots, and an effort to clarify the concept, resources, and associated infrastructure (D2.2).
- The delivery of a comprehensive landscape report detailing the array of tools and services that can support OS-aware RRA practices (D3.1).
- The design (D4.1) and implementation (D4.3) of a first version of the GraspOS open, federated, and modular infrastructure that provides easy access to datasets, tools, and services, which are valuable for the implementation of OS-aware RRA events.
- The analysis (D5.1) which shed light on the status of research evaluation objectives, contextual factors, and available resources within the GaspOS pilots, also illuminating a diverse array of applications within the field of research assessment. Importantly, the insights gleaned have proven invaluable in shaping both the GraspOS assessment framework and the development of the GraspOS tools and services.
- The establishment of a Community of Practice on OS and RRA that expands GraspOS’ reach to stakeholder communities aiming to educate the attendees in relevant subjects.
- The design and development of an alpha version of the OSAF framework that can help in the operationalisation of Open-Science-aware responsible research assessment (OS-aware RRA). This result was supported by a landscape analysis of the respective domain (D2.1) engagement activities with the nine GraspOS pilots, and an effort to clarify the concept, resources, and associated infrastructure (D2.2).
- The delivery of a comprehensive landscape report detailing the array of tools and services that can support OS-aware RRA practices (D3.1).
- The design (D4.1) and implementation (D4.3) of a first version of the GraspOS open, federated, and modular infrastructure that provides easy access to datasets, tools, and services, which are valuable for the implementation of OS-aware RRA events.
- The analysis (D5.1) which shed light on the status of research evaluation objectives, contextual factors, and available resources within the GaspOS pilots, also illuminating a diverse array of applications within the field of research assessment. Importantly, the insights gleaned have proven invaluable in shaping both the GraspOS assessment framework and the development of the GraspOS tools and services.
- The establishment of a Community of Practice on OS and RRA that expands GraspOS’ reach to stakeholder communities aiming to educate the attendees in relevant subjects.
The project is centered on innovation, with its endeavors aimed at pushing the boundaries of the current state of the art in the respective fields. However, the most important contributions of the project are related to technological & theoretical advances that can help stakeholders in the research assessment domain to reform the landscape fostering a more equitable and inclusive environment for researchers and research organisations which also properly recognises Open Science. To this end, the early version of the assessment framework, the infrastructure, and the related datasets, tools, and services are expected to have a significant impact.