Τhe MultiRATE project, created a Holistic RL (HRL) assessment framework to evaluate the maturity of products, systems, or processes developed in civil security R&D projects for both Law Enforcement Agencies (LEAs) and non-LEAs. MultiRATE’s RL dimensions include adapted versions of existing RL scales like Technology RL, Societal RL, Integration RL, Commercialisation RL, Manufacturing RL as well as additional RL dimensions relevant in the field, such as Security RL and Legal, Privacy and Ethics RL. All seven dimensions needed to be holistically harmonized to meet the project’s objectives. Additionally, the framework includes an investment forecasting module to estimate the costs required to increase RL maturity.
MultiRATE project elaborated on the implementation of this holistic framework and the evaluation of its feasibility by the project’s conclusion. More specifically, the contributions include:
• The MultiRATE HRL calculator that integrates the indicators and methodologies of the seven RL dimensions taking into account all their peculiarities adapted to the civil security sector. The web-based MultiRATE HRL calculator can be accessed here:
https://hrl.multiratehl.iti.gr(s’ouvre dans une nouvelle fenêtre).
• The integration process of an Investment Forecasting module to effectively estimate the costs required to increase RL maturity in the context of the MultiRATE HRL.
• The validation process of the MultiRATE HRL and its components with the collaboration of an external network of experts following the Design Science Research
Methodology (DSRM)
The ambition of MultiRATE is to develop a holistic, homogenous and harmonised RL evolution methodology and calculator for R&D solutions in the security domain, available to the EU R&D community. More specifically MultiRATE’s objectives are:
• To conduct research in the abovementioned RL fields to create solid ground for the development of the holistic, homogenous and harmonised RL evaluation methodology.
• To accurately evaluate solutions in all RL fields and to develop unique methodology and indicators as each field measures different aspects and has different objectives.
• To develop the HRL evaluation methodology for security related solutions. The EU R&D community will take advantage of open access HRL, harmonising the approach taken from all projects, initiatives and more.
• Establish a network of projects and organisations that will support the design of the appropriate evaluation methodologies, and will support the calibration and testing of both individual RLs and the holistic.
• Evaluate accurately the RLs of both EU and National R&D solutions as well as the investment forecasting and business plan of organisations' solutions regarding the future strategic research planning.
MultiRATE's pathways to impact include the increase in literacy on the value and efficient use of maturity assessment frameworks to communicate the readiness of technology, synchronise parallel developments, forecast implementation and support decision making in the planning of investment in the area of security. Additionally, another aspect includes the improved cross-disciplinary assessment of the maturity of innovative technologies based on common harmonised frameworks for the security domain. Further to that, a comprehensive and timely updated map of the maturity of the security solutions developed through EU-funded security research and innovation programmes enabled by widely accessible assessment tools and methods. Last but not least, the pathway to impact includes the evidence-based programming of security research built on a more reliable assessment of the SOTA technologies in the field of security.
