Indicators for benchmarking

The aim of the first set of indicators is to provide a broad comparative overview of the performance of Member States in relation to the four themes, using currently available and internationally harmonised statistics. Wherever possible, comparative indicators have been provided for the USA and Japan.

A total of 20 indicators were drawn up in consultation with the High Level Group on Benchmarking of National Research Policies and with the advice of a number of S&T indicators experts, including Eurostat and the OECD. Of the 20 indicators, 15 are indicators available from existing sources, and 5 are new indicators that need to be developed by the European Statistical System. The first set of 15 science and technology indicators for the four thematic areas has been prepared by the European Commission services, in collaboration with the Member States, and is included in the Working Document 'Progress Report on Benchmarking of National Research Policies' submitted to the Research Council. The annex is published as the special edition of Key Figures 2001

In order to ensure the methodological validity of the indicators, detailed definitions, sources and other methodological notes were sent to the statistical services in the Member States for comments during December 2000 - January 2001. In particular, benchmarking activities requires the most up-to-date, internationally comparable and policy-relevant indicators and data were therefore based as much as possible on the official statistics provided to Eurostat and the OECD by the Member States' statistical offices. Privately collected data were only used when there was no official source available for all Members States (e.g. venture capital).

In order to ensure that the best possible data were used for this work, a two step approach of data collection was employed. First, the indicators were collected for each country from harmonised international databases at Eurostat and the OECD. Then these indicators were sent to the Member States' statistical services (via the High Level Group on Benchmarking) for validation and completion. This involved checking that the data were correct, the addition of any revised data not yet available in international databases, and the inclusion where possible of estimates for the most recent years.

Work on improving the 15 existing indicators continues

The first set of indicators provides the starting point for benchmarking research policies while it is important to look towards possible improvements for them in the future. It is possible that, as a result of the analyses carried out during the benchmarking process, needs for improved technical definitions of the indicators and underlying data could emerge. The continuous work on improving the quality of the indicators and data is carried out by the Eurostat (Working parties)

Development of 5 new indicators

The development of the five new indicators is be undertaken by a special Eurostat task force. The five indicators comprise:

• Proportion of women in the total number of researchers in universities and public research institutes
• Proportion of researchers from other countries amongst researchers in universities and public research centers
• Number of spin-offs generated by universities and research centers
• Rate of usage of broadband electronic networks for research by R&D laboratories

The task force involves representatives from Member States' statistical offices, which will explore the technical issues for developing these indicators, which include measures of human resources, gender and mobility, all of which are critical issues in the context of the European Research Area. The first meeting of the task force took place 8 June 2001.