This site has been archived on
Innovation Programme Home Page Innovation & Technology Transfer Contents Page, January 1998

Cover illustration


Next Section: ... ... Publications and Conferences

Mapping the Innovation Universe in Europe

The Community Innovation Survey is the first attempt ever made to collect comparable enterprise-level data on the processes and results of technological innovation across an entire economic bloc. It has made possible detailed comparative studies between sectors and regions.

Extent of innovative activity
The data from the CIS1 pilot project demonstrate the importance of taking representative samples (see 'Teething Problems' ). This is being addressed in CIS2, the follow-up exercise.

Technological innovation is essential if companies - and countries - are to maintain their competitiveness in global markets.

But where and how does innovation actually occur? How big and how rapid are its impacts on turnover, export sales, and employment? What are its costs? What are its key mechanisms and constraints? And how widely do these factors vary between regions and industrial activities? (1)

The effectiveness of measures to stimulate or facilitate innovation depends to a very large extent on the ability of policy-makers to answer these kinds of question. Without a detailed understanding of innovation's complex processes, resources may not be directed where they will do most good. Until recently, however, both policy-makers and business and investment strategists were forced to rely on largely theoretical studies, supported by small-scale or at best national surveys of enterprises.

In the US, Japan and Southeast Asia, this remains the case. But in Europe the Commission, in collaboration with EU Member States, has embarked on a unique and ambitious project to gather data from enterprises in every region of the Union, in a common Community Innovation Survey (CIS). A pilot survey, CIS1, was conducted in 1992/93. A second, improved in the light of the pilot experience, is currently being carried out, and should be completed by mid-1998. Thereafter, the Commission intends to conduct the CIS on a regular basis, once every two or three years.

Policy-makers across Europe at all levels - EU, national, regional and local - will in future be able to base their deliberations on robust and comprehensive evidence.

I. Developing Innovation Intelligence

Innovation & Technology Transfer spoke to some of those who have collected, analysed and made use of the CIS data. What has been their experience of the CIS?

In the Netherlands, a higher proportion of R&D is carried out in universities and institutes than in any other Member State. But its Ministry of Economic Affairs is keen to improve the efficiency of institutional-industrial technology transfer. Like Germany, it has for some time conducted its own national innovation survey, and has therefore had better data than most Member States. But before CIS1, inter-country comparisons were only possible at sector or macro levels.

"We wanted to know what type of innovation support structures and interactions had worked well elsewhere, in order to improve our own policy instruments," says the Ministry's Dr Theo Roelandt. "What makes the CIS database so valuable is that it enables us to compare the performance of our own structures and those of other countries, using firm-level data. That is something we have never been able to do before.

"Innovation theory told us that the interactions between a country's public knowledge infrastructure and its firms and knowledge suppliers is critical to its industrial performance. But this was an assumption rather than a fact. The actual data was scarce. The CIS confirmed the theory, and gave us a better understanding of the processes involved. The data cannot tell you exactly what to do, of course. But it stimulates constructive policy debate by highlighting areas of under-performance where policy intervention is called for, and by suggesting hypotheses which can then be researched in more detail on a case-study basis."

Extent of co-operative R&D arrangements in 1992
The larger the firm, the more likely it is to be involved in collaborative R&D projects.

Teething Problems

The Ministry used CIS data in a recent review of industrial and technological policy, which focused on initiatives to improve inter-firm collaboration. But Roelandt believes that its value would have been much greater, if not for methodological problems encountered in the pilot. "We made less use of it than we had hoped," he says. "But CIS1 was designed as a pilot, and one of its key results was to highlight the difficulties of creating a single data set for all EU countries. We are very keen to see even better data coming out of the current survey."

The problems are of three kinds. First, which enterprises should be invited to participate? It is clearly important that firms of all sizes and from all sectors, both innovators and non-innovators, are represented in the sample. In CIS 1, for example, some countries focused on known innovative companies, which skewed their results upwards (see figure ).

Second, what data should be collected, and in particular what financial data? Georg Licht of the Mannheim-based Centre for European Economic Research (ZEW) is responsible for the collection of CIS data in Germany. He admits that questions about innovation costs are time-consuming to answer, because these costs are not shown directly in a firm's accounts. But he says that firms themselves are acutely aware that their answers to simple multiple choice questions about their innovation activities are almost meaningless unless these are accompanied by detailed financial information.

Professor Sergio Cesaratto of the University of Rome, who used CIS data to carry out a detailed study of the impacts of innovation on employment in Italy (EIMS publication 37), believes that some financial data could more easily be acquired from accounts submitted to national authorities. "The quality of the data would be improved if the CIS questionnaire omitted questions which firms have answered elsewhere," he says.

Georg Licht disagrees. "The survey does add to an already heavy administrative burden on business," he says. "But in most Member States data protection laws would prevent us from matching CIS data with that gathered for other purposes. It is essential that the CIS includes both financial and innovation data."

The third problem concerns the actual wording of the CIS questionnaire. "Take the word 'technology'", says Licht. "Not only does it have quite different meanings in German and in English. But different firms, particularly in the service sector, are likely to interpret it in different ways. For example, do a software house's products constitute 'technological innovation' or not? We should avoid a terminology which is oriented towards the manufacturing sector."

Comparing Like with Like

Addressing these problems will be crucial to the long-term success of the Community Innovation Survey. The inter-country comparability demanded by policy-makers like Theo Roelandt can only be achieved if sampling methods, questionnaire design and - as far as possible - the wording of questions are all uniformly applied in all Member States.

The Innovation Programme's European Innovation Monitoring System (EIMS), which with Eurostat co-ordinates the CIS, acknowledges the shortcomings of the first survey. But it is confident that a firm foundation has been created for a European resource of steadily increasing value.

The selection of indicators in consultation with the OECD, the development of the database itself, the use of micro-aggregation as a means of anonymising enterprise-level data to safeguard commercial confidentiality, and the establishment of working methods by the EIMS, Eurostat and national statistical offices - these are solid achievements, and the difficulties revealed by the first survey are largely being addressed in CIS2.

(1) The charts in this article illustrate the range and power of the CIS data, but are based on individual researchers' interpretations. Inter-country comparisons, in particular, should be viewed as indicative only.

Context: The CIS: Facts and Figures

Protection for product and process innovation
Speed to market is widely regarded as the most effective means of protecting the competitive advantage gained through product innovation.

What is the Community Innovation Survey?
The CIS collects data on the innovation inputs and outputs of individual enterprises throughout the European Union. It measures the introduction of new or improved products and processes, taking into account innovations arising from industrial design and investment in new equipment, as well as those based on R&D.

Who operates and funds the CIS?
The CIS is a joint initiative of the Statistical Office of the European Communities (Eurostat) and the European Innovation Monitoring System (EIMS), part of the Innovation Programme. Each Member State funds its own national innovation survey. EIMS and Eurostat contribute to the cost of the additional work required to ensure that data is comparable at European level.

How is data collected?
The first pilot survey (CIS1) was carried out in 1992/93, using a common questionnaire developed by Eurostat, based on the OECD's Oslo Manual methodology. Data was collected from 40,000 enterprises in the then twelve countries of the EU, as well as in Norway and Iceland. Enterprises were selected at random from groupings made according to size and activity, and contacted directly by the national co-ordinator, normally the national Statistical Office.

Data on an enterprise's innovation activities could be commercially sensitive. How is confidentiality protected?
The data provided by participating enterprises is seen only by national co-ordinators and Eurostat. Before it is made available for analysis it is anonymised using a technique called micro-aggregation.

How is CIS data used?
The CIS is designed principally to provide information for the development of innovation policy at EU, Member State and regional levels. The EIMS commissions studies from consultants and academics, and has published over 50 reports on innovation-related topics to date, of which about half are based on CIS data.

Do participating enterprises themselves benefit?
In most Member States, the survey relies upon the voluntary contribution of time and effort by business managers. But the European business community as a whole should benefit greatly from improved understanding of the scale, processes, requirements and impacts of technological innovation. Successive surveys will make it possible to identify trends, to anticipate changing needs, and to improve the targeting and delivery of support.

Are the findings of studies based on the CIS data available to anyone?
Most of the study reports are available, free of charge, from the EIMS. In addition, Eurostat can provide researchers wishing to carry out their own analyses with much of the underlying anonymised data. It has prepared a CD-ROM with over 7,000 of the most significant data tables.

CIS1 was a pilot. What lessons have been drawn from that experience?
Pan-European monitoring of technological innovation was found to be both feasible and worthwhile. On the other hand, further standardisation of sampling techniques, questionnaires and data processing is still required. Additionally, greater effort is needed to feed survey results back to participating enterprises.

How will these lessons be applied in the future?
The second Community Innovation Survey (CIS2) was launched in 1997, and is currently being carried out in the 15 EU Member States, Iceland and Norway. Strict co-ordination of the work will ensure higher levels of comparability between national data.


Next Section: ... ... Dossier (followed)