The Use of Input Data in the Performance Analysis of R&D Systems

Potentialities and Pitfalls
  • Marc Luwel


With the emergence of the knowledge based society, great emphasis is put on the development of qualitative and quantitative policy tools for analysing the science and innovation system. In this chapter an overview is given of the available R&D input data at (supra) national and regional level. With the Frascati Manual the OECD provides a methodological framework for setting up national surveys to collect these data. This methodology is used to produce standardised measurements of human and financial resources devoted to R&D by OECD member countries. EUROSTAT adapted and extended this methodology to produce for the EU countries R&D input data at regional level. To measure the performance of national and regional R&D systems, input and output data have to be combined. The methodologies for collecting input and output data have, however, been developed largely independently from each other. The resulting limitations on their use in performance indicators are discussed, and suggestions are formulated for a more integrated approach to construct input and output data.


Statistical Unit Patent Data High Education Sector International Patent Classification Community Innovation Survey 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. Bonaccorsi, A., Daraio, C. (2004). Econometric approaches to the analysis of productivity of R&D systems. Production functions and production frontiers. This Handbook.Google Scholar
  2. European Commission (2003). Third European report on science & techmology indicators 2003. Towards a knowledge-based economy. Brussels: European Commission, Directorate-General for Research.Google Scholar
  3. Eurostat (2003). Statistics on science and technology, 1980-2002 (CD-ROM).Google Scholar
  4. Glänzel, W., Schibert A. (2003). A new classification scheme of fields of science and subfields designed for scientometric evaluation purposes. Scientometrics, 56, 357–367.CrossRefGoogle Scholar
  5. Jaffe, A.B., Trajtenberg, M. (2002). Patents, citations and innovations: a window on the knowledge economy. Cambridge: MIT Press.Google Scholar
  6. Narin, F.J., Hamilton, F., Olivastro, D. (1997). The increasing linkage between US technology and science. Research Policy, 26, 317–330.CrossRefGoogle Scholar
  7. OECD (1990). Proposed standard method of compiling and interpreting technology balance of payment data TBP Manual 1990. The measurement of scientific and technological activities series. Paris.Google Scholar
  8. OECD (1994). Using patent data as science and technology indicators Patent Manual 1994. The measurement of scientific and technological activities series, Paris.Google Scholar
  9. OECD (2002). Basic science and technology statistics (CD-rom).Google Scholar
  10. OECD (2002). International mobility of the highly skilled.Google Scholar
  11. OECD (2002). Frascati Manual. Proposed standard practice for surveys on research and experimental development.Google Scholar
  12. OECD / EUROSTAT (1997). Proposed guidelines for collecting and interpreting technological innovation data Oslo Manual. The measurement of scientific and technological activities series, Paris.Google Scholar
  13. OECD / EUROSTAT (1995). The measurement of human resources devoted to science and technology — Canberra Manual. The measurement of scientific and technological activities series, Paris.Google Scholar
  14. Okubo, Y. (1997). Bibliometric indicators and analysis of research systems, methods and examples. OECD, STI Working Paper 1997/1.Google Scholar
  15. UNESCO (1978). Recommendations concerning the international standardisation of statistics on science and technology.Google Scholar
  16. UNESCO (2003). Immediate, medium and longer term strategy in science and technology statistics. Internal review of science and technology statistics and indicators ( Scholar
  17. UNESCO, (2001). The state of science and technology in the world, 1996–1997. ( Scholar
  18. van Raan, A.F.J. (Ed.). (1988). Handbook of quantitative studies of science and technology. Amsterdam: North-Holland.Google Scholar
  19. Verbeek, A., Debackere, K., Luwel, M. (2003). Science cited in patents: A geographic “flow” analysis of bibliographic patterns in patents. Scientometrics, 58, 241–263.CrossRefGoogle Scholar

Copyright information

© Kluwer Academic Publishers 2004

Authors and Affiliations

  • Marc Luwel
    • 1
    • 2
  1. 1.Centre for Science and Technology StudiesUniversity Leidenthe Netherlands
  2. 2.Dutch-Flemish Accreditation OrganisationThe Haguethe Netherlands

Personalised recommendations