Skip to main content

A Bayesian Measure of Research Productivity

  • Chapter
  • First Online:
  • 1345 Accesses

Part of the book series: Innovation, Technology, and Knowledge Management ((ITKM))

Abstract

We use Bayesian probability theory to develop a new way of measuring research productivity. The metric accommodates a wide variety of project types and productivity sources and accounts for the contributions of “failed” as well as “successful” investigations. Employing a mean-absolute-deviation loss functional form with this new metric allows decomposition of knowledge gain into an outcome probability shift (mean surprise) and outcome variance reduction (statistical precision), a useful distinction, because projects scoring well on one often score poorly on the other. In an international aquacultural research program, we find laboratory size to moderately boost mean surprise but have no effect on precision, while scientist education improves precision but has no effect on mean surprise. Returns to research scale are decreasing in the size dimension but increasing when size and education are taken together, suggesting the importance of measuring human capital at both the quantitative and qualitative margin.

This chapter is an abbreviated and edited version of the article entitled “Knowledge Measurement and Productivity in a Research Program” published in the American Journal of Agricultural Economics 99 (4): 932–951.

This is a preview of subscription content, log in via an institution.

Notes

  1. 1.

    Basic research cannot as easily be divided into Fig. 1’s steps or into any regular steps at all. We note below the important differences between basic research and the applied research that motivates our present approach.

  2. 2.

    Basic research in contrast could be argued to lack any concrete outcomes or probabilities, being a matter more of discrete realizations than incremental steps. Probit models might in future be useful in representing that kind of discrete space.

  3. 3.

    Feed-the-Future Innovation Lab for Collaborative Research on Aquaculture and Fisheries, Oregon State University, sponsored by US Agency for International Development. The countries are Bangladesh, Cambodia, China, Ghana, Guyana, Indonesia, Kenya, Mexico, Nepal, Nicaragua, the Philippines, South Africa, Tanzania, Thailand, Uganda, and Vietnam.

  4. 4.

    If laboratory expansion did impair precision, we would be unlikely to observe any expansion unless the mean-surprise advantage more than compensated for the precision loss.

References

  • Adams, J., and Z. Griliches. 1996. Measuring Science: An Exploration. Proceedings of the National Academy of Science 93: 12664–12670.

    Article  Google Scholar 

  • Alston, J.M., G.W. Norton, and P.G. Pardey. 1995. Science Under Scarcity: Principles and Practices for Agricultural Research Evaluation and Priority Setting. Ithaca: Cornell University Press and ISNAR.

    Google Scholar 

  • Alston, J.M., M.C. Marra, P.G. Pardey, and T.J. Wyatt. 2000. Research Returns Redux: A Meta-Analysis of the Returns to Agricultural R&D. Australian Journal of Agricultural and Resource Economics 44 (2): 185–215.

    Article  Google Scholar 

  • Alston, J.M., M.A. Andersen, J.S. James, and P.G. Pardey. 2011. The Economic Returns to US Public Agricultural Research. American Journal of Agricultural Economics 93 (5): 1257–1277.

    Article  Google Scholar 

  • Berger, J.O. 1985. Statistical Decision Theory and Bayesian Analysis. 2nd ed. New York: Springer.

    Book  Google Scholar 

  • CGIAR Science Council. 2009. Defining and Refining Good Practice in Ex-Post Impact Assessment – Synthesis Report. Rome: CGIAR Science Council Secretariat.

    Google Scholar 

  • Cohen, W.M., and D.A. Levinthal. 1989. Innovation and Learning: The Two Faces of R&D. Economic Journal 99: 569–596.

    Article  Google Scholar 

  • Fontana, R., A. Nuvolari, H. Shimizu, and A. Vezzulli. 2013. Reassessing Patent Propensity: Evidence from a Dataset of R&D Awards, 1977–2004. Research Policy 42 (10): 1780–1792.

    Article  Google Scholar 

  • Griliches, Z. 1990. Patent Statistics as Economic Indicators: A Survey. Journal of Economic Literature 27: 1661–1707.

    Google Scholar 

  • Hall, B.H., A.B. Jaffe, and M. Trajtenberg. 2005. Market Value and Patent Citations. RAND Journal of Economics 36: 16–38.

    Google Scholar 

  • Hausman, J.A., B.H. Hall, and Z. Griliches. 1984. Econometric Models for Count Data with an Application to the Patents-R&D Relationship. Econometrica 52 (4): 909–938.

    Article  Google Scholar 

  • Huffman, W.E., and R.E. Evenson. 2006. Do Formula or Competitive Grant Funds Have Greater Impacts on State Agricultural Productivity? American Journal of Agricultural Economics 88 (4): 783–798.

    Article  Google Scholar 

  • Hurley, T.M., X. Rao, and P.G. Pardey. 2014. Re-Examining the Reported Rates of Return to Food and Agricultural Research and Development. American Journal of Agricultural Economics 96 (5): 1492–1504.

    Article  Google Scholar 

  • Industrial Research Institute. 2016. 2016 Global Funding Forecast. R&D Magazine (Winter 2016 Supplement), 3–34.

    Google Scholar 

  • Kocher, M.G., M. Luptacik, and M. Sutter. 2006. Measuring Productivity of Research in Economics: A Cross-Country Study Using DEA. Socio-Economic Planning Sciences 40: 314–332.

    Article  Google Scholar 

  • Lanjouw, J.O., and M. Schankerman. 2004. Patent Quality and Research Productivity: Measuring Innovation with Multiple Indicators. Economic Journal 114 (495): 441–465.

    Article  Google Scholar 

  • Lindley, D.V. 1956. On a Measure of the Information Provided by an Experiment. Annals of Mathematical Statistics 27: 986–1005.

    Article  Google Scholar 

  • Oettl, A. 2012. Reconceptualizing Stars: Scientist Helpfulness and Peer Performance. Management Science 58 (6): 1122–1140.

    Article  Google Scholar 

  • Pardey, P.G. 1989. The Agricultural Knowledge Production Function: An Empirical Look. The Review of Economics and Statistics 71: 453–461.

    Article  Google Scholar 

  • Polanyi, M. 1974. Personal Knowledge. Chicago: University of Chicago Press.

    Google Scholar 

  • Robert, C.P. 2001. The Bayesian Choice. 2nd ed. New York: Springer.

    Google Scholar 

  • Rynes, S.L., J.M. Bartunek, and R.L. Daft. 2001. Across the Great Divide: Knowledge Creation and Transfer between Practitioners and Academics. Academy of Management Journal 44 (2): 340–355.

    Article  Google Scholar 

  • Schimmelpfennig, D.E., and G.W. Norton. 2003. What is the Value of Agricultural Economics Research? American Journal of Agricultural Economics 85: 81–94.

    Article  Google Scholar 

  • Schulze, A., and M. Hoegl. 2008. Organizational Knowledge Creation and the Generation of New Product Ideas: A Behavioral Approach. Research Policy 37 (10): 1742–1750.

    Article  Google Scholar 

  • Shapira, P., J. Youtie, K. Yogeesvaran, and Z. Jaafar. 2006. Knowledge Economy Measurement: Methods, Results, and Insights from the Malaysian Knowledge Content Study. Research Policy 35 (10): 1522–1537.

    Article  Google Scholar 

  • Wang, E.C., and W. Huang. 2007. Relative Efficiency of R&D Activities: A Cross-Country Study Accounting for Environmental Factors in the DEA Approach. Research Policy 36: 260–273.

    Article  Google Scholar 

  • White, F.C., and J. Havlicek. 1982. Optimal Expenditures for Agricultural Research and Extension: Implications of Underfunding. American Journal of Agricultural Economics 64 (1): 47–55.

    Article  Google Scholar 

  • Winkler, R.L. 1972. An Introduction to Bayesian Inference and Decision. New York: Holt, Rinehart and Winston.

    Google Scholar 

  • ———. 1986. Expert Resolution. Management Science 32 (3): 298–303.

    Article  Google Scholar 

  • ———. 1994. Evaluating Probabilities: Asymmetric Scoring Rules. Management Science 40 (11): 1395–1405.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Steven T. Buccola .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer International Publishing AG

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Qin, L., Buccola, S.T. (2018). A Bayesian Measure of Research Productivity. In: Kalaitzandonakes, N., Carayannis, E., Grigoroudis, E., Rozakis, S. (eds) From Agriscience to Agribusiness. Innovation, Technology, and Knowledge Management. Springer, Cham. https://doi.org/10.1007/978-3-319-67958-7_23

Download citation

Publish with us

Policies and ethics