Abstract
We use Bayesian probability theory to develop a new way of measuring research productivity. The metric accommodates a wide variety of project types and productivity sources and accounts for the contributions of “failed” as well as “successful” investigations. Employing a mean-absolute-deviation loss functional form with this new metric allows decomposition of knowledge gain into an outcome probability shift (mean surprise) and outcome variance reduction (statistical precision), a useful distinction, because projects scoring well on one often score poorly on the other. In an international aquacultural research program, we find laboratory size to moderately boost mean surprise but have no effect on precision, while scientist education improves precision but has no effect on mean surprise. Returns to research scale are decreasing in the size dimension but increasing when size and education are taken together, suggesting the importance of measuring human capital at both the quantitative and qualitative margin.
This chapter is an abbreviated and edited version of the article entitled “Knowledge Measurement and Productivity in a Research Program” published in the American Journal of Agricultural Economics 99 (4): 932–951.
This is a preview of subscription content, log in via an institution.
Notes
- 1.
Basic research cannot as easily be divided into Fig. 1’s steps or into any regular steps at all. We note below the important differences between basic research and the applied research that motivates our present approach.
- 2.
Basic research in contrast could be argued to lack any concrete outcomes or probabilities, being a matter more of discrete realizations than incremental steps. Probit models might in future be useful in representing that kind of discrete space.
- 3.
Feed-the-Future Innovation Lab for Collaborative Research on Aquaculture and Fisheries, Oregon State University, sponsored by US Agency for International Development. The countries are Bangladesh, Cambodia, China, Ghana, Guyana, Indonesia, Kenya, Mexico, Nepal, Nicaragua, the Philippines, South Africa, Tanzania, Thailand, Uganda, and Vietnam.
- 4.
If laboratory expansion did impair precision, we would be unlikely to observe any expansion unless the mean-surprise advantage more than compensated for the precision loss.
References
Adams, J., and Z. Griliches. 1996. Measuring Science: An Exploration. Proceedings of the National Academy of Science 93: 12664–12670.
Alston, J.M., G.W. Norton, and P.G. Pardey. 1995. Science Under Scarcity: Principles and Practices for Agricultural Research Evaluation and Priority Setting. Ithaca: Cornell University Press and ISNAR.
Alston, J.M., M.C. Marra, P.G. Pardey, and T.J. Wyatt. 2000. Research Returns Redux: A Meta-Analysis of the Returns to Agricultural R&D. Australian Journal of Agricultural and Resource Economics 44 (2): 185–215.
Alston, J.M., M.A. Andersen, J.S. James, and P.G. Pardey. 2011. The Economic Returns to US Public Agricultural Research. American Journal of Agricultural Economics 93 (5): 1257–1277.
Berger, J.O. 1985. Statistical Decision Theory and Bayesian Analysis. 2nd ed. New York: Springer.
CGIAR Science Council. 2009. Defining and Refining Good Practice in Ex-Post Impact Assessment – Synthesis Report. Rome: CGIAR Science Council Secretariat.
Cohen, W.M., and D.A. Levinthal. 1989. Innovation and Learning: The Two Faces of R&D. Economic Journal 99: 569–596.
Fontana, R., A. Nuvolari, H. Shimizu, and A. Vezzulli. 2013. Reassessing Patent Propensity: Evidence from a Dataset of R&D Awards, 1977–2004. Research Policy 42 (10): 1780–1792.
Griliches, Z. 1990. Patent Statistics as Economic Indicators: A Survey. Journal of Economic Literature 27: 1661–1707.
Hall, B.H., A.B. Jaffe, and M. Trajtenberg. 2005. Market Value and Patent Citations. RAND Journal of Economics 36: 16–38.
Hausman, J.A., B.H. Hall, and Z. Griliches. 1984. Econometric Models for Count Data with an Application to the Patents-R&D Relationship. Econometrica 52 (4): 909–938.
Huffman, W.E., and R.E. Evenson. 2006. Do Formula or Competitive Grant Funds Have Greater Impacts on State Agricultural Productivity? American Journal of Agricultural Economics 88 (4): 783–798.
Hurley, T.M., X. Rao, and P.G. Pardey. 2014. Re-Examining the Reported Rates of Return to Food and Agricultural Research and Development. American Journal of Agricultural Economics 96 (5): 1492–1504.
Industrial Research Institute. 2016. 2016 Global Funding Forecast. R&D Magazine (Winter 2016 Supplement), 3–34.
Kocher, M.G., M. Luptacik, and M. Sutter. 2006. Measuring Productivity of Research in Economics: A Cross-Country Study Using DEA. Socio-Economic Planning Sciences 40: 314–332.
Lanjouw, J.O., and M. Schankerman. 2004. Patent Quality and Research Productivity: Measuring Innovation with Multiple Indicators. Economic Journal 114 (495): 441–465.
Lindley, D.V. 1956. On a Measure of the Information Provided by an Experiment. Annals of Mathematical Statistics 27: 986–1005.
Oettl, A. 2012. Reconceptualizing Stars: Scientist Helpfulness and Peer Performance. Management Science 58 (6): 1122–1140.
Pardey, P.G. 1989. The Agricultural Knowledge Production Function: An Empirical Look. The Review of Economics and Statistics 71: 453–461.
Polanyi, M. 1974. Personal Knowledge. Chicago: University of Chicago Press.
Robert, C.P. 2001. The Bayesian Choice. 2nd ed. New York: Springer.
Rynes, S.L., J.M. Bartunek, and R.L. Daft. 2001. Across the Great Divide: Knowledge Creation and Transfer between Practitioners and Academics. Academy of Management Journal 44 (2): 340–355.
Schimmelpfennig, D.E., and G.W. Norton. 2003. What is the Value of Agricultural Economics Research? American Journal of Agricultural Economics 85: 81–94.
Schulze, A., and M. Hoegl. 2008. Organizational Knowledge Creation and the Generation of New Product Ideas: A Behavioral Approach. Research Policy 37 (10): 1742–1750.
Shapira, P., J. Youtie, K. Yogeesvaran, and Z. Jaafar. 2006. Knowledge Economy Measurement: Methods, Results, and Insights from the Malaysian Knowledge Content Study. Research Policy 35 (10): 1522–1537.
Wang, E.C., and W. Huang. 2007. Relative Efficiency of R&D Activities: A Cross-Country Study Accounting for Environmental Factors in the DEA Approach. Research Policy 36: 260–273.
White, F.C., and J. Havlicek. 1982. Optimal Expenditures for Agricultural Research and Extension: Implications of Underfunding. American Journal of Agricultural Economics 64 (1): 47–55.
Winkler, R.L. 1972. An Introduction to Bayesian Inference and Decision. New York: Holt, Rinehart and Winston.
———. 1986. Expert Resolution. Management Science 32 (3): 298–303.
———. 1994. Evaluating Probabilities: Asymmetric Scoring Rules. Management Science 40 (11): 1395–1405.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer International Publishing AG
About this chapter
Cite this chapter
Qin, L., Buccola, S.T. (2018). A Bayesian Measure of Research Productivity. In: Kalaitzandonakes, N., Carayannis, E., Grigoroudis, E., Rozakis, S. (eds) From Agriscience to Agribusiness. Innovation, Technology, and Knowledge Management. Springer, Cham. https://doi.org/10.1007/978-3-319-67958-7_23
Download citation
DOI: https://doi.org/10.1007/978-3-319-67958-7_23
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-67957-0
Online ISBN: 978-3-319-67958-7
eBook Packages: Business and ManagementBusiness and Management (R0)