Estimation of Residential Property Price Index: Methodology and Data Sources

Part of the Advances in Japanese Business and Economics book series (AJBE, volume 11)


Fluctuations in real estate prices have substantial impacts on economic activities. In Japan, a sharp rise in real estate prices during the latter half of the 1980s and its decline in the early 1990s led to a decade-long stagnation of the Japanese economy. More recently, a rapid rise in housing prices and its reversal in the United States triggered a global financial crisis. In such circumstances, the development of appropriate indexes that allow one to capture changes in real estate prices with precision is extremely important, not only for policy makers but also for market participants who are looking for the time when housing prices hit bottom. Recent research has focussed on methods of compiling appropriate residential property price indexes. The location, maintenance and the facilities of each house are different from each other in varying degrees, so there are no two houses that are identical in terms of quality. Even if the location and basic structure are the same at two periods of time, the building ages over time and the houses are not identical across time. In other words, it is very difficult to apply the usual matching methodology (where the prices of exactly the same item are compared over time) to housing.


  1. Allen, M.T., and W.H. Dare. 2004. The effects of Charm listing prices on house transaction prices. Real Estate Economics 32: 696–713.CrossRefGoogle Scholar
  2. Bai, J., and P. Perron. 1998. Estimating and testing linear models with multiple structural changes. Econometrica 66: 47–78.CrossRefGoogle Scholar
  3. Bailey, M.J., R.F. Muth, and H.O. Nourse. 1963. A regression model for real estate price index construction. Journal of the American Statistical Association 58: 933–942.CrossRefGoogle Scholar
  4. Bostic, R.W., S.D. Longhofer, and C.L. Readfearn. 2007. Land leverage: decomposing home price dynamics. Real Estate Economics 35 (2): 183–208.CrossRefGoogle Scholar
  5. Bourassa, S.T., M. Hoesli, and J. Sun. 2006. A simple alternative house price index method. Journal of Housing Economics 15: 80–97.CrossRefGoogle Scholar
  6. Case, B., H.O. Pollakowski, and S.M. Wachter. 1991. On choosing among house price index methodologies. AREUEA Journal 19: 286–307.CrossRefGoogle Scholar
  7. Case, B., and J.M. Quigley. 1991. The dynamics of real estate prices. Review of Economics and Statistics 22: 50–58.CrossRefGoogle Scholar
  8. Case, K.E., and R.J. Shiller. 1987. Prices of single family homes since 1970: new indexes for four cities. New England Economic Review:45–56.Google Scholar
  9. Case, K.E., and R.J. Shiller. 1989. The efficiency of the market for single family homes. The American Economic Review 79: 125–137.Google Scholar
  10. Chau, K.W., S.K. Wong, and C.Y. Yiu. 2005. Adjusting for non-linear age effects in the repeat sales index. Journal of Real Estate Finance and Economics 31: 137–153.CrossRefGoogle Scholar
  11. Clapp, J.M. 1980. The elasticity of substitution for land: the effects of measurement errors. Journal of Urban Economics 8: 255–263.CrossRefGoogle Scholar
  12. Clapp, J.M., and C. Giaccotto. 1992. Estimating price trends for residential property: a comparison of repeat sales and assessed value methods. Journal of Real Estate Finance and Economics 5: 357–374.CrossRefGoogle Scholar
  13. Clapp, J.M., and C. Giaccotto. 1998. Price indexes based on the hedonic repeat-sales method: application to the housing market. Journal of Real Estate Finance and Economics 16: 5–26.CrossRefGoogle Scholar
  14. Court, A. T. 1939. Hedonic Price Indexes with Automotive Examples. In The Dynamics of Automobile Demand, pp. 98–117. New York: General Motors Corporation.Google Scholar
  15. Davis, M.A., and J. Heathcote. 2007. The price and quantity of residential land in the United States. Journal of Monetary Economics 54: 2595–2620.CrossRefGoogle Scholar
  16. de Haan, J., and F. Krsinich. 2014. Scanner Data and the Treatment of Quality Change in Rolling Year GEKS Price Indexes. Journal of Business and Economic Statistics. forthcoming.Google Scholar
  17. Deng, Y.D., and McMillen and T.F. Sing, 2012. Private residential price indices in Singapore: a matching approach. Regional Science and Urban Economics 42: 485–494.CrossRefGoogle Scholar
  18. Diewert, W.E. 1976. Exact and superlative index numbers. Journal of Econometrics 4: 114–145.CrossRefGoogle Scholar
  19. Diewert, W.E. 1992. Fisher ideal output, input and productivity indexes revisited. Journal of Productivity Analysis 3: 211–248.CrossRefGoogle Scholar
  20. Diewert, W.E. 2003a. Hedonic Regressions: A Consumer Theory Approach. In Studies in Income and Wealth 64, ed. Scanner Data, R.C. Price Indexes, and Feenstra and M.D. Shapiro, 317–348. Chicago: University of Chicago.Google Scholar
  21. Diewert, W.E. 2003b. Hedonic Regressions: A Review of Some Unresolved Issues. In Paper Presented at the 7th Meeting of the Ottawa Group, Paris, May 27–29.Google Scholar
  22. Diewert, W.E. 2010. Alternative Approaches to Measuring House Price Inflation. Discussion Paper 10-10, Department of Economics, The University of British Columbia, Vancouver, Canada, V6T 1Z1.Google Scholar
  23. Diewert, W.E. 2011. The Paris OECD-IMF Workshop on Real Estate Price Indexes: Conclusions and Future Directions. In Price and Productivity Measurement, Vol. 1: Housing, W.E. Diewert, B.M. Balk, D. Fixler, K.J. Fox and A.O. Nakamura, eds., pp. 87–116. Trafford Press.Google Scholar
  24. Diewert, W.E. and C. Shimizu 2013. Residential Property Price Indexes for Tokyo. Discussion Paper 13-07, School of Economics, The University of British Columbia, Vancouver, Canada, V6T 1Z1. Forthcoming in Macroeconomic Dynamics.Google Scholar
  25. Diewert, W.E., J. de Haan, and R. Hendriks. 2011a. The decomposition of a house price index into land and structures components: a hedonic regression approach. The Valuation Journal 6 (2011): 58–106.Google Scholar
  26. Diewert, W.E., J. de Haan and R. Hendriks 2011b. Hedonic Regressions and the Decomposition of a House Price index into Land and Structure Components. Discussion Paper 11-01, Department of Economics, University of British Columbia, Vancouver, Canada, V6T1Z1. Forthcoming in Econometric Reviews.Google Scholar
  27. Dorsey, R.E., H. Hua, W.J. Mayera, and H. Wanga. 2010. Hedonic versus repeat-sales housing price indexes for measuring the recent boom-bust cycle. Journal of Housing Economics 19: 75–93.CrossRefGoogle Scholar
  28. Ekeland, I., J.J. Heckman, and L. Nesheim. 2004. Identification and estimation of hedonic models. Journal of Political Economy 112: 60–109.CrossRefGoogle Scholar
  29. Engelhardt, G.V. 2003. Nominal loss aversion, housing equity constraints and household mobility: evidence from the United States. Journal of Urban Economics 53: 171–195.CrossRefGoogle Scholar
  30. Eurostat. 2011. Handbook on Residential Property Price Indices. Luxembourg: Eurostat.Google Scholar
  31. Fisher, I. 1922. The Making of Index Numbers. Boston: Houghton-Mifflin.Google Scholar
  32. Francke, M.K. 2008. The Hierarchical Trend Model. In Mass Appraisal Methods: An International Perspective for Property Valuers, T. Kauko and M. Damato, eds., pp. 164–180. Oxford: Wiley-Blackwell.Google Scholar
  33. Francke, M.K., and G.A. Vos. 2004. The hierarchical trend model for property valuation and local price indices. Journal of Real Estate Finance and Economics 28 (2/3): 179–208.CrossRefGoogle Scholar
  34. Gatzlaff, D.H., and D.R. Haurin. 1998. Sample selection and biases in local house value indices. Journal of Urban Economics 43: 199–222.CrossRefGoogle Scholar
  35. Genesove, D., and C. Mayer. 1997. Equity and time to sale in the real estate market. American Economic Review 87: 255–269.Google Scholar
  36. Genesove, D., and C. Mayer. 2001. Loss aversion and seller behavior: evidence from the housing market. Quarterly Journal of Economics 116: 1233–1260.CrossRefGoogle Scholar
  37. Goetzmann, W. and L. Peng 2006. Estimating house price indexes in the preference of seller reservation prices.CrossRefGoogle Scholar
  38. Goodman, A.C. and T.G. Thibodeau. 1998. Dwelling age heteroskedasticity in repeat sales house price equations.Google Scholar
  39. Griliches, Z. 1971. Introduction: hedonic price indexes revisited. In Price Indexes and Quality Change, Z. Griliches, ed., pp. 3–15. Cambridge MA: Harvard University Press.Google Scholar
  40. Gyourko, J., and A. Saiz. 2004. Reinvestment in the housing stock: the role of construction costs and the supply side. Journal of Urban Economics 55: 238–256.CrossRefGoogle Scholar
  41. Hicks, J.R. 1946. Value and Capital, 2nd ed. Oxford: Clarendon Press.Google Scholar
  42. Haurin, D.R., J.L. Haurin, T. Nadauld, and A. Sanders. 2010. List prices, sale prices and marketing time: an application to U.S. housing markets. Real Estate Economics 38: 659–685.CrossRefGoogle Scholar
  43. Ivancic, L., W.E. Diewert, and K.J. Fox. 2009. Scanner Data, Time Aggregation and the Construction of Price Indexes, Discussion Paper 09–09. Department of Economics: The University of British Columbia, Vancouver, Canada.Google Scholar
  44. Ivancic, L., W.E. Diewert, and K.J. Fox. 2011. Scanner data, time aggregation and the construction of price indexes. Journal of Econometrics 161: 24–35.CrossRefGoogle Scholar
  45. Knight, J.R., C.F. Sirmans, and G.K. Turnbull. 1998. List price information in residential appraisal and underwriting. Journal of Real Estate Research 15: 59–76.Google Scholar
  46. Koev, E., and J.M.C. Santos Silva. 2008. Hedonic Methods for Decomposing House Price Indices into Land and Structure Components, unpublished paper. Department of Economics: University of Essex, England, October.Google Scholar
  47. Machado, J.A.F., and J. Mata. 2005. Counterfactual decomposition of changes in wage distributions using quantile regression. Journal of Applied Econometrics 20: 445–465.CrossRefGoogle Scholar
  48. McMillen, D.P. 2003. The return of centralization to Chicago: using repeat sales to identify changes in house price distance gradients. Regional Science and Urban Economics 33: 287–304.CrossRefGoogle Scholar
  49. McMillen, D.P. 2008. Changes in the distribution of house prices over time: structural characteristics, neighborhood or coefficients? Journal of Urban Economics 64: 573–589.CrossRefGoogle Scholar
  50. McMillen, D.P. 2012. Repeat sales as a matching estimator. Real Estate Economics 40: 745–773.CrossRefGoogle Scholar
  51. McMillen, D.P., and P. Thorsnes. 2006. Housing renovations and the quantile repeat sales price index. Real Estate Economics 34: 567–587.CrossRefGoogle Scholar
  52. Muth, R.F. 1971. The derived demand for Urban residential land. Urban Studies 8: 243–254.CrossRefGoogle Scholar
  53. Pollakowski, H.O. 1995. Data sources for measuring house price changes. Journal of Housing Research 6 (3): 377–387.Google Scholar
  54. Rambaldi, A.N., R.R.J. McAllister, K. Collins and C.S. Fletcher. 2010. Separating Land from Structure in Property Prices: A Case Study from Brisbane Australia. School of Economics, The University of Queensland, St. Lucia, Queensland 4072, Australia.Google Scholar
  55. Rosen, S. 1974. Hedonic prices and implicit markets: product differentiation in pure competition. Journal of Political Economy 82: 34–55.CrossRefGoogle Scholar
  56. Schwann, G.M. 1998. A real estate price index for thin markets. Journal of Real Estate Finance and Economics 16 (3): 269–287.CrossRefGoogle Scholar
  57. Shimizu, C., and K.G. Nishimura. 2006. Biases in appraisal land price information: the case of Japan. Journal of Property Investment and Finance 26: 150–175.CrossRefGoogle Scholar
  58. Shimizu, C., and K.G. Nishimura. 2007. Pricing structure in Tokyo metropolitan land markets and its structural changes: pre-bubble, bubble, and post-bubble periods. Journal of Real Estate Finance and Economics 35: 475–496.CrossRefGoogle Scholar
  59. Shimizu, C., K.G. Nishimura, and Y. Asami. 2004. Search and vacancy costs in the Tokyo housing market: an attempt to measure social costs of imperfect information. Review of Urban and Regional Development Studies 16: 210–230.CrossRefGoogle Scholar
  60. Shimizu, C., K.G. Nishimura, and T. Watanabe. 2010. Housing prices in Tokyo: a comparison of hedonic and repeat sales measures. Journal of Economics and Statistics 230 (6): 792–813.Google Scholar
  61. Shimizu, C., K.G. Nishimura and T. Watanabe. 2011. House Prices at Different Stages in Buying/Selling Process. Hitotsubashi University Research Center for Price Dynamics Working Paper Working Paper,No. 69.Google Scholar
  62. Shimizu, C., K.G. Nishimura and T. Watanabe. 2012. House Prices from Magazines, Realtors, and the Land Registry. Property Market and Financial Stability, BIS Papers No.64, Bank of International Settlements, March 2012, pp. 29-38.Google Scholar
  63. Shimizu, C., H. Takatsuji, H. Ono, and K.G. Nishimura. 2010. Structural and temporal changes in the housing market and hedonic housing price indices. International Journal of Housing Markets and Analysis 3 (4): 351–368.CrossRefGoogle Scholar
  64. Standard and Poor’s. 2008. S&P/Case-Shiller Home Price indexes: Index Methodology, March 2008.Google Scholar
  65. Statistics Portugal (Instituto Nacional de Estatistica). 2009. Owner-Occupied Housing: Econometric Study and Model to Estimate Land Prices, Final Report, paper presented to the Eurostat Working Group on the Harmonization of Consumer Price Indices, March 26–27. Luxembourg: Eurostat.Google Scholar
  66. Summers, R. 1973. International comparisons with incomplete data. Review of Income and Wealth 29 (1): 1–16.CrossRefGoogle Scholar
  67. Triplett, Jack. 2004. Handbook on Hedonic Indexes and Quality Adjustments in Price Indexes. OECD Science, Technology and Industry Working Papers 2004/9.Google Scholar
  68. Thorsnes, P. 1997. Consistent estimates of the elasticity of substitution between land and non-land inputs in the production of housing. Journal of Urban Economics 42: 98–108.CrossRefGoogle Scholar
  69. White, K.J. 2004. Shazam: User’s Reference Manual, Version 10. Vancouver, Canada: Northwest Econometrics Ltd.Google Scholar

Copyright information

© Springer Japan KK, part of Springer Nature 2020

Authors and Affiliations

  1. 1.University of British ColumbiaVancouverCanada
  2. 2.National Graduate Institute for Policy Studies (GRIPS)TokyoJapan
  3. 3.Nihon University & The University of TokyoTokyoJapan
  4. 4.The University of TokyoTokyoJapan

Personalised recommendations