Computational Statistics

, Volume 16, Issue 1, pp 109–130 | Cite as

A study of sensitivity analysis on the method of Principal Hessian Directions

  • Lue Heng-Hui


A new method for nonparametric regression data analysis by analyzing the sensitivity of normally large perturbations with the Principal Hessian Directions (PHD) method (Li 1992) is introduced, combining the merits of effective dimension reduction and visualization. We develop techniques for detecting perturbed points without knowledge of the functional form of the regression model when a small percentage of observations is subject to normally large values. The main feature in our proposed method is to estimate the deviation angle of the PHD direction. The basic idea is to recursively trim out perturbed points which cause larger directional deviations. Our multiple trimming method always reduces the pattern-ambiguity of geometric shape information about the regression surface. Several simulations with empirical results are reported.


Dimension reduction Principal Hessian Directions Recursive trimming Visualization 



This research was supported in part by the National Science Council, R.O.C. grant #NSC86-2115-M-130-002.


  1. Chaudhuri, P., Huang, M. C., Loh, W. Y. and Yao, R. (1994), “Piecewise-polynomial regression trees,” Statistica Sinica, 4, 143–167.zbMATHGoogle Scholar
  2. Cheng, C. S. and Li, K. C. (1995), “A study of the method of Principal Hessian Direction for analysis of data from designed experiments,” Statistica Sinica, 5, 617–639.MathSciNetzbMATHGoogle Scholar
  3. Cook, R. D. (1998), “Principal Hessian Directions Revisited,” (with discussion), J. Amer. Stat. Assoc., 93, 84–100.MathSciNetCrossRefGoogle Scholar
  4. Cook, R. D. and Weisberg, S. (1989), “Regression diagnostics with dynamic graphics,” (with discussion), Technometrics, 31, 277–308.MathSciNetGoogle Scholar
  5. Duan, N. and Li, K. C. (1991), “Slicing regression: A link-free regression method,” Ann. Statist., 19, 505–530.MathSciNetCrossRefGoogle Scholar
  6. Filliben, J. J. and Li, K. C. (1997), “A systematic approach to the analysis of complex interaction patterns in two-level factorial designs,” Technometrics, 39, 286–297.CrossRefGoogle Scholar
  7. Hall, P. and Li, K. C. (1993), “On almost linearity of low dimensional projections from high dimensional data,” Ann. Statist., 21, 867–889.MathSciNetCrossRefGoogle Scholar
  8. Hsing, T. and Carroll, R. J. (1992), “An asymptotic theory for sliced inverse regression,” Ann. Statist., 20, 1040–1061.MathSciNetCrossRefGoogle Scholar
  9. Kurt, E., Anthony, R. and Herbert, S. W. (1979), Statistical Methods for Digital Computers, Vol. 3, John Wiley.Google Scholar
  10. Li, K. C. (1991), “Sliced inverse regression for dimension reduction,” (with discussion), J. Amer. Stat. Assoc., 86, 316–342.MathSciNetCrossRefGoogle Scholar
  11. Li, K. C. (1992), “On principal Hessian directions for data visualization and dimension reduction: another application of Stein’s lemma,” J. Amer. Stat. Assoc., 87, 1025–1039.MathSciNetCrossRefGoogle Scholar
  12. Li, K. C., Lue, H. H. and Chen, C. H. (2000), “Interactive Tree-structured Regression via Principal Hessian Directions,” J. Amer. Stat. Assoc., 95, 547–560.MathSciNetCrossRefGoogle Scholar
  13. Lue, H. H. (1994), “Principal-Hessian-direction-based regression trees,” unpublished Ph.D. dissertation, Department of Math., University of California, Los Angeles.Google Scholar
  14. Weisberg, S. (1985), Applied Linear Regression, John Wiley.Google Scholar
  15. Tierney, L. (1990), LISP-STAT: an object-oriented environment for statistical computing and dynamic graphics, New York: John Wiley & Sons.CrossRefGoogle Scholar

Copyright information

© Physica-Verlag 2001

Authors and Affiliations

  • Lue Heng-Hui
    • 1
  1. 1.Department of Applied StatisticsMing Chuan UniversityTaipeiTaiwan

Personalised recommendations