Abstract
Although regression models offer a standard tool in machine learning, there exist barely possibilities to inspect a trained model which go beyond plotting the prediction against single features. In this contribution, we propose a general framework to visualize a trained regression model together with the training data in two dimensions. For this purpose, we rely on modern nonlinear dimensionality reduction (DR) techniques. In addition, we argue that discriminative DR techniques are particularly useful for the visualization of regression models since they can guide the projection to be more sensitive for those aspects in the data which are important for prediction. Given a data set, our framework can be utilized to visually inspect any trained regression model.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Bishop, C.M., Svensén, M., Williams, C.K.: Gtm: The generative topographic mapping. Neural computation 10(1), 215–234 (1998)
Breheny, P., Burchett, W.: Visualization of regression models using visreg (2013)
Breiman, L., Friedman, J.H., Olshen, R.A., Stone, C.J.: Classification and Regression Trees. Statistics/Probability Series. Wadsworth Publishing Company, Belmont (1984)
Cameron, A.C., Windmeijer, F.A.G.: An r-squared measure of goodness of fit for some common nonlinear regression models. Journal of Econometrics 77(2), 329–342 (1997)
Chang, C.-C., Lin, C.-J.: LIBSVM: A library for support vector machines. ACM Transactions on Intelligent Systems and Technology 2, 27:1–27:27 (2011). http://www.csie.ntu.edu.tw/ cjlin/libsvm
Efron, B., Hastie, T., Johnstone, I., Tibshirani, R.: Least angle regression. Annals of Statistics 32, 407–499 (2004)
Gisbrecht, A., Hammer, B.: Data visualization by nonlinear dimensionality reduction. WIREs Data Mining and Knowledge Discovery (2014)
Gisbrecht, A., Mokbel, B., Hammer, B.: Relational generative topographic mapping. Neurocomputing 74(9), 1359–1371 (2011)
House, T.W.: Big data research and development initiative (2012)
Lee, J.A., Verleysen, M.: Nonlinear dimensionality reduction. Springer (2007)
Peltonen, J., Klami, A., Kaski, S.: Improved learning of riemannian metrics for exploratory analysis. Neural Networks 17, 1087–1100 (2004)
Rauber, P.E., Silva, R.R.O.D., Feringa, S., Celebi, M.E., FalÃo, A.X., Telea, A.C.: Interactive image feature selection aided by dimensionality reduction. In: Bertini, E., Roberts, J.C. (eds.) EuroVis Workshop on Visual Analytics (EuroVA). The Eurographics Association (2015)
Schulz, A., Gisbrecht, A., Hammer, B.: Using discriminative dimensionality reduction to visualize classifiers. Neural Processing Letters, 1–28 (2014)
Schulz, A., Hammer, B.: Discriminative dimensionality reduction for regression problems using the fisher metric. In: Accepted in IJCNN 2015 (2015)
Simoff, S.J., Böhlen, M.H., Mazeika, A. (eds.): Visual Data Mining - Theory, Techniques and Tools for Visual Analytics. LNCS, vol. 4404. Springer, Heildelberg (2008)
van der Maaten, L., Hinton, G.: Visualizing data using t-sne. The Journal of Machine Learning Research 9(2579–2605), 85 (2008)
van der Maaten, L., Postma, E., van den Herik, H.: Dimensionality reduction: A comparative review. Technical report, Tilburg University Technical Report, TiCC-TR 2009–005 (2009)
Vapnik, V.N.: The Nature of Statistical Learning Theory. Springer, New York (1995)
Venna, J., Peltonen, J., Nybo, K., Aidos, H., Kaski, S.: Information retrieval perspective to nonlinear dimensionality reduction for data visualization. JMLR-10 11, 451–490 (2010)
Ward, M., Grinstein, G., Keim, D.A.: Interactive Data Visualization: Foundations, Techniques and Application. A.K. Peters Ltd. (2010)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this paper
Cite this paper
Schulz, A., Hammer, B. (2015). Visualization of Regression Models Using Discriminative Dimensionality Reduction. In: Azzopardi, G., Petkov, N. (eds) Computer Analysis of Images and Patterns. CAIP 2015. Lecture Notes in Computer Science(), vol 9257. Springer, Cham. https://doi.org/10.1007/978-3-319-23117-4_38
Download citation
DOI: https://doi.org/10.1007/978-3-319-23117-4_38
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-23116-7
Online ISBN: 978-3-319-23117-4
eBook Packages: Computer ScienceComputer Science (R0)