Abstract
User generated virtual worlds, such as Second Life, typically lack accurate metadata for their virtual world objects. This is a significant problem for blind users who rely on textual descriptions in order to access virtual worlds using synthetic speech. In this paper, we consider the problem of automatic object labeling to improve accessibility of virtual worlds for users with disabilities. Taking advantage of the primitivebased representation of virtual world objects in Second Life, we present an approach that leverages histogram-based geometric object representations, machine learning and crowdsourcing to accurately label virtual world objects at a large scale. We report excellent classification results using seven challenging object classes.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Ibm human ability and accessibility center, virtual worlds user interface for the blind, http://www-03.ibm.com/able/accessibility_research_projects/virtual_worlds_accessible_UI.html (access April 5, 2009)
Linden lab’s second life ’extremely profitable,’ company looking to expand, http://massively.joystiq.com/2012/03/15/linden-labs-second-life-extremely-profitable-company-looking/ (access August 18, 2012)
Virtual guide dog project, http://virtualguidedog.org (access March 4, 2009)
Csurka, G., Dance, C., Willamowski, J., Fan, L., Bray, C.: Visual categorization with bags of keypoints. In: ECCV International Workshop on Statistical Learning in Computer Vision (2004)
Cybenko, G., Bhasin, A., Cohen, K.D.: Pattern recognition of 3D cad objects: Towards an electronic yellow pages of mechanical parts. Int. J. Smart Eng. Syst. Design 1(1), 1–13 (1997)
Fehr, J., Burkhardt, H.: Harmonic shape histograms for 3D shape classification and retrieval. In: IAPR Conference on Machine Vision Applications, pp. 384–387 (2007)
Fehr, J., Streicher, A., Burkhardt, H.: A bag of features approach for 3D shape retrieval. In: Bebis, G., et al. (eds.) ISVC 2009, Part I. LNCS, vol. 5875, pp. 34–43. Springer, Heidelberg (2009)
Folmer, E., Yuan, B., Carr, D., Sapre, M.: Textsl: a command-based virtual world interface for the visually impaired. In: Proceedings of the 11th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS 2009), Pittsburgh, Pennsylvania, USA, pp. 59–66 (2009)
Hearst, M.A., Dumais, S.T., Osman, E., Platt, J., Scholkopf, B.: Support vector machines. IEEE Intelligent Systems and their Applications 13(4), 18–28 (1998)
Hilaga, M., Shinagawa, Y., Kohmura, T., Kunii, T.L.: Topology matching for fully automatic similarity estimation of 3D shapes. In: Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques, pp. 203–212. ACM (2001)
Huber, D., Kapuria, A., Donamukkala, R., Hebert, M.: Parts-based 3D object classification. In: Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR 2004, pp. 82–89. IEEE Computer Society, Washington, DC (2004)
Mika, S., Ratsch, G., Weston, J., Scholkopf, B., Mullers, K.R.: Fisher discriminant analysis with kernels. In: Proceedings of the 1999 IEEE Signal Processing Society Workshop on Neural Networks for Signal Processing IX, pp. 41–48. IEEE (1999)
Chazelle, B., Osada, R., Funkhouser, T., Dobkin, D.: Matching 3D models with shape distributions. In: Shape Modeling and Applications, pp. 154–166 (2001)
Shilane, P., Funkhouser, T.: Selecting distinctive 3D shape descriptors for similarity retrieval. In: IEEE International Conference on Shape Modeling and Applications, SMI 2006, p. 18. IEEE (2006)
Vranić, D.V.: 3D model retrieval. University of Leipzig, Germany. PhD thesis (2004)
Yuan, B., Sapre, M., Folmer, E.: Seek-n-tag: a game for labeling and classifying virtual world objects. In: Proceedings of Graphics Interface, GI 2010, Ottawa, Ontario, Canada, pp. 201–208 (2010)
Zhang, C., Chen, T.: Indexing and retrieval of 3D models aided by active learning. In: Proceedings of the Ninth ACM International Conference on Multimedia, pp. 615–616. ACM (2001)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Apostolopoulos, I., Folmer, E., Bebis, G. (2013). Improving Accessibility of Virtual Worlds by Automatic Object Labeling. In: Bebis, G., et al. Advances in Visual Computing. ISVC 2013. Lecture Notes in Computer Science, vol 8034. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-41939-3_25
Download citation
DOI: https://doi.org/10.1007/978-3-642-41939-3_25
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-41938-6
Online ISBN: 978-3-642-41939-3
eBook Packages: Computer ScienceComputer Science (R0)