Skip to main content
SpringerLink
Log in

Ontology-Based User Modeling in an Augmented Audio Reality System for Museums

  • Published:
User Modeling and User-Adapted Interaction Aims and scope Submit manuscript

Abstract

Ubiquitous computing is a challenging area that allows us to further our understanding and techniques of context-aware and adaptive systems. Among the challenges is the general problem of capturing the larger context in interaction from the perspective of user modeling and human–computer interaction (HCI). The imperative to address this issue is great considering the emergence of ubiquitous and mobile computing environments. This paper provides an account of our addressing the specific problem of supporting functionality as well as the experience design issues related to museum visits through user modeling in combination with an audio augmented reality and tangible user interface system. This paper details our deployment and evaluation of ec(h)o – an augmented audio reality system for museums. We explore the possibility of supporting a context-aware adaptive system by linking environment, interaction objects and users at an abstract semantic level instead of at the content level. From the user modeling perspective ec(h)o is a knowledge-based recommender system. In this paper we present our findings from user testing and how our approach works well with an audio and tangible user interface within a ubiquitous computing system. We conclude by showing where further research is needed.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Alfaro, I., Zancanaro, M., Cappalletti, A., Nardon, M. and Guerzoni, A.: 2003, Navigating by Knowledge. In: Proceedings of the Eighth International Conference on Intelligent User Interfaces, Miami, Florida, USA, pp. 221–223.

  • P. M. Aoki R. E. Grinter A. Hurst M. H. Szymanski J. D. Thornton A. Woodruff (2002) Sotto Voce: Exploring the Interplay of Conversation and Mobile Audio Spaces Minneapolis Minnesota, USA 431–438

    Google Scholar 

  • Aoki, P. M. and Woodruff, A.: 2000, Improving Electronic Guidebook Interfaces using a Task-Oriented Design Approach. In: Proceedings of the Conference on Designing Interactive Systems, New York City, New York, USA, pp. 319–325.

  • Bartle, R. A.: 1990, Who Plays MUAs?. Comms Plus! October/November 1990, 18–19.

  • Baus, J., Krüger, A. and Wahlster W.: 2002, A Resource-Adaptive Mobile Navigation System. In: Seventh International Conference on Intelligent User Interfaces, San Francisco, California, USA, pp. 15–22.

  • G. Bell J. J. Kaye (2002) ArticleTitleDesigning technology for domestic spaces: a kitchen manifesto Gastronomica – the Journal of Food and Culture 2 IssueID2 42–62

    Google Scholar 

  • Bell, G.: 2002, Making Sense of Museums: The Museum as Cultural Ecology. Intel Labs 1–17.

  • G. Benelli A. Bianchi P. Marti E. Not D. Sennari (1999) HIPS: Hyper-Interaction within the Physical Space Florence Italy 1075–1078

    Google Scholar 

  • T. Berners-Lee J. Hendler O. Lassila (2001) ArticleTitleThe Semantic Web Scientific American 284 IssueID5 34–44 Occurrence Handle11396337

    PubMed  Google Scholar 

  • S. Bjork J. Holopainen P. Ljungstrand K. P. Akesson (2002) ArticleTitleDesigning Ubiquitous Computing Games: A Report from a Workshop Exploring Ubiquitous Computing Entertainment Personal and Ubiquitous Computing 6 443–458 Occurrence Handle10.1007/s007790200048

    Article  Google Scholar 

  • D. G. Bobrow (1991) ArticleTitleDimensions of interactions AI Magazine 12 IssueID3 64–80

    Google Scholar 

  • S. Bodker (1990) Through the Interface: A Human Activity Approach to User Interface Design Lawrence Erlbaum Associates, Inc. Malwah, New Jersey

    Google Scholar 

  • Brewster, S., Lumsden, J., Bell, M., Hall, M. and Tasker, S.: 2003, Multimodal Eyes-Free Interaction Techniques for Wearable Devices. In: Proceedings of the conference on Human factors in computing systems, Ft. Lauderdale, Florida, USA, pp. 473–480.

  • R. Burke (2002) ArticleTitleHybrid Recommender Systems: Survey and Experiments User Modeling and User-Adapted Interaction 12 IssueID4 331–370 Occurrence Handle10.1023/A:1021240730564

    Article  Google Scholar 

  • Burnett, M. and Rainsford, C.: 2001, A Hybrid Evaluation Approach for Ubiquitous Computing Environments. Ubicomp01 Workshop: Evaluation Methodologies for Ubiquitous Computing, http://zing.ncsl.nist.gov/ubicomp01/papers/Ubiquitous_Computing_Evaluation.pdf. Last viewed Aug. 15, 2005.

  • J. M. Carroll (2002) Human-Computer Interaction in the New Millenium ACM Press New York

    Google Scholar 

  • J. M. Carroll (2000) Making use: Scenario-Based Design of Human-Computer Interactions MIT Press Cambridge, Massachusetts

    Google Scholar 

  • J. P. Carse (1987) Finite and Infinite Games Ballantine Books New York

    Google Scholar 

  • B. Chandrasekaran J. R. Josephson V. R. Benjamins (1991) ArticleTitleWhat are ontologies, and why do we need them? IEEE Intelligent Systems 14 IssueID1 20–26 Occurrence Handle10.1109/5254.747902

    Article  Google Scholar 

  • Crampton-Smith, G.: 1995, The Hand that Rocks the Cradle. ID Magazine, 60–65.

  • Crofts, N., Doerr, M. and Gill, T.: 2003, The CIDOC Conceptual Reference Model: A standard for communicating cultural contents, Cultivate Interactive, 9, 7 February 2003, http://www.cultivate-int.org/issue9/chios/. Last viewed Aug. 15, 2005.

  • M. Csikszentmihalyi (1990) Flow: The Psychology of Optimal Experience Harper & Row New York

    Google Scholar 

  • D. Dean (1994) Museum Exhibition: Theory and Practice Routledge London

    Google Scholar 

  • P. Dourish (2001) Where the Action is: The Foundations of Embodied Interaction MIT Press Cambridge, Massachusetts

    Google Scholar 

  • P. Dourish (2004) ArticleTitleWhat We Talk About When We Talk About Context Personal Ubiquitous Computing 8 IssueID1 19–30 Occurrence Handle10.1007/s00779-003-0253-8

    Article  Google Scholar 

  • Eckel, G.: 2001, Immersive Audio-Augmented Environments. In: Proceedings of the Eighth Biennial Symposium on Arts and Technology at Connecticut College, New London, CT, USA. http://viswiz.gmd.de/∼eckel/publications/eckel01a.pdf. Last viewed Aug. 15, 2005.

  • P. Ehn (1989) Work-Oriented Design of Computer Artifacts Arbetslivscentrum Stockholm

    Google Scholar 

  • J. Fink A. Kobsa (2002) ArticleTitleUser Modeling for Personalized City Tours Artifical Intellegence Review 18 IssueID1 33–74 Occurrence Handle10.1023/A:1016383418977

    Article  Google Scholar 

  • G. Fischer (2001) ArticleTitleUser Modeling in Human Computer Interaction’ User Modeling and User-Adapted Interaction 11 IssueID1–2 65–86 Occurrence Handle10.1023/A:1011145532042

    Article  Google Scholar 

  • K. P. Fishkin (2004) ArticleTitleA Taxonomy for and Analysis of Tangible Interfaces Personal Ubiquitous Computing 8 IssueID5 347–358

    Google Scholar 

  • G. W. Fitzmaurice H. Ishii W. A. S. Buxton (1995) Bricks: Laying the Foundations for Graspable User Interfaces Denver Colorado, USA 442–449

    Google Scholar 

  • M. Fleck M. Frid T. Kindberg E. O’Brien-Strain R. Rajani M. Spasojevic (2002) ArticleTitleFrom Informing to Remembering: Ubiquitous Systems in Interactive Museums IEEE Pervasive Computing 1 IssueID2 13–21 Occurrence Handle10.1109/MPRV.2002.1012333

    Article  Google Scholar 

  • G. Gay H. Hembrooke (2004) Activity-Centered Design: An Ecological Approach to Designing Smart Tools and Usable Systems MIT Press Cambridge, Massachusetts

    Google Scholar 

  • Goecks, J. and Shavlik, J.: 2000, Learning Users’ Interests by Unobtrusively Observing their Normal Behavior. In: Proceedings of the fifth international conference on Intelligent user interfaces. New Orleans, Louisiana, USA, pp. 129–132.

  • J. Goßmann M. Specht (2002) ArticleTitleLocation Models for Augmented Environments Personal and Ubiquitous Computing 6 IssueID5–6 334–340 Occurrence Handle10.1007/s007790200038

    Article  Google Scholar 

  • M. Hatala R. Wakkary L. Kalantari (2005) ArticleTitleRules and Ontologies in Support of Real-Time Ubiquitous Application Web Semantics: Science, Services and Agents on the World Wide Web 3 IssueID1 5–22

    Google Scholar 

  • Hatala, M., Kalantari, L., Wakkary, R. and Newby, K.: 2004, Ontology and Rule Based Retrieval of Sound Objects in Augmented Audio Reality System for Museum Visitors. In: Proceedings of the 2004 ACM symposium on Applied computing, Nicosia, Cyprus, pp. 1045–1050.

  • Hinckley, K., Pausch, R., Goble, J. C. and Kassell, N. F.: 1994, Passive Real-World Interface Props for Neurosurgical Visualization. In: Proceedings of the SIGCHI conference on Human factors in computing systems, Boston, Massachusetts, USA, pp. 452–458.

  • L.E. Holmquist J. Redström P. Ljungstrand (1999) Token-Based Access to Digital Information Karlsruhe Germany 234–245

    Google Scholar 

  • J. Huizinga (1964) Homo Ludens: A Study of the Play-element in Culture Beacon Press Boston

    Google Scholar 

  • C. Hummels A.v.d. Helm (2004) ArticleTitleISH and the Search for Resonant Tangible Interaction Personal Ubiquitous Computing 8 IssueID5 385–388

    Google Scholar 

  • H. Ishii C. Wisneski J. Orbanes B. Chun J. Paradiso (1999) Pingpongplus: Design of an Athletic-Tangible Interface for Computer-Supported Cooperative Play Pittsburgh Pennsylvania, USA 394–401

    Google Scholar 

  • H. Ishii B. Ullmer (1997) Tangible Bits: Towards Seamless Interfaces between People, Bits and Atoms Atlanta Georgia, USA 234–241

    Google Scholar 

  • Konstan J.A., Rield J., Borchers A. and Herlocker J.L. (1998). Recommender Systems: A GroupLens Perspective. Recommender Systems: Papers from the 1998 Workshop Menlo Park, California USA, pp. 60–64.

  • J. Kopena W. C. Regli (2003) ArticleTitleDAMLJessKB: A Tool for Reasoning with the Semantic Web IEEE Intelligent Systems 18 IssueID3 74–77 Occurrence Handle10.1109/MIS.2003.1200733

    Article  Google Scholar 

  • G. Leinhardt K. Crowley (1998) Museum Learning as Conversational Elaboration: A Proposal to Capture, Code and Analyze Museum Talk. Vol. Museum Learning Collaborative Technical Report MLC-01 University of Pittsburgh Learning Research and Development Center Pittsburgh, PA

    Google Scholar 

  • Lieberman H. (1995). Letizia: An Agent that Assists Web Browsing. International Joint Conference on Artificial Intelligence (IJCAI-95). Montreal, Quebec, Canada, pp. 475–480.

  • Miller, C. and Funk, H. B.: 2001, Verification through User Value: Or ‘How to Avoid Drinking Your Own Bathwater in Ubicomp Evaluations. Ubicomp’01 Workshop: Evaluation Methodologies for Ubiquitous Computing, http://zing.ncsl.nist.gov /ubicomp01/papers/Ubicomp-eval3.doc. Last viewed Aug. 15, 2005.

  • Mladenic, D.: 1996, Personal WebWatcher: Implementation and Design. Vol. Technical Report IJS-DP-7472. Department for Intelligent Systems, J.Stefan Institute.

  • Mulholland, P., Collins, T. and Zdrahal, Z.: 2004, Story Fountain: Intelligent Support for Story Research and Exploration. In: Proceedings of the Ninth international conference on Intelligent user interface, Funchal, Madeira, Portugal, pp. 62–69.

  • Mynatt, E. D., Back, M. and Want, R.: 1998, Designing Audio Aura. In: Proceedings of the SIGCHI conference on Human factors in computing systems, Los Angeles, California, USA, pp. 566–573.

  • B. A. Nardi (1995) Context and Consciousness: Activity Theory and Human-Computer Interaction MIT Press Cambridge, Massachusetts

    Google Scholar 

  • B. A. Nardi V. L. O’Day (1999) Information Ecologies: Using Technology with Heart MIT Press Cambridge, Massachusetts

    Google Scholar 

  • M. Norman P. Thomas (1990) The Very Idea: Informing HCI Design from Conversation Analysis P. Luff N. Gilbert D. Frohlich (Eds) Computers and Conversation Academic Press London 51–65

    Google Scholar 

  • Not, E. and Zancanaro, M.: 2000, The MacroNode Approach: Mediating between Adaptive and Dynamic Hypermedia. In: Proceedings of the International Conference on Adaptive Hypermedia and Adaptive Web-Based Systems, Trento, Italy, pp. 167–178.

  • N. F. Noy C. D. Hafner (1997) ArticleTitleThe State of the Art in Ontology Design: A Survey and Comparative Review AI Magazine 18 IssueID3 53–74

    Google Scholar 

  • Oppermann, R. and Specht, M.: 2000, A Context-Sensitive Nomadic Exhibition Guide.In: Proceedings of the 2nd international symposium on Handheld and Ubiquitous Computing, Bristol, UK, pp. 127–142.

  • A. Pentland (1996) ArticleTitleSmart Rooms Scientific American 274 IssueID4 68–76

    Google Scholar 

  • D. Petrelli E. Not M. Zancanaro C. Strapparava O. Stock (2001) ArticleTitleModeling and Adapting to Context Personal Ubiquitous Computing 5 IssueID1 20–24 Occurrence Handle10.1007/s007790170023

    Article  Google Scholar 

  • Pirhonen, A., Brewster, S. and Holguin, C.: 2002, Gestural and Audio Metaphors as a Means of Control for Mobile Devices. In: Proceedings of the SIGCHI conference on Human factors in computing systems, Minneapolis, Minnesota, USA, pp. 291–298.

  • S. Post A. P. Sage (1990) ArticleTitleAn Overview of Automated Reasoning IEEE Transactions on Systems, Man and Cybernetics 20 IssueID1 202–224

    Google Scholar 

  • Proctor, N. and Tellis, C.: 2003, The State of the Art in Museum Handhelds in 2003’. Museum and the Web, Pittsburgh, Pennsylvania, U.S.A., http://www.archimuse. com/mw2003/papers/proctor/proctor.html. Last viewed Aug. 15, 2005.

  • P. Resnick H. R. Varian (1997) ArticleTitleRecommender Systems Communications of the ACM 40 IssueID3 56–58 Occurrence Handle10.1145/245108.245121

    Article  Google Scholar 

  • Semper, R. and Spasojevic, M.: 2002, The Electronic Guidebook: Using Portable Devices and a Wireless Web-Based Network to Extend the Museum Experience. Museum and Web, Charlotte, North Carolina, USA, http://www.archimuse. com/mw2002/papers/semper/semper.html. Last viewed Aug. 15, 2005.

  • Seo, Y. and Zhang, B.: 2000, A Reinforcement Learning Agent for Personalized Information Filtering. In: Proceedings of the fifth international conference on intelligent user interfaces, New Orleans, Louisiana, USA, pp. 248–251.

  • B. Serrell (1996) The Question of Visitor Styles S. Bitgood (Eds) Visitor Studies: Theory, Research, and Practice Visitor Studies Association Jacksonville, Alabama 48–53

    Google Scholar 

  • O. Shaer N. Leland E. H. Calvillo-Gamez R. J. K. Jacob (2004) ArticleTitleThe TAC paradigm: Specifying tangible user interfaces Personal and Ubiquitous Computing 8 IssueID5 359–369 Occurrence Handle10.1007/s00779-004-0298-3

    Article  Google Scholar 

  • Sparacino, F.: 2002, The Museum Wearable: Real-Time Sensor-Driven Understanding of Visitors’ Interests for Personalized Visually-Augmented Museum Experiences’. Museums and the Web, Boston, Massachusetts, U.S.A.,http://www.archimuse. com/mw2002/papers/sparacino/sparacino.html. Last viewed Aug. 15, 2005.

  • Spasojevic, M. and Kindberg, T.: 2001, Evaluating the CoolTown User Experience.Ubicomp’01 Workshop: Evaluation Methodologies for Ubiquitous Computing, http://zing.ncsl.nist.gov/ubicomp01/papers/Exploratorium-UbicompPosition.pdf. Last viewed Aug. 15, 2005.

  • L. A. Suchman (1987) Plans and Situated Actions: The Problem of Human-Machine Communication Cambridge University Press New York, NY

    Google Scholar 

  • Terrenghi, L. and Zimmermann, A.: 2004, Tailored Audio Augmented Environments for Museums. In: IUI ’04: Proceedings of the ninth international conference on Intelligent user interface, Funchal, Madeira, Portugal, pp.334–336.

  • Tolmie, P.: 2002, Unremarkable Computing. In: Proceedings of the SIGCHI conference on Human factors in computing systems, Minneapolis, Minnesota, USA, pp. 399–406.

  • Towle, B. and Quinn, C.: 2000, Knowledge Based Recommender Systems using Explicit User Models. Knowledge-Based Electronic Markets, Papers from the AAAI Workshop (AAAI Technical Report WS-00–04), Menlo Park, California, USA, pp. 74–77.

  • Ullmer, B.: 2002, Tangible Interfaces for Manipulating Aggregates of Digital Information. PhD Thesis, Massachusetts Institute of Technology.

  • B. Ullmer H. Ishii (2001) Emerging Frameworks for Tangible User Interfaces’ J. M. Carroll (Eds) Human-Computer Interaction in the New Millenium Addison-Wesley New York 579–601

    Google Scholar 

  • B. Ullmer H. Ishii R. J. K. Jacob (2005) ArticleTitleToken+constraint Systems for Tangible Interaction with Digital Information ACM Transactions Computer-Human Interaction 12 IssueID1 81–118 Occurrence Handle10.1145/1057237.1057242

    Article  Google Scholar 

  • D. vom Lehn C. Heath J. Hindmarsh (2001) ArticleTitleExhibiting Interaction: Conduct and Collaboration in Museums and Galleries Symbolic Interaction 24 189–216 Occurrence Handle10.1525/si.2001.24.2.189

    Article  Google Scholar 

  • Vygotsky, L. S.: 1925/1982, Consciousness as a Problem in the Psychology of Behaviour. Moscow: Pedagogika.

  • W. Wahlster A. Kobsa (1989) User Models in Dialog Systems A. Kobsa W. Wahlster (Eds) User Models in Dialog Systems Springer-Verlag, Inc. New York, NY

    Google Scholar 

  • R. Wakkary D. Evernden (2005) Museum as Ecology: A Case Study of an Ambient Intelligent Museum Guide D. Bearman J. Trant (Eds) Museums and the Web 2005 Selected Papers Canada Vancouver 151–162

    Google Scholar 

  • R. Wakkary K. Newby M. Hatala D. Evernden M. Droumeva (2004) Interactive Audio Content: The use of Audio for a Dynamic Museum Experience through Augmented Audio Reality and Adaptive Information Retrieval D. Bearman J. Trant (Eds) Museums and the Web 2004 Selected Papers Arlington Virginia 55–60

    Google Scholar 

  • Wakkary, R.: 2005, Framing Complexity, Design and Experience: A Reflective Analysis. Digital Creativity 16(1), (in press).

  • M. Weiser (1993) ArticleTitleSome Computer Science Issues in Ubiquitous Computing Communications of ACM 36 IssueID7 75–84 Occurrence Handle10.1145/159544.159617

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. School of Interactive Arts and Technology, Simon Fraser University, Surrey, BC, V3T 2W1, Canada

    Marek Hatala & Ron Wakkary

Authors
  1. Marek Hatala
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ron Wakkary
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Marek Hatala.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Hatala, M., Wakkary, R. Ontology-Based User Modeling in an Augmented Audio Reality System for Museums. User Model User-Adap Inter 15, 339–380 (2005). https://doi.org/10.1007/s11257-005-2304-5

Download citation

  • Received:

  • Accepted:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11257-005-2304-5

Keywords

Search

Navigation