Accessible UI Design and Multimodal Interaction through Hybrid TV Platforms: Towards a Virtual-User Centered Design Framework

  • Pascal Hamisu
  • Gregor Heinrich
  • Christoph Jung
  • Volker Hahn
  • Carlos Duarte
  • Pat Langdon
  • Pradipta Biswas
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6766)


We report on work towards an architecture that incorporates accessible design methods, guidelines and support tools for building and testing adaptive and accessible user interfaces (UI) for users with mild impairments. We especially address interaction constraints for elderly people, both during application design time and at run time, targeting on hybrid TV platforms. The functional principle of our architecture is twofold: At runtime, it lets users interact with hybrid TV applications through an ensemble of accessible UIs that cover different input and output modalities and are jointly adapted via user profiles and real-time feedback. At design time, it allows developers to re-use UIs and representative user personas in simulating the effect of the UI modalities on different impairments.


Inclusive Design Accessibility Guidelines Development Methods Access to the Web Hybrid TV Connected TV Interaction Techniques Usability and User Experience Virtual User User Simulation Context–awareness Architectures and Tools for Universal Access Adaptive and augmented Interaction 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Gavrilov, L.A., Heuveline, P.: Aging of Population. In: Demeny, P., McNicoll, G. (eds.) The Encyclopedia of Population. Macmillan Reference USA, NY (2003)Google Scholar
  2. 2.
    Fisk, A.D., Rogers, W.A., Charness, N., Czaja, S.J., Sharit, J.: Designing for Older Adults. CRC, Boca Raton (2004)CrossRefGoogle Scholar
  3. 3.
    Fozard, J.: Vision and Hearing in Aging. In: The Handbook of the Psychology of Ageing, pp. 150–170. Academic, New York (1990)Google Scholar
  4. 4.
    Goodman-Deane, J., Keith, S., Whitney, G.: HCI and the older population. In: Proceedings of the 22nd British HCI Group Annual Conference on People and Computers: Culture, Creativity, Interaction, BCS, Swinton, UK, vol. 2, pp. 193–194.Google Scholar
  5. 5.
    W3C-WAI, Web Accessibility Initiative,
  6. 6.
    WAI-ARIA-1.0, Acessible Rich Interanet Applications, w3c cand. recom (January 18, 2011)Google Scholar
  7. 7.
    Kinsella, K., Wan, H., Way, P.: An Aging World: 2008. U.S. Department of Commerce, Economics and Statistics Administration, U.S Census Bureau (issued June 2009)Google Scholar
  8. 8.
    HbbTV, Hybrid Broadcast Broadband TV,
  9. 9.
    APPMARKET, Analysis and news media convergenceGoogle Scholar
  10. 10.
    AT-SPI Toolkit, Assistive Technology Service Provider Interface Google Scholar
  11. 11.
    GNOME ATK, Accessibilty ToolkitGoogle Scholar
  12. 12.
    MSAA, Microsoft Active Accessibility APIGoogle Scholar
  13. 13.
    JAAPI, Java Accessibility APIGoogle Scholar
  14. 14.
    Zimmermann, G., Vanderheiden, G.: The Universal Control Hub: An Open Platform for Remote User Interfaces in the Digital Home. In: Jacko, J.A. (ed.) HCI 2007. LNCS, vol. 4551, pp. 1040–1049. Springer, Heidelberg (2007)CrossRefGoogle Scholar
  15. 15.
    Moumtzi, V., Farinos, J., Wills, C.: T-Seniority: an online service platform to assist independent living of elderly population. In: Proc. of the 2nd Intl. Conf. on Pervasive Technologies Related To Assistive Environments (PETRA), Corfu, Greece (2009)Google Scholar
  16. 16.
    Tazari, M.: An Open Distributed Framework for Adaptive User Interaction in Ambient Intelligence. In: Proceedings of the 1st International Joint Conference on Ambient Intelligence, Malaga, Spain, November 10–12 (2010)Google Scholar
  17. 17.
    Duarte, C., Carriço, L., Guimarães, N.: Evaluating Usability Improvements by Combining Visual and Audio Modalities in the Interface. In: Proceedings of the Twelfth International Conference on Human-Computer Interaction (2007) (accepted for publication)Google Scholar
  18. 18.
    Duarte, C., Carriço : A Conceptual Framework for Developing Adaptive Multimodal Applications. In: Proceedings of IUI 2006, 11th International Conference on Intelligent User Interfaces, Sydney, Australia, pp. 132–139. ACM Press, New York (2006)Google Scholar
  19. 19.
    Naumann, A., Wechsung, I., Hurtienne, J.: Multimodality, Inclusive Design, and Intuitive Use. Paper Presented at the Is Prior Experience the Same as Intuition in the Context of Inclusive Design? Workshop of the 23rd British Computer Society Human Computer Interaction Workshop and Conference, Cambridge (2009)Google Scholar
  20. 20.
    ETSI EG 202 191 V1.1.1 (2003-2008), Human factors; Multimodal interaction, communication and navigation guidelines (2003)Google Scholar
  21. 21.
    Orvec, J.A.: Virtual Individuals, Virtual Groups: Human Dimensions of Groupware and Computer Networking. Cambridge University Press, New York (1996)CrossRefGoogle Scholar
  22. 22.
    Biswas, P., Langdon, P., Clarkson, P.J., Robinson, P.: A case study in simulated HCI for special needs. In: Designing Inclusive Futures. Springer, London (2008) ISBN: 978-1-84800-211-1Google Scholar
  23. 23.
    EU-COM/2003; Open platforms in digital television and 3G Brussels (July 2003)Google Scholar
  24. 24.
  25. 25.
    Zimmermann, G., et al.: Toward a Unified Universal Remote Console Standard. In: CHI 2003 Extended Abstracts, p. 874f (2003)Google Scholar
  26. 26.
    Langdon, P., Gonzalez, M., Biswas, P.: Designing studies for requirements and modeling of users for an accessible set-top box. In: Proc. 8th Intl. Conf. on Disability, Virtual Reality and Assoc. Technologies, Chile, pp. 203–212 (2011)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2011

Authors and Affiliations

  • Pascal Hamisu
    • 1
  • Gregor Heinrich
    • 2
  • Christoph Jung
    • 1
  • Volker Hahn
    • 1
  • Carlos Duarte
    • 3
  • Pat Langdon
    • 4
  • Pradipta Biswas
    • 4
  1. 1.Fraunhofer-IGDGermany
  2. 2.vsonix GmbHGermany
  3. 3.University of LisbonPortugal
  4. 4.University of CambridgeUK

Personalised recommendations