Model-Based Multi-modal Human-System Interaction

  • Daniela Elisabeth StröcklEmail author
  • Heinrich C. Mayr
Conference paper
Part of the Advances in Intelligent Systems and Computing book series (AISC, volume 903)


The paper presents a model-based approach to the abstract specification of multi-modal interfaces of assistive systems within the domain of Active and Assisted Living (AAL). We introduce an appropriate metamodel and a related domain specific modeling language that allow for a generic definition of multi-modal, situation dependent interactions. The language has been implemented using the metamodeling framework ADOxx®.


Human-system interaction Model centered architecture Conceptual modeling Multi-modal interface AAL Smart home 


  1. 1.
    Pal, D., Funilkul, S., Charoenkitkarn, N., Kanthamanon, P.: Internet-of-Things and smart homes for elderly healthcare: an end user perspective. IEEE Access 6, 10483–10496 (2018)CrossRefGoogle Scholar
  2. 2.
    Rubisch, M., Sozialministerium, Abt. IV/A/1, Bericht der Bundesregierung über die Lage der Menschen mit Behinderungen in Österreich 2016, Bundesministerium für Arbeit, Soziales und Konsumentenschutz (2016)Google Scholar
  3. 3.
    Mayr, H.C., et al.: HCM-L: domain-specific modeling for active and assisted living. In: Domain-Specific Conceptual Modeling, pp. 527–552. Springer, Heidelberg (2016)CrossRefGoogle Scholar
  4. 4.
    Batsakis, S., Petrakis, E.: SOWL: spatio-temporal representation, reasoning and querying over the semantic web. In: Proceedings of 6th International Conference on Semantic Systems. ACM (2010)Google Scholar
  5. 5.
    Mayr, H.C., Michael, J., Ranasinghe, S., Shekhovtsov, V., Steinberger, C.: Model centered architecture. In: Conceptual Modeling Perspectives, pp. 85–104. Springer, Heidelberg (2017)CrossRefGoogle Scholar
  6. 6.
    Liddle, S.W.: Model-driven software development. In: Handbook of Conceptual Modeling, pp. 17–54. Springer, Berlin, Heidelberg (2011)CrossRefGoogle Scholar
  7. 7.
    Bencomo, N., France, R.B., Cheng, B.H.C., Aßmann, U.: Models@run.time - Foundations, Applications, and Roadmaps. Springer, Heidelberg (2014)CrossRefGoogle Scholar
  8. 8.
    Shekhovtsov, V., Ranasinghe, S., Mayr, H.C., Michael, J.: Domain Specific Models as System Links. In: Woo, C., et al. (eds.) Advances in Conceptual Modeling. LNCS, vol. 11158. Springer, Heidelberg (2018)Google Scholar
  9. 9.
    Michael, J., et al.: The HBMS story. Enterp. Model. Inf. Syst. Arch. 13, 345–370 (2018)Google Scholar
  10. 10.
    Ranasinghe, S., et al.: A review on applications of activity recognition systems with regard to performance and evaluation. Int. J. Distrib. Sens. Netw. 12 (2016)CrossRefGoogle Scholar
  11. 11.
    Pastor, Ó., Molina, J.C.: Model-Driven Architecture in Practice: A Software Production Environment Based on Conceptual Modeling. Springer, Berlin, Heidelberg (2007)Google Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  • Daniela Elisabeth Ströckl
    • 1
    Email author
  • Heinrich C. Mayr
    • 2
  1. 1.Institute for Applied Research on AgeingCarinthia University of Applied SciencesKlagenfurtAustria
  2. 2.Alpen-Adria-Universität KlagenfurtKlagenfurtAustria

Personalised recommendations