Abstract
The design and implementation of combined mobile and touchscreen-based multimodal Web 3.0 interfaces should include new approaches of intelligent semantic mediation, knowledge acquisition and user interaction when dealing with a semantic-based digitalization of mostly unstructured textual or image-based source information. In this article, we propose a semantic-based model for those three tasks. The technical components rely on semantic web data structures in order to, first, transcend the traditional keyboard and mouse interaction metaphors, and second, provide the representation structures for more complex, collaborative interaction scenarios that may combine mobile with terminal-based interaction to accommodate the growing need to store, organize, and retrieve all these data. Interactive knowledge acquisition plays a major role in increasing the quality of automatic annotations as well as the usability of different intelligent user interfaces to control, correct, and add annotations to unstructured text and image sources. Examples are provided in the context of the Medico and Texo use cases.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
H. Bunt, R.J. Beun (eds.), Cooperative Multimodal Communication. Volume 2155 of Lecture Notes in Computer Science (Springer, Berlin/Heidelberg/New York, 2001), http://dblp.uni-trier.de/db/conf/cmc/cmc1998.html
P. Cimiano, P. Haase, J. Heizmann, Porting natural language interfaces between domains: an experimental user study with the ORAKEL system, in Proceedings of the 12th International Conference on Intelligent User Interfaces (IUI ’07), Honolulu (ACM, New York, 2007), pp. 180–189
R. Engel, SPIN: a semantic parser for spoken dialog systems, in Proceedings of the 5th Slovenian and First International Language Technology Conference (IS-LTC ’06) (Ljubljana, Slovenia, 2006)
J. Euzenat, P. Shvaiko, Ontology Matching (Springer, Berlin/Heidelberg/New York, 2007)
T.S. Huang, A. Nijholt, M. Pantic, A. Pentland (eds.), Artifical Intelligence for Human Computing. Volume 4451 of Lecture Notes in Computer Science (Springer, Berlin/Heidelberg/New York, 2007)
A. Jameson, A. Spaulding, N. Yorke-Smith, Introduction to the special issue on usable AI. AI Mag. 30(4), 11–15 (2009), http://www.aaai.org/ojs/index.php/aimagazine/article/view/2273
V. Lopez, M. Pasin, E. Motta, AquaLog: an ontology-portable question answering system for the semantic web, in The Semantic Web: Research and Applications, ed. by A. Gómez-Pérez, J. Euzenat. Volume 3532 of Lecture Notes in Computer Science (Springer, Berlin/Heidelberg/New York, 2005), pp. 546–562
T.M. Mitchell, Machine Learning (Mcgraw-Hill New York, 1997)
D. Porta, M. Deru, S. Bergweiler, G. Herzog, P. Poller, Building multimodal dialog user interfaces in the context of the internet of services, in Towards the Internet of Services: The THESEUS Research Program, ed. by W. Wahlster, H.J. Grallert, S. Wess, H. Friedrich, T. Widenka (Springer, Berlin/Heidelberg/New York, 2014)
V.A. Ramachandran, I. Krishnamurthi, NLION: natural language interface for querying ONtologies, in Proceedings of the 2nd Bangalore Annual Compute Conference (COMPUTE ’09), Bangalore, ed. by R.K. Shyamasundar (ACM, New York, 2009), http://dblp.uni-trier.de/db/conf/compute/compute2009.html#RamachandranK09
S. Russel, P. Norvig, Artificial Intelligence: A Modern Approach, vol. 2 (Pearson, Upper Saddle River, 2003)
D. Sonntag, Towards dialogue-based interactive semantic mediation in the medical domain, in Proceedings of the Third International Workshop on Ontology Matching (OM) collocated with the 7th International Semantic Web Conference (ISWC ’08), Karlsruhe (2008)
D. Sonntag, Ontologies and Adaptivity in Dialogue for Question Answering. Volume 4 of Studies on the Semantic Web (AKA and IOS Press, Heidelberg, 2010)
D. Sonntag, Collaborative Multimodality. KI – Künstliche Intelligenz 26(2), 161–168 (2012), http://dblp.uni-trier.de/db/journals/ki/ki26.html#Sonntag12
D. Sonntag, C. Weihrauch, O. Jacobs, D. Porta, THESEUS CTC-WP4 usability guidelines for use case applications, Technical report, DFKI GmbH, BMWi, April 2010, http://www.dfki.de/web/forschung/publikationen?pubid=4788
W. Wahlster, SmartWeb: Ein multimodales Dialogsystem für das semantische Web, in Informatikforschung in Deutschland, ed. by B. Reuse, R. Vollmar (Springer, Berlin/Heidelberg/New York, 2008), pp. 300–311
D.L. Weiss, C.P. Langlotz, Structured reporting: patient care enhancement or productivity nightmare? Radiology 249, 739–747 (2008)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this chapter
Cite this chapter
Sonntag, D., Porta, D. (2014). Intelligent Semantic Mediation, Knowledge Acquisition and User Interaction. In: Wahlster, W., Grallert, HJ., Wess, S., Friedrich, H., Widenka, T. (eds) Towards the Internet of Services: The THESEUS Research Program. Cognitive Technologies. Springer, Cham. https://doi.org/10.1007/978-3-319-06755-1_14
Download citation
DOI: https://doi.org/10.1007/978-3-319-06755-1_14
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-06754-4
Online ISBN: 978-3-319-06755-1
eBook Packages: Computer ScienceComputer Science (R0)