Understanding Simple Stories through Concepts Extraction and Multimedia Elements
Teaching children with intellectual disabilities is a challenging task. Instructors use different methodologies and techniques to introduce the concepts of lessons to the children, motivate them and keep them engaged. These methodologies include reading texts, showing pictures and images, touching items, taking children to sites to see and understand, and even using the taste and smell senses (i.e., hot, cold). The objective of this work is to develop a system that can assist the children with special needs to improve their understanding of simple stories related to the animals and foods domain through multimedia technology. We use formal concepts analysis and a simple ontology to extract the keywords representing characters, actions, and objects from the story text and link them with the corresponding multimedia elements (i.e., images, sounds and clips). These elements are retrieved by querying Google database using Google APIs features. The instructors would have to validate the obtained results and select what is appropriate for the children in the classroom. The system allows the instructor to input the story text and get as output the multimedia story.
KeywordsMultimedia Special Education Keywords Extraction Formal Concepts Analysis Ontology
Unable to display preview. Download preview PDF.
- 1.Alja’am, J.M., Jaoua, A.M., Hasnah, A.M., Hassan, F., Mohamed, H., Mosaid, T., Saleh, H., Abdullah, F., Hassan, C.: Text Summarization based on Conceptual Data Classification. In: Alkhatib, G., Rine, D.D. (eds.) Agent Technologies and Web Engineering: Applications and Systems, pp. 195–209. IGI Global (2008)Google Scholar
- 2.Elsaddik, A.: Interactive Multimedia Learning. Springer (2001)Google Scholar
- 4.Ganter, B., Wille, R.: Formal Concept Analysis. Springer (1999)Google Scholar
- 5.Google Ajax Language APIs, http://code.google.com/apis/ajaxlanguage/
- 6.Gunther, S., Ströhlein, T.: Relations and Graphs. Springer (1989) Google Scholar
- 7.Jaoua, A.: Pseudo-Conceptual Text and Web Structuring. In: The Third Conceptual Structures Tool Interoperability Workshop, CS-TIW 2008, pp. 22–32 (2008)Google Scholar
- 8.Miguel, A.G.R., El-Seoud, S.A., Edwards, A., Alja’am, J.M., Raul, A.S.: Integrating the Sense of Smell in an Educational Human-Computer Interface. In: International Conference on Interactive Collaborative Learning, ICL 2008, pp. 1–7 (2008)Google Scholar
- 9.Nickull, D., Reitman, L., Ward, J., Wilber, J.: Service Oriented Architecture (SOA) and Specialized Messaging Patterns. Technical White Paper, pp. 1–15, (2007), http://www.adobe.com/enterprise/pdfs/Services_Oriented_Architecture_from_Adobe.pdf