Multimedia Tools and Applications

, Volume 71, Issue 1, pp 39–60 | Cite as

Interactive faceted search and exploration of open social media data on a touchscreen mobile phone

  • Alexander Kleinen
  • Ansgar ScherpEmail author
  • Steffen Staab


A central challenge of semantic ambient media applications is designing smart user interfaces that are able to dynamically deal with an a-priori unknown number of data categories and data instances received live from different Linked Open Data sources while at the same time being intuitive and easy to use. In the mobile world, this challenge is even more difficult as the mobile devices have limited interaction possibilities and smaller display size. In this paper, we tackle this challenge and present the user-centered, iterative design of a mobile application for faceted search and exploration of a large, multi-dimensional data set of open social media on a touchscreen mobile phone. The application is called Mobile Facets and provides live retrieval and interactive search and exploration of resources like places, persons, organizations, and events originating from different, integrated social media sources like DBpedia, Eventful, Upcoming, Flickr, and GeoNames. In contrast to existing work, we do not know in advance the number and type of data categories and data instances that will be received as the data is queried live from the sources. While developing Mobile Facets, we have applied a participatory design with a small group of five users. For the final prototype we have conducted a task-based, formative evaluation with 12 additional subjects to investigate the applicability and usability of our Mobile Facets application.


Mobile computing Faceted search and exploration Social media 



We thank all subjects participating in the evaluation. This research has been co-funded by the EU in FP7 in the IP WeKnowIt (215453) and IP SocialSensor (287975).


  1. 1.
    Arndt H (2006) Integrierte informationsarchitektur: die erfolgreiche konzeption professioneller websites. Springer, BerlinGoogle Scholar
  2. 2.
    Auer S, Bizer C, Kobilarov G, Lehmann J, Cyganiak R, Ives ZG (2007) DBpedia: a nucleus for a web of open data. In: ISWC/ASWC. Springer, BerlinGoogle Scholar
  3. 3.
    de Oliveira Neto JaS, Roussel N, Filgueiras LV (2009) User’s issues in crossmedia applications. In: Proceedings of the 27th ACM international conference on design of communication, SIGDOC ’09. ACM, New York, pp 119–126CrossRefGoogle Scholar
  4. 4.
    English J, Hearst M, Sinha R, Swearingen K, Yee K-P (2002) Flexible search and navigation using faceted metadata. Technical report, University of BerkeleyGoogle Scholar
  5. 5.
    Franz T, Schultz A, Sizov S, Staab S (2009) TripleRank: ranking semantic web data by tensor decomposition. In: ISWCGoogle Scholar
  6. 6.
    Gediga G, Hamborg K-C (1999) IsoMetrics: an usability inventory supporting summative and formative evaluation of software systems. In: HCI (1). Lawrence Erlbaum, Hove, pp 1018–1022Google Scholar
  7. 7.
    Gediga G, Hamborg K-C (2001) Evaluation of software systems. In: Encyclopedia of computer science and technology, vol 45Google Scholar
  8. 8.
    Hearst MA (2006) Design recommendations for hierarchical faceted search interfaces. In: Workshop on faceted search, pp 26–30Google Scholar
  9. 9.
    Hearst MA (2008) UIs for faceted navigation: recent advances and remaining open problems. In: Computer interaction and information retrievalGoogle Scholar
  10. 10.
    Heath T, Bizer C (2011) Linked data: evolving the web into a global data space. Morgan & Claypool. Accessed 6 Feb 2013
  11. 11.
    Hildebrand M, van Ossenbruggen J, Hardman L (2006) /facet: a browser for heterogeneous semantic web repositories. In: ISWCGoogle Scholar
  12. 12.
    Jacobson I, Booch G, Rumbaugh J (1999) The unified software development process. Object technology. Addison Wesley Longman, Don MillsGoogle Scholar
  13. 13.
    Karlson AK, Robertson GG, Robbins DCC, Czerwinski MP, Smith GR (2006) FaThumb: a facet-based interface for mobile search. In CHI. ACM, New YorkGoogle Scholar
  14. 14.
    Lewis C, Rieman J, Blustein AJ (1994) Task-centered user interface design: a practical introduction. Accessed 6 Feb 2013
  15. 15.
    Oren E, Delbru R, Decker S (2006) Extending faceted navigation for RDF data. In: International semantic web conferenceGoogle Scholar
  16. 16.
    Pogorelc B, Vatavu R, Lugmayr A, Stockleben B, Risse T, Kaario J, Lomonaco EC, Gams M (2011) Re-thinking the future of semantic ambient media. Multimed Tools Appl. doi: 10.1007/s11042-011-0917-8 Google Scholar
  17. 17.
    Sacco G (2009) Dynamic taxonomies and faceted search: theory, practice, and experience. Springer, BerlinCrossRefGoogle Scholar
  18. 18.
    Schmeiß D, Scherp A, Staab S (2010) Integrated mobile visualization and interaction of events and POIs. In: Multimedia, Firenze, Italy. ACM, New York, pp 1567–1570Google Scholar
  19. 19.
    Schraefel MC, Smith DA, Owens A et al (2005) The evolving mspace platform: leveraging the semantic web on the trail of the memex. In: HypertextGoogle Scholar
  20. 20.
    Segerståhl K (2009) Crossmedia systems constructed around human activities: a field study and implications for design. In: 12th IFIP TC13 international conference on human–computer interaction—INTERACT 2009, Uppsala, Sweden. Lecture notes in computer science, vol 5727. Springer, New York, pp 354–367Google Scholar
  21. 21.
    Sohn T, Li KA, Griswold WG, Hollan JD (2008) A diary study of mobile information needs. In: CHI. ACM, New York, pp 433–442Google Scholar
  22. 22.
    Tan S, Ngo C-W, Tan H-K, Pang L (2011) Cross media hyperlinking for search topic browsing. In: Proceedings of the 19th international conference on multimedia 2011, Scottsdale, AZ, USA. ACM, New York, pp 243–252Google Scholar
  23. 23.
    Trappeniers L, Godon M, Claeys L, Martinot O, Marilly E (2008) Cross-media experiences: ambient community interactions in the city. Bell Labs Tech J 13(2):5–11CrossRefGoogle Scholar
  24. 24.
    van Aart CJ, Wielinga BJ, van Hage WR (2010) Mobile cultural heritage guide: location-aware semantic search. In: EKAW. Springer, New YorkGoogle Scholar
  25. 25.
    Wilson ML, Russell A, Smith DA, Owens A, Schraefel MC (2005) mSpace Mobile: a mobile application for the semantic web. In: End user semantic web workshopGoogle Scholar
  26. 26.
    Wilson ML, Smith DA, Russell A, Schraefel MC (2006) mSpace Mobile: a UI Gestalt to support on-the-go info-interaction. In: CHIGoogle Scholar
  27. 27.
    Yee K-P, Swearingen K, Li K, Hearst M (2003) Faceted metadata for image search and browsing. In: Human factors in computing systems. ACM, New YorkGoogle Scholar

Copyright information

© Springer Science+Business Media New York 2013

Authors and Affiliations

  • Alexander Kleinen
    • 1
  • Ansgar Scherp
    • 1
    Email author
  • Steffen Staab
    • 1
  1. 1.Institute for Web Science and TechnologiesUniversity of Koblenz-LandauKoblenzGermany

Personalised recommendations