User Interaction for Visual Lifelog Retrieval in a Virtual Environment

  • Aaron DuaneEmail author
  • Cathal Gurrin
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11295)


Efficient retrieval of lifelog information is an ongoing area of research due to the multifaceted nature, and ever increasing size of lifelog datasets. Previous studies have examined lifelog exploration on conventional hardware platforms, but in this paper we describe a novel approach to lifelog retrieval using virtual reality. The focus of this research is to identify what aspects of lifelog retrieval can be effectively translated from a conventional to a virtual environment and if it provides any benefit to the user. The most widely available lifelog datasets for research are primarily image-based and focus on continuous capture from a first-person perspective. These large image corpora are often enhanced by image processing techniques and various other metadata. Despite the rapidly maturing nature of virtual reality as a platform, there has been very little investigation into user interaction within the context of lifelogging. The experiment outlined in this work seeks to evaluate four different virtual reality user interaction approaches to lifelog retrieval. The prototype system used in this experiment also competed at the Lifelog Search Challenge at ACM ICMR 2018 where it ranked first place.


Virtual reality Lifelog Retrieval User interaction 


  1. 1.
    Yang, Y., Lee, H., Gurrin, C.: Visualizing lifelog data for different interaction platforms. In: CHI 2013 Extended Abstracts on Human Factors in Computing Systems on - CHI EA 2013, p. 1785 (2013).
  2. 2.
    Sellen, A.J., Whittaker, S.: Beyond total capture. Commun. ACM 53(5), 70 (2010). ISSN 0001-078CrossRefGoogle Scholar
  3. 3.
    Gurrin, C., et al.: NTCIR lifelog: the first test collection for lifelog research. In: Proceedings of the 39th International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 705–708. ACM (2016). ISBN 978-1-4503-4069-4.
  4. 4.
    Duane, A., Gurrin, C.: Lifelog exploration prototype in virtual reality. In: Schoeffmann, K., et al. (eds.) MMM 2018. LNCS, vol. 10705, pp. 377–380. Springer, Cham (2018). Scholar
  5. 5.
    Gurrin, C., et al.: Overview of NTCIR-13 lifelog-2 task. In: Proceedings of the 13th NTCIR Conference on Evaluation of Information Access Technologies, NTCIR, pp. 6–11 (2017). ISBN 978-4-86049-075-1Google Scholar
  6. 6.
    Dale, E.: Audio-Visual Methods in Teaching, 3rd edn, pp. 12–13. Dryden Press, New York (1969)Google Scholar
  7. 7.
    Krokos, E., Plaisant, C., Varshney, A.: Virtual memory palaces: immersion aids recall. Virtual Reality, 1–15 (2018).
  8. 8.
    Nakazato, M., Huang, T.S.: 3D MARS: immersive virtual reality for content-based image retrieval. In: Proceedings of 2001 IEEE International Conference on Multimedia and Expo (ICME2001) (2001)Google Scholar
  9. 9.
    Gurrin, C., Lee, H., Caprani, N., Zhang, Z.X., O’Connor, N., Carthy, D.: Browsing large personal multimedia archives in a lean-back environment. In: Boll, S., Tian, Q., Zhang, L., Zhang, Z., Chen, Y.-P.P. (eds.) MMM 2010. LNCS, vol. 5916, pp. 98–109. Springer, Heidelberg (2010). Scholar
  10. 10.
    LSC 2018: Proceedings of the 2018 ACM Workshop on the Lifelog Search Challenge. ACM, Yokohama (2018). ISBN 978-1-4503-5796-8Google Scholar
  11. 11.
    Likert, R.: A Technique for the Measurement of Attitudes, p. 55. The Science Press, New York (1932)Google Scholar
  12. 12.
    Duane, A., Huerst, W., Gurrin, C.: Virtual reality lifelog explorer. In: Proceedings of the 2018 ACM on International Conference on Multimedia Retrieval. ACM (2018)Google Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  1. 1.Insight Centre for Data AnalyticsDublinIreland

Personalised recommendations