Advertisement

A Test Collection for Interactive Lifelog Retrieval

  • Cathal Gurrin
  • Klaus Schoeffmann
  • Hideo Joho
  • Bernd Munzer
  • Rami Albatal
  • Frank Hopfgartner
  • Liting Zhou
  • Duc-Tien Dang-NguyenEmail author
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11295)

Abstract

There is a long history of repeatable and comparable evaluation in Information Retrieval (IR). However, thus far, no shared test collection exists that has been designed to support interactive lifelog retrieval. In this paper we introduce the LSC2018 collection, that is designed to evaluate the performance of interactive retrieval systems. We describe the features of the dataset and we report on the outcome of the first Lifelog Search Challenge (LSC), which used the dataset in an interactive competition at ACM ICMR 2018.

Keywords

Interactive retrieval Lifelogging Comparative evaluation Test collection Multimodal dataset 

Notes

Acknowledgements

We acknowledge the financial support of Science Foundation Ireland (SFI) under grant number SFI/12/RC/2289 and JSPS KAKENHI under Grant Number 18H00974.

References

  1. 1.
    Alsina, A., Giró, X., Gurrin, C.: An interactive lifelog search engine for LSC2018. In: ACM Workshop on The Lifelog Search Challenge, LSC 2018, pp. 30–32. ACM, New York (2018)Google Scholar
  2. 2.
    Bush, V.: As we may think. Interactions 3(2), 35–46 (1996)CrossRefGoogle Scholar
  3. 3.
    Dang-Nguyen, D.-T., Piras, L., Riegler, M., Boato, G., Zhou, L., Gurrin, C.: Overview of ImageCLEFlifelog 2017: lifelog retrieval and summarization. In: CLEF2017 Working Notes, Dublin, Ireland, 11–14 September 2017Google Scholar
  4. 4.
    Dang-Nguyen, D.-T., Piras, L., Riegler, M., Zhou, L., Lux, M., Gurrin, C.: Overview of ImageCLEFlifelog 2018: daily living understanding and lifelog moment retrieval. In: CLEF2018 Working Notes, CEUR Workshop Proceedings, Avignon, France, 10–14 September 2018. CEUR-WS.org (2018)Google Scholar
  5. 5.
    Dang-Nguyen, D.-T., Zhou, L., Gupta, R., Riegler, M., Gurrin, C.: Building a disclosed lifelog dataset:challenges, principles and processes. In: Content-Based Multimedia Indexing (CBMI) (2017)Google Scholar
  6. 6.
    Dodge, M., Kitchin, R.: Outlines of a world coming into existence: pervasive computing and the ethics of forgetting. Environ. Plan. B: Plan. Des. 34(3), 431–445 (2007)CrossRefGoogle Scholar
  7. 7.
    Duane, A., Gurrin, C., Huerst, W.: Virtual reality lifelog explorer: lifelog search challenge at ACM ICMR 2018. In: ACM Workshop on The Lifelog Search Challenge, LSC 2018, pp. 20–23. ACM, New York (2018)Google Scholar
  8. 8.
    Gurrin, C., Joho, H., Hopfgartner, F., Zhou, L., Albatal, R.: NTCIR lifelog: the first test collection for lifelog research. In: Proceedings of SIGIR 2016 Conference, pp. 705–708. ACM (2016)Google Scholar
  9. 9.
    Gurrin, C., Joho, H., Hopfgartner, F., Zhou, L., Albatal, R.: Overview of NTCIR-12 lifelog task. In: Proceedings of the 12th NTCIR Conference, pp. 354–360 (2016)Google Scholar
  10. 10.
    Gurrin, C., et al.: Overview of NTCIR-13 lifelog-2 task. In: Proceedings of the 13th NTCIR Conference, pp. 6–11 (2017)Google Scholar
  11. 11.
    Gurrin, C., Schoeffmann, K., Joho, H., Dang-Nguyen, D.-T., Riegler, M., Piras, L. (eds.): LSC 2018: Proceedings of the 2018 ACM Workshop on The Lifelog Search Challenge. ACM, New York (2018)Google Scholar
  12. 12.
    Jones, W., Teevan, J.: Personal Information Management. University of Washington Press, Seattle (2011)Google Scholar
  13. 13.
    Kato, M.P., Liu, Y.: Overview of NTCIR-13, pp. 1–5 (2017)Google Scholar
  14. 14.
    Kim, P.H., Giunchiglia, F.: The open platform for personal lifelogging: the elifelog architecture. In: CHI 2013 Extended Abstracts on Human Factors in Computing Systems, CHI EA 2013, pp. 1677–1682. ACM, New York (2013)Google Scholar
  15. 15.
    Lee, Y.J., Ghosh, J., Grauman, K.: Discovering important people and objects for egocentric video summarization. In: 2012 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1346–1353. IEEE (2012)Google Scholar
  16. 16.
    Lokoc, J., Bailer, W., Schoeffmann, K., Muenzer, B., Awad, G.: On influential trends in interactive video retrieval: video browser showdown 2015–2017. IEEE Trans. Multimed. 20(12), 3361–3376 (2018)CrossRefGoogle Scholar
  17. 17.
    Lokoč, J., Kovalčík, G., Souček, T.: Revisiting SIRET video retrieval tool. In: Schoeffmann, K., et al. (eds.) MMM 2018. LNCS, vol. 10705, pp. 419–424. Springer, Cham (2018).  https://doi.org/10.1007/978-3-319-73600-6_44CrossRefGoogle Scholar
  18. 18.
    Münzer, B., Leibetseder, A., Kletz, S., Primus, M.J., Schoeffmann, K.: lifeXplore at the lifelog search challenge 2018. In: ACM Workshop on The Lifelog Search Challenge, LSC 2018, pp. 3–8. ACM, New York (2018)Google Scholar
  19. 19.
    Schoeffmann, K., Münzer, B., Primus, J., Leibetseder, A.: The diveXplore system at the video browser showdown 2018 - final notes. CoRR abs/1804.01863 (2018)Google Scholar
  20. 20.
    Sellen, A.J., Whittaker, S.: Beyond total capture. Commun. ACM 53(5), 70–77 (2010)CrossRefGoogle Scholar
  21. 21.
    Sole, A.D.: Microsoft Computer Vision APIs Distilled: Getting Started with Cognitive Services. Apress, New York City (2017)Google Scholar
  22. 22.
    Song, S., Chandrasekhar, V., Cheung, N.-M., Narayan, S., Li, L., Lim, J.-H.: Activity recognition in egocentric life-logging videos. In: Jawahar, C.V., Shan, S. (eds.) ACCV 2014. LNCS, vol. 9010, pp. 445–458. Springer, Cham (2015).  https://doi.org/10.1007/978-3-319-16634-6_33CrossRefGoogle Scholar
  23. 23.
    Talavera, E., Dimiccoli, M., Bolaños, M., Aghaei, M., Radeva, P.: R-clustering for egocentric video segmentation. In: Paredes, R., Cardoso, J.S., Pardo, X.M. (eds.) IbPRIA 2015. LNCS, vol. 9117, pp. 327–336. Springer, Cham (2015).  https://doi.org/10.1007/978-3-319-19390-8_37CrossRefGoogle Scholar
  24. 24.
    Truong, T.-D., Dinh-Duy, T., Nguyen, V.-T., Tran, M.-T.: Lifelogging retrieval based on semantic concepts fusion. In: ACM Workshop on The Lifelog Search Challenge, LSC 2018, pp. 24–29. ACM, New York (2018)Google Scholar
  25. 25.
    Zhou, L., Hinbarji, Z., Dang-Nguyen, D.-T., Gurrin, C.: Lifer: an interactive lifelog retrieval system. In: ACM Workshop on The Lifelog Search Challenge, LSC 2018, pp. 9–14. ACM, New York (2018)Google Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  • Cathal Gurrin
    • 1
  • Klaus Schoeffmann
    • 2
  • Hideo Joho
    • 3
  • Bernd Munzer
    • 2
  • Rami Albatal
    • 1
  • Frank Hopfgartner
    • 4
  • Liting Zhou
    • 1
  • Duc-Tien Dang-Nguyen
    • 1
    • 5
    Email author
  1. 1.Insight Centre for Data AnalyticsDublin City UniversityDublinIreland
  2. 2.Klagenfurt UniversityKlagenfurtAustria
  3. 3.University of TsukubaTsukubaJapan
  4. 4.University of SheffieldSheffieldUK
  5. 5.University of BergenBergenNorway

Personalised recommendations