Advertisement

A Baseline Interactive Retrieval Engine for Visual Lifelogs at the NTCIR-14 Lifelog-3 Task

  • Van-Tu Ninh
  • Tu-Khiem Le
  • Liting Zhou
  • Graham Healy
  • Kaushik Venkataraman
  • Minh-Triet Tran
  • Duc-Tien Dang-Nguyen
  • Sinead Smyth
  • Cathal GurrinEmail author
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11966)

Abstract

This paper describes the work of DCU research team in collaboration with University of Science, Vietnam, and University of Bergen, Norway at the Lifelog task of NTCIR-14. In this paper, a new interactive retrieval engine is described that supports faceted retrieval and we present the results of an initial experiment with four users. Following this initial experiment, we implement a list of changes for a revised interactive retrieval engine for the LSC2019 comparative evaluation competition. The interactive retrieval system we describe utilises the wide range of lifelog metadata provided by the task organisers to develop an extensive faceted retrieval system.

Keywords

Interactive lifelog search engine Information retrieval 

Notes

Acknowledgements

This publication has emanated from research supported in part by research grants from Irish Research Council (IRC) under Grant Number GOIPG/2016/741 and Science Foundation Ireland under grant numbers SFI/12/RC/2289 and 13/RC/2106. We wish to also thank the four users who used our retrieval system to generate the official runs.

References

  1. 1.
    Duane, A., Gurrin, C., Hürst, W.: Virtual reality lifelog explorer: lifelog search challenge at ACM ICMR 2018. In: Proceedings of the 2018 ACM Workshop on The Lifelog Search Challenge, LSC 2018, pp. 20–23. ACM, New York (2018).  https://doi.org/10.1145/3210539.3210544
  2. 2.
    Fu, M.H., Chia-Chun, C., Huang, G.H., Chen, H.H.: Introducing external textual knowledge for lifelog retrieval and annotation. In: The Fourteenth NTCIR conference (NTCIR-14) (2019)Google Scholar
  3. 3.
    Gurrin, C., et al.: Overview of NTCIR-14 lifelog task. In: Proceedings of the 14th NTCIR Conference on Evaluation of Information Access Technologies, National Center of Sciences, 10–13 June 2019, Tokyo, Japan (2019)Google Scholar
  4. 4.
    Gurrin, C., Joho, H., Hopfgartner, F., Zhou, L., Albatal, R.: Overview of NTCIR-12 lifelog task. In: Proceedings of the 12th NTCIR Conference on Evaluation of Information Access Technologies, National Center of Sciences, 7–10 June 2016, Tokyo, Japan (2016)Google Scholar
  5. 5.
    Gurrin, C., et al.: A test collection for interactive lifelog retrieval. In: Kompatsiaris, I., Huet, B., Mezaris, V., Gurrin, C., Cheng, W.-H., Vrochidis, S. (eds.) MMM 2019. LNCS, vol. 11295, pp. 312–324. Springer, Cham (2019).  https://doi.org/10.1007/978-3-030-05710-7_26CrossRefGoogle Scholar
  6. 6.
    Gurrin, C., et al.: Comparing approaches to interactive lifelog search at the lifelog search challenge ( LSC2018). ITE Trans. Media Technol. Appl. 7(2), 46–59 (2019)CrossRefGoogle Scholar
  7. 7.
    Laugwitz, B., Held, T., Schrepp, M.: Construction and evaluation of a user experience questionnaire. In: Holzinger, A. (ed.) USAB 2008. LNCS, vol. 5298, pp. 63–76. Springer, Heidelberg (2008).  https://doi.org/10.1007/978-3-540-89350-9_6CrossRefGoogle Scholar
  8. 8.
    Le, N.K., et al.: Smart lifelog retrieval system with habit-based concepts and moment visualization. In: Proceedings of the ACM Workshop on Lifelog Search Challenge, LSC 2019, pp. 1–6. ACM, New York (2019).  https://doi.org/10.1145/3326460.3329155
  9. 9.
    Le, T.K., et al.: LifeSeeker - interactive lifelog search engine at LSC 2019. In: Proceedings of the 2019 ACM Workshop on The Lifelog Search Challenge, LSC 2019. ACM, New York (2019)Google Scholar
  10. 10.
    Leibetseder, A., et al.: lifeXplore at the lifelog search challenge 2019. In: Proceedings of the ACM Workshop on Lifelog Search Challenge, LSC 2019, pp. 13–17. ACM, New York (2019).  https://doi.org/10.1145/3326460.3329157
  11. 11.
    Lin, T.-Y., et al.: Microsoft COCO: common objects in context. In: Fleet, D., Pajdla, T., Schiele, B., Tuytelaars, T. (eds.) ECCV 2014. LNCS, vol. 8693, pp. 740–755. Springer, Cham (2014).  https://doi.org/10.1007/978-3-319-10602-1_48CrossRefGoogle Scholar
  12. 12.
    Lokoč, J., Souček, T., Kovalčik, G.: Using an interactive video retrieval tool for lifelog data. In: Proceedings of the 2018 ACM Workshop on The Lifelog Search Challenge, LSC 2018, pp. 15–19. ACM, New York (2018).  https://doi.org/10.1145/3210539.3210543
  13. 13.
    Lowe, D.G.: Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vis. 60(2), 91–110 (2004).  https://doi.org/10.1023/B:VISI.0000029664.99615.94CrossRefGoogle Scholar
  14. 14.
    Münzer, B., Leibetseder, A., Kletz, S., Primus, M.J., Schoeffmann, K.: lifeXplore at the lifelog search challenge 2018. In: Proceedings of the 2018 ACM Workshop on The Lifelog Search Challenge, LSC 2018, pp. 3–8. ACM, New York (2018).  https://doi.org/10.1145/3210539.3210541
  15. 15.
    Nguyen, I.V.K., Shrestha, P., Zhang, M., Liu, Y., Ma, S.: THUIR at the NTCIR-14 lifelog-3 task: how does lifelog help the user’s status recognition. In: The Fourteenth NTCIR Conference (NTCIR-14) (2019)Google Scholar
  16. 16.
    de Oliveira Barra, G., Ayala, A.C., Bolaños, M., Dimiccoli, M., Giró i Nieto, X., Radeva, P.: LEMoRe: a lifelog engine for moments retrieval at the NTCIR-lifelog LSAT task. In: Proceedings of the 12th NTCIR Conference on Evaluation of Information Access Technologies, National Center of Sciences, 7–10 June 2016, Tokyo, Japan (2016)Google Scholar
  17. 17.
    Ren, S., He, K., Girshick, R., Sun, J.: Faster R-CNN: towards real-time object detection with region proposal networks. In: Proceedings of the 28th International Conference on Neural Information Processing Systems, NIPS 2015, vol. 1, pp. 91–99. MIT Press, Cambridge (2015). http://dl.acm.org/citation.cfm?id=2969239.2969250
  18. 18.
    Robertson, S.E., Jones, K.S.: Simple, proven approaches to text retrieval. Technical report (1997)Google Scholar
  19. 19.
    Rossetto, L., Gasser, R., Heller, S., Amiri Parian, M., Schuldt, H.: Retrieval of structured and unstructured data with vitrivr. In: Proceedings of the ACM Workshop on Lifelog Search Challenge, LSC 2019, pp. 27–31. ACM, New York (2019).  https://doi.org/10.1145/3326460.3329160
  20. 20.
    Zhou, B., Lapedriza, A., Khosla, A., Oliva, A., Torralba, A.: Places: a 10 million image database for scene recognition. IEEE Trans. Pattern Anal. Mach. Intell. 40, 1452–1464 (2017)CrossRefGoogle Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  • Van-Tu Ninh
    • 1
  • Tu-Khiem Le
    • 1
  • Liting Zhou
    • 1
  • Graham Healy
    • 1
  • Kaushik Venkataraman
    • 1
  • Minh-Triet Tran
    • 2
  • Duc-Tien Dang-Nguyen
    • 3
  • Sinead Smyth
    • 1
  • Cathal Gurrin
    • 1
    Email author
  1. 1.Dublin City UniversityDublinIreland
  2. 2.VNU-HCMUniversity of ScienceHo Chi Minh CityVietnam
  3. 3.University of BergenBergenNorway

Personalised recommendations