Abstract
Lifelogging refers to the process of digitally capturing a continuous and detailed trace of life activities in a passive manner. In order to assist the research community to make progress in the organisation and retrieval of data from lifelog archives, a lifelog task was organised at NTCIR since edition 12. Lifelog-3 was the third running of the lifelog task (at NTCIR-14) and the Lifelog-3 task explored three different lifelog data access related challenges, the search challenge, the annotation challenge and the insights challenge. In this paper we review the dataset created for this activity, activities of participating teams who took part in these challenges and we highlight learnings for the community from the NTCIR-Lifelog challenges.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsNotes
- 1.
Last.FM Music Tracker and Recommender - https://www.last.fm/.
- 2.
Fitbit Fitness Tracker (FitBit Versa) - https://www.fitbit.com.
- 3.
Freestyle Libre wearable glucose monitor - https://www.freestylelibre.ie/.
- 4.
Moves App for Android and iOS - http://www.moves-app.com/.
- 5.
- 6.
Google Cloud Vision API - https://cloud.google.com/vision/.
References
Buckley, C.: Treceval IR evaluation package (2004)
Dang-Nguyen, D.T., Piras, L., Riegler, M., Zhou, L., Lux, M., Gurrin, C.: Overview of ImageCLEFlifelog 2018: daily living understanding and lifelog moment retrieval. In: CLEF2018 Working Notes. CEUR Workshop Proceedings, 10–14 September 2018. CEURWS, Avignon (2018)
Dang-Nguyen, D.T., Zhou, L., Gupta, R., Riegler, M., Gurrin, C.: Building a disclosed lifelog dataset: challenges, principles and processes. In: Content-Based Multimedia Indexing (CBMI) (2017)
Dodge, M., Kitchin, R.: ‘Outlines of a world coming into existence’: pervasive computing and the ethics of forgetting. Environ. Plan. 34(3), 431–445 (2007). https://doi.org/10.1068/b32041t
Duane, A., Zhou, L., Dang-Nguyen, D.T., Gurrin, C.: DCU at the NTCIR-13 lifelog-2 task. In: Proceedings of NTCIR-13, Tokyo, Japan (2017)
Everson, B., Mackintosh, K.A., McNarry, M.A., Todd, C., Stratton, G.: Can wearable cameras be used to validate school-aged children’s lifestyle behaviours? Children 6(2), 20 (2019). https://doi.org/10.3390/children6020020
Fu, M.H., Chia-Chun, C., Huang, G.H., Chen, H.H.: Introducing external textual knowledge for lifelog retrieval and annotation. In: The Fourteenth NTCIR Conference (NTCIR-14) (2019)
Gurrin, C., et al.: Overview of the NTCIR-14 lifelog-3 task. In: The Fourteenth NTCIR Conference (NTCIR-14) (06 2019)
Gurrin, C., Joho, H., Hopfgartner, F., Zhou, L., Albatal, R.: Overview of NTCIR-12 lifelog task. In: Kando, N., Kishida, K., Kato, M.P., Yamamoto, S. (eds.) Proceedings of the 12th NTCIR Conference on Evaluation of Information Access Technologies, pp. 354–360 (2016)
Gurrin, C., et al.: Overview of NTCIR-13 lifelog-2 task. In: The Thirteenth NTCIR conference (NTCIR-13), pp. 6–11 (2017)
Gurrin, C., et al.: Comparing approaches to interactive lifelog search at the lifelog search challenge ( LSC2018). ITE Trans. Media Technol. Appl. 7(2), 46–59 (2019)
Gurrin, C., Smeaton, A.F., Doherty, A.R.: LifeLogging: personal big data. Found. Trends® Inform. Retrieval 8(1), 1–125 (2014). https://doi.org/10.1561/1500000033. http://www.nowpublishers.com/articles/foundations-and-trends-in-information-retrieval/INR-033
Harvey, M., Langheinrich, M., Ward, G.: Remembering through lifelogging: a survey of human memory augmentation. Pervasive Mob. Comput. 27, 14–26 (2016). https://doi.org/10.1016/j.pmcj.2015.12.002
Hoyle, R., Templeman, R., Armes, S., Anthony, D., Crandall, D., Kapadia, A.: Privacy behaviors of lifeloggers using wearable cameras. In: Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing, UbiComp 2014, pp. 571–582. ACM, New York (2014)
Kahneman, D., Krueger, A.B., Schkade, D.A., Schwarz, N., Stone, A.A.: A survey method for characterizing daily life experience: the day reconstruction method. Science 306, 1776–1780 (2004)
Lin, H.L., Chiang, T.C., Chen, L.P., Yang, P.C.: Image searching by events with deep learning for NTCIR-12 lifelog. In: Proceedings of NTCIR-12, Tokyo, Japan (2016)
Lin, J., del Molino, A.G., Xu, Q., Fang, F., Subbaraju, V., Lim, J.H.: VCI2R at the NTCIR-13 lifelog semantic access task. In: Proceedings of NTCIR-13, Tokyo, Japan (2017)
Lin, T., et al.:: Microsoft COCO: common objects in context. CoRR abs/1405.0312 (2014). http://arxiv.org/abs/1405.0312
Nguyen, I.V.K., Shrestha, P., Zhang, M., Liu, Y., Ma, S.: THUIR at the NTCIR-14 lifelog-3 task: how does lifelog help the user’s status recognition. In: The Fourteenth NTCIR Conference (NTCIR-14) (2019)
Ninh, V.T., et al.: A baseline interactive retrieval engine for the NTICR-14 lifelog-3 semantic access task. In: The Fourteenth NTCIR Conference (NTCIR-14) (2019)
de Oliveira Barra, G., et al.: LEMoRe: a lifelog engine for moments retrieval at the NTCIR-lifelog lsat task. In: Proceedings of NTCIR-12, Tokyo, Japan (2016)
Ren, S., He, K., Girshick, R.B., Sun, J.: Faster R-CNN: towards real-time object detection with region proposal networks. CoRR abs/1506.01497 (2015). http://arxiv.org/abs/1506.01497
Safadi, B., Mulhem, P., Qul’not, G., Chevallet, J.P.: MRIM-LIG at NTCIR lifelog semantic access task. In: Proceedings of NTCIR-12, Tokyo, Japan (2016)
Scells, H., Zuccon, G., Kitto, K.: QUT at the NTCIR lifelog semantic access task. In: Proceedings of NTCIR-12, Tokyo, Japan (2016)
Signal, L.N., et al.: KidsCam: an objective methodology to study the world in which children live. Am. J. Prevent. Med. 53(3), e89–e95 (2017). https://doi.org/10.1016/j.amepre.2017.02.016
Suzuki, T., Ikeda, D.: Smart lifelog retrieval system with habit-based concepts and moment visualization. In: The Fourteenth NTCIR Conference (NTCIR-14) (2019)
Wilson, G., Jones, D., Schofield, P., Martin, D.J.: The use of a wearable camera to explore daily functioning of older adults living with persistent pain: methodological reflections and recommendations. J. Rehabil. Assist. Technol. Eng. 5, 2055668318765411 (2018). https://doi.org/10.1177/2055668318765411
Xia, L., Ma, Y., Fan, W.: VTIR at the NTCIR-12 2016 lifelog semantic access task. In: Proceedings of NTCIR-12, Tokyo, Japan (2016)
Zhou, B., Lapedriza, A., Khosla, A., Oliva, A., Torralba, A.: Places: a 10million image database for scene recognition. IEEE Trans. Pattern Anal. Mach. Intell. 40, 1452–1464 (2017)
Zhou, Q., et al.: The use of wearable cameras in assessing children’s dietary intake and behaviours in China. Appetite 139, 1–7 (2019)
Acknowledgements
This publication has emanated from research supported in party by research grants from Irish Research Council (IRC) under Grant Number GOIPG/2016/741 and Science Foundation Ireland under grant numbers SFI/12/RC/2289 and SFI/13/RC/2106. We acknowledge the support and input of the DCU ethics committee and the risk & compliance officer.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Gurrin, C. et al. (2019). Advances in Lifelog Data Organisation and Retrieval at the NTCIR-14 Lifelog-3 Task. In: Kato, M., Liu, Y., Kando, N., Clarke, C. (eds) NII Testbeds and Community for Information Access Research. NTCIR 2019. Lecture Notes in Computer Science(), vol 11966. Springer, Cham. https://doi.org/10.1007/978-3-030-36805-0_2
Download citation
DOI: https://doi.org/10.1007/978-3-030-36805-0_2
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-36804-3
Online ISBN: 978-3-030-36805-0
eBook Packages: Computer ScienceComputer Science (R0)