Abstract
Lifelog system involves capturing personal experiences in the form of digital multimedia during an entire lifespan. Recent advancements in mobile sensor technologies have helped to develop these systems using commercial smart phones. These systems have the potential to act as a secondary memory and also aid people who struggle with episodic memory impairment (EMI). Despite their huge potential, there are major challenges that need to be addressed to make them useful. One of them is how to index the inherently large lifelog data so that the person can efficiently retrieve the log segments that interest him / her most. In this paper, we present an ongoing research of using mobile phones to record and index lifelogs using activity language. By converting sensory data such as accelerometer and GPS readings into activity language, we are able to apply statistical natural language processing techniques to index, recognize, segment, cluster, retrieve, and infer high-level semantic meanings of the collected lifelogs. Based on this indexing approach, our lifelog system supports easy retrieval of log segments representing past similar activities and automatic lifelog segmentation for efficient browsing and activity summarization.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Aipperspach, R., Cohen, E., Canny, J.: Modeling human behavior from simple sensors in the home. In: Proceedings of IEEE Conf. on Pervasive Computing, Dublin, Ireland, pp. 337–348 (April 2006)
Aizawa, K., Tancharoen, D., Kawasaki, S., Yamasaki, T.: Efficient retrieval of life log based on context and content. In: CARPE 2004: Proceedings of the the 1st ACM Workshop on Continuous Archival and Retrieval of Personal Experiences, pp. 22–31. ACM, New York (2004)
Brookmeyer, R., Johnson, E., Ziegler-Graham, K., Arrighi, H.M.: Forecasting the global burden of alzheimer’s disease. Alzheimer’s and Dementia 3(3), 186–191 (2007); predicted 107 million people will suffer from Alzheimer by 2050
Burke, K.: Language as Symbolic Action. University of California Press (1966)
Chen, P., Chennuru, S., Buthpitiya, S., Zhang, Y.: A language-based approach to indexing heterogeneous multimedia lifelog. In: Proceedings of 12th International Conference on Multimodal Interfaces (2010)
Gemmell, J., Bell, G., Lueder, R., Drucker, S., Wong, C.: Mylifebits: fulfilling the memex vision. In: MULTIMEDIA 2002: Proceedings of the Tenth ACM International Conference on Multimedia, pp. 235–238. ACM, New York (2002)
Hartigan, J.A.: Clustering Algorithms. Wiley (1975) ISBN 0-471-35645-X
Kim, I.-J., Ahn, S.C., Kim, H.-G.: Personalized Life Log Media System in Ubiquitous Environment. In: Stajano, F., Kim, H.-J., Chae, J.-S., Kim, S.-D. (eds.) ICUCT 2006. LNCS, vol. 4412, pp. 20–29. Springer, Heidelberg (2007)
Kim, I.-J., Ahn, S.C., Ko, H., Kim, H.G.: Automatic lifelog media annotation based on heterogeneous sensor fusion. In: Proceedings of IEEE International Conference on Multi Sensor Fusion and Integration for Intelligent Systems, Seoul, Korea, August 20-22 (2008)
Lee, M.L., Dey, A.K.: Lifelogging memory appliance for people with episodic memory impairment. In: UbiComp 2008: Proceedings of the 10th International Conference on Ubiquitous Computing, pp. 44–53. ACM, New York (2008)
Manber, U., Myers, G.: Suffix arrays: a new method for on-line string searches. SIAM J. Comput. 22(5), 935–948 (1993)
Neergaard, L.: Report: 35 million-plus worldwide have dementia. Associate Press (September 21, 2009)
Nguyen, A., Moore, D., McCowan, I.: Unsupervised clustering of free-living human activities using ambulatory accelerometry. In: Proceedings of the 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBS), Lyon, France, August 22-26, pp. 4895–4898 (2007)
Papineni, K., Roukos, S., Ward, T., Zhu, W.: Bleu: a method for automatic evaluation of machine translation. Technical Report RC22176(W0109-022), IBM Research Division, Thomas J. Watson Research Center (2001)
Patterson, D.J., Liao, L., Fox, D., Kautz, H.: Inferring High-Level Behavior from Low-Level Sensors. In: Dey, A.K., Schmidt, A., McCarthy, J.F. (eds.) UbiComp 2003. LNCS, vol. 2864, pp. 73–89. Springer, Heidelberg (2003)
Stolcke, A.: Srilm – an extensible language modeling toolkit. In: Proc. Intl. Conf. on Spoken Language Processing, Denver, CO, vol. 2, pp. 901–904 (2002)
Takata, K., Ma, J., Apduhan, B.O., Huang, R., Jin, Q.: Modeling and analyzing individual’s daily activities using lifelog. In: ICESS 2008: Proceedings of the 2008 International Conference on Embedded Software and Systems, pp. 503–510. IEEE Computer Society, Washington, DC (2008)
Wertsch, J.V.: Mind As Action. Oxford University Press, USA (1998)
Yonezawa, K., Miyaki, T., Rekimoto, J.: Cat@log: sensing device attachable to pet cats for supporting human-pet interaction. In: ACE 2009: Proceedings of the International Conference on Advances in Computer Enterntainment Technology. ACM (2009)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 ICST Institute for Computer Science, Social Informatics and Telecommunications Engineering
About this paper
Cite this paper
Chennuru, S., Chen, PW., Zhu, J., Zhang, J.Y. (2012). Mobile Lifelogger – Recording, Indexing, and Understanding a Mobile User’s Life. In: Gris, M., Yang, G. (eds) Mobile Computing, Applications, and Services. MobiCASE 2010. Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering, vol 76. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-29336-8_15
Download citation
DOI: https://doi.org/10.1007/978-3-642-29336-8_15
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-29335-1
Online ISBN: 978-3-642-29336-8
eBook Packages: Computer ScienceComputer Science (R0)