Abstract
The automatic analysis of real-life, long-term behavior and dynamics of individuals and groups from mobile sensor data constitutes an emerging and challenging domain. We present a framework to classify people’s daily routines (defined by day type, and by group affiliation type) from real-life data collected with mobile phones, which include physical location information (derived from cell tower connectivity), and social context (given by person proximity information derived from Bluetooth). We propose and compare single- and multi-modal routine representations at multiple time scales, each capable of highlighting different features from the data, to determine which best characterized the underlying structure of the daily routines. Using a massive data set of 87000+ hours spanning four months of the life of 30 university students, we show that the integration of location and social context and the use of multiple time-scales used in our method is effective, producing accuracies of over 80% for the two daily routine classification tasks investigated, with significant performance differences with respect to the single-modal cues.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Choudhury, T., Pentland, A.: Sensing and Modeling Human Networks using the Sociometer. In: Fensel, D., Sycara, K.P., Mylopoulos, J. (eds.) ISWC 2003. LNCS, vol. 2870. Springer, Heidelberg (2003)
Eagle, N., Pentland, A.: Reality mining: Sensing complex social systems. Personal and Ubiquitous Computing 10(4), 255–268 (2006)
Wren, C., Ivanov, Y., Kaur, I., Leigh, D., Westhues, J.: SocialMotion: Measuring the Hidden Social Life of a Building. In: Hightower, J., Schiele, B., Strang, T. (eds.) LoCA 2007. LNCS, vol. 4718, pp. 85–102. Springer, Heidelberg (2007)
McCowan, I., Gatica-Perez, D., Bengio, S., Lathoud, G.: Automatic Analysis of Multimodal Group Actions in Meetings. IEEE Transactions on Pattern Analysis and Machine Intelligence (T-PAMI) 27(3), 305–317 (2005)
Stiefelhagen, R., Bernardin, K., Ekenel, H.K., McDonough, J., Nickel, K., Voit, M., Woelfel, M.: Audio-Visual Perception of a Lecturer in a Smart Seminar Room. In: Signal Processing - Special Issue on Multimodal Interfaces, vol. 86 (12). Elsevier, Amsterdam (2006)
Oliver, N., Horvitz, E., Garg, A.: Layered Representations for Learning and Inferring Office Activity from Multiple Sensory Channels. In: Proceedings of Int. Conf. on Multimodal Interfaces (ICMI), Pittsburgh, PA (2002)
Munguia Tapia, E., Intille, S.S., Haskell, W., Larson, K., Wright, J., King, A., Friedman, R.: Real-time recognition of physical activities and their intensities using wireless accelerometers and a heart monitor. In: Proc. Int. Symp. on Wearable Comp., Boston (2007)
Wyatt, D., Choudhury, T., Kautz, H.: Capturing Spontaneous Conversation and Social Dynamics: A Privacy-Sensitive Data Collection Effort. In: Proceedings of International Conference on Acoustics, Speech, and Signal Processing (ICASSP), Honolulu (2007)
Davis, M., House, N.V., Towle, J., King, S., Ahern, S., Burgener, C., Perkel, D., Finn, M., Viswanathan, V., Rothenberg, M.: MMM2: Mobile media metadata for media sharing. In: Proceedings of ACM CHI, Portland (2005)
Technology Review, http://www.technologyreview.com/specialreports/specialreport.aspx?id=25
Sohn, T., Varshavsky, A., LaMarca, A., Chen, M., Choudhury, T., Smith, I., Consolvo, S., Hightower, J., Griswold, W.G., Lara, E.: Mobility Detection Using Everyday GSM Traces. In: Dourish, P., Friday, A. (eds.) UbiComp 2006. LNCS, vol. 4206, pp. 212–224. Springer, Heidelberg (2006)
Hariharan, R., Krumm, J., Horvitz, E.: Web-Enhanced GPS. In: Strang, T., Linnhoff-Popien, C. (eds.) LoCA 2005. LNCS, vol. 3479. Springer, Heidelberg (2005)
Eagle, N., Pentland, A.: Eigenbehaviors: Identifying structure in routine. Behavioral Ecology and Sociobiology (in submission, 2007)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2008 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Farrahi, K., Gatica-Perez, D. (2008). Daily Routine Classification from Mobile Phone Data. In: Popescu-Belis, A., Stiefelhagen, R. (eds) Machine Learning for Multimodal Interaction. MLMI 2008. Lecture Notes in Computer Science, vol 5237. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-85853-9_16
Download citation
DOI: https://doi.org/10.1007/978-3-540-85853-9_16
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-85852-2
Online ISBN: 978-3-540-85853-9
eBook Packages: Computer ScienceComputer Science (R0)