3D Visualization and Multimodal Interaction with Temporal Information Using Timelines

  • Giannis Drossis
  • Dimitris Grammenos
  • Ilia Adami
  • Constantine Stephanidis
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8119)


This paper reports on the design, development and evaluation of TimeViewer, a system allowing the storing, visualization and multimodal interaction with temporal and semantic information using timelines in 3D environments. We focus on the appliance of 3D interactive timelines for temporal information visualization, extending their capabilities with the novel concept of a time-tunnel. Our work is intended to investigate beyond the current state of the art interaction with 3D environments using a variety of input modes, such as touch and full-body kinesthetic interaction. Qualitative results were elicited through an evaluation with 16 users in order to assess the users’ opinion of the system, the efficiency of the offered interactions and direct future research in the area.


Interactive timelines multimodal interaction 3D information visualization full-body interaction virtual environment usability evaluation 


  1. 1.
    Allen, R.B.: Visualization, Causation, and History. In: Proc. iConference 2011, pp. 538–545. ACM Press (2011)Google Scholar
  2. 2.
    Andre, P., Wilson, M.L., Russell, A., Smith, D., Owens, A., Schraefel, M.C.: Continuum: Designing Timelines for Hierarchies, Relationships and Scale. In: Proc. UIST 2007, pp. 101–110. ACM (2007)Google Scholar
  3. 3.
  4. 4.
    Crossan, A., Brewster, S., Ng, A.: Foot tapping for mobile interaction. In: Proc. BCS 2010, pp. 418–422. British Computer Society Swinton, UK (2010)Google Scholar
  5. 5.
    Fikkert, W., van der Vet, P., van der Veer, G., Nijholt, A.: Gestures for large display control. In: Kopp, S., Wachsmuth, I. (eds.) GW 2009. LNCS, vol. 5934, pp. 245–256. Springer, Heidelberg (2010)CrossRefGoogle Scholar
  6. 6.
    Jaimes, A., Sebe, N.: Multimodal human–computer interaction: A survey. Journal Computer Vision and Image Understanding Archive 108(1-2), 116–134 (2007)CrossRefGoogle Scholar
  7. 7.
    Hilliges, O., Izadi, S., Wilson, A., Hodges, S., Mendoza, A.G., Butz, A.: Interactions in the air: adding further depth to interactive tabletop. In: Proc. UIST 2009, pp. 139–148. ACM (2009)Google Scholar
  8. 8.
    Jensen, M.: Visualizing Complex Semantic Timelines. NewsBlib (2003)Google Scholar
  9. 9.
    Kullberg, R.L.: Dynamic Timelines Visualizing Historical Information in Three Dimensions. M.S. Thesis at the MIT Media Laboratory, Boston, MA (September 1995)Google Scholar
  10. 10.
    Kumar, V., Furuta, R., Allen, R.B.: Metadata visualization for digital libraries: interactive timeline editing and review. In: Proc. DL 1998, pp. 126–133. ACM (1996)Google Scholar
  11. 11.
    Marcus, A., Bernstein, M.S., Badar, O., Karger, D.R., Madden, S., Miller, R.C.: TwitInfo: Aggregating and Visualizing Microblogs for Event Exploration. In: Proc. CHI 2011, pp. 227–236. ACM (2011)Google Scholar
  12. 12.
    Matković, K., Lež, A., Gračanin, D., Ammer, A., Purgathofer, W.: Event Line View: Interactive Visual Analysis of Irregular Time-Dependent Data. In: Taylor, R., Boulanger, P., Krüger, A., Olivier, P. (eds.) SG 2010. LNCS, vol. 6133, pp. 208–219. Springer, Heidelberg (2010)Google Scholar
  13. 13.
    Nickel, K., Stiefelhagen, R.: Pointing Gesture Recognition based on 3D-Tracking of Face, Hands and Head Orientation. In: Proc. ICMI 2003, pp. 140–146. ACM (2003)Google Scholar
  14. 14.
    OWL, Web Ontology Language Overview, (last accessed on January 22, 2013)
  15. 15.
    Papadopoulos, C., Sugarman, D., Kaufmant, A.: NuNav3D: A Touch-less, Body-driven Interface for 3D Navigation. In: Proc. IEEE VR 2012, pp. 67–68. IEEE (2012)Google Scholar
  16. 16.
    Plaisant, C., Milash, B., Rose, A., Widoff, S., Shneiderman, B.: LifeLines Visualizing Personal Histories. In: Proc. CHI 1996, pp. 221–227. ACM (1996)Google Scholar
  17. 17.
    Ronkainen, S., Häkkilä, J., Kalev, S., Colley, A., Linjama, J.: Tap input as an embedded interaction method for mobile devices. In: Proc. TEI 2007, pp. 263–270. ACM (2007)Google Scholar
  18. 18.
    Sangsuriyachot, N., Mi, H., Sugimoto, M.: Novel Interaction Techniques by Combining Hand and Foot Gestures on Tabletop Environments. In: Proc. ITS 2011, pp. 268–269. ACM (2011)Google Scholar
  19. 19.
    Serrano, M., Nihay, L., Lawson, J.-Y., Ramsay, A., Murray-Smith, R., Denef, S.: The OpenInterface Framework: A tool for multimodal interaction. In: Proc. CHI 2008, pp. 3501–3506. ACM (2008)Google Scholar
  20. 20.
    Simile Project, (accessed on January 22, 2013)
  21. 21.
    Stab, C., Nazemi, K., Fellner, D.W.: Sematime - timeline visualization of time-dependent relations and semantics. In: Bebis, G., Boyle, R., Parvin, B., Koracin, D., Chung, R., Hammound, R., Hussain, M., Kar-Han, T., Crawfis, R., Thalmann, D., Kao, D., Avila, L. (eds.) ISVC 2010, Part III. LNCS, vol. 6455, pp. 514–523. Springer, Heidelberg (2010)CrossRefGoogle Scholar
  22. 22.
    Valkov, D., Steinicke, F., Bruder, B., Hinrichs, K.: Traveling in 3D Virtual Environments with foot gestures and a multitouch enabled World in Miniature. In: Proc. VRIC 2012, pp. 171–180. IEEE (2010)Google Scholar
  23. 23.
    Wongsuphasawat, K., Gomez, J.A.G., Plaisant, C., Wang, T.D., Shneiderman, B., Maimom, M.T.: LifeFlow: Visualizing an Overview of Event Sequences. In: CHI 2011, pp. 1747–1756. ACM Press (2011)Google Scholar
  24. 24.
    Yoo, B., Han, J.-J., Choi, C., Yi, K., Suh, S., Partk, D., Kim, C.: 3D User Interface Combining Gaze and Hand Gestures for Large-Scale Display. In: Proc. CHI 2010, pp. 3709–3714. ACM (2010)Google Scholar
  25. 25.
    Zhao, J., Drucker, S.M., Fisher, D., Brinkman, D.: TimeSlice: Interactive Faceted Browsing of Timeline Data. In: Proc. AVI 2012, pp. 433–436. ACM (2012)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2013

Authors and Affiliations

  • Giannis Drossis
    • 1
    • 2
  • Dimitris Grammenos
    • 1
  • Ilia Adami
    • 1
  • Constantine Stephanidis
    • 1
    • 2
  1. 1.Institute of Computer ScienceFoundation for Research and Technology - Hellas (FORTH)HeraklionGreece
  2. 2.Computer Science DepartmentUniversity of CreteHeraklionGreece

Personalised recommendations