Human—Computer Interaction with Global Information Spaces — Beyond Data Mining

  • Jim Thomas
  • Kris Cook
  • Vern Crow
  • Beth Hetzler
  • Richard May
  • Dennis McQuerry
  • Renie McVeety
  • Nancy Miller
  • Grant Nakamura
  • Lucy Nowell
  • Paul Whitney
  • Pak Chung Wong


This chapter describes a vision and progress towards a fundamentally new approach for dealing with the massive information overload situation of the emerging global information age. Today we use techniques such as data mining, through a WIMP interface, for searching or for analysis. Yet the human mind can deal and interact simultaneously with millions of information items, e.g. documents. The challenge is to find visual paradigms, interaction techniques and physical devices that encourage a new human information discourse between humans and their massive global and corporate information resources. After the vision and the current progress towards some core technology development, we present the grand challenges to bring this vision to reality.


Digital Library Information Space Grand Challenge Information Visualization Information Unit 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.



  1. [1]
    Card, S.K., Mackinlay, J.D., and Shneiderman, B. (eds.) Readings in Information Visualization: Using Vision to Think, Morgan Kaufmann Series in Interactive Technologies, San Francisco, 1999.Google Scholar
  2. [2]
    Cleveland, W. Visualizing Data, Hobart Press, Summit, NJ, 1993.Google Scholar
  3. [3]
    Foley, J.D., van Dam, A., Feiner, S.K., and Hughes, J.F. Computer Graphics Principles and Practice, 2nd edn. Addison-Wesley, Reading MA, 1990.Google Scholar
  4. [4]
    Heath, L.S., Hix, D., Nowell, L.T., Wake, W.C., Averboch, G.A., Labow, E., Guyer, S.A., Brueni, D.J., France, R.K., Dalal, K., and Fox, E.A. Envision: A User-Centered Database of Computer Science Literature. Communications of the ACM, 38, 4 (April 1995) 52–53.Google Scholar
  5. [5]
    Schneiderman, B. Designing the User Interface, 3rd edn. Addison-Wesley, Reading, MA, 1998.Google Scholar
  6. [6]
    Tufte, E. The Visual Display of Quantitative Information, Graphics Press, Cheshire, CT, 1983.Google Scholar
  7. [7]
    Tufte, E. Envisioning Information, Graphics Press, Cheshire, CT, 1990.Google Scholar
  8. [8]
    Tufte, E. Visual Explanations, Graphics Press, Cheshire, CT, 1997.zbMATHGoogle Scholar
  9. [9]
    Tukey, J.W. Exploratory Data Analysis, Addison-Wesley, Reading MA, 1977.zbMATHGoogle Scholar
  10. [10]
    Wise, J.A., Thomas, J.J., Pennock, K., Lantrip, D., Pottier, M., Schur, A., and Crow, V. Visualizing the non-visual: Spatial analysis and interaction with information from textdocuments, Proc. IEEE Information Visualization ‘85 (1995), 51–58.Google Scholar
  11. Ill Wong, P.C. and Bergeron, R.D. 30 years of multidimensional multivariate visualization. In Gregory M. Nielson, Heinrich Mueller, and Hans Hagen (eds.) Scientific Visualization: Overviews, Methodologies XXXXXX Techniques,IEEE Computer Society Press, Los Alamitos, California, 1997.Google Scholar

Paradigms and Metrics

  1. [12]
    Ahlberg, C. and Shneiderman, B. Visual information seeking: Tight coupling of dynamic query filters with starfield displays, Proc. ACM CHI94 Conference: Human Factors in Computing Systems (1994), 313–321 and color plates.Google Scholar
  2. [13]
    Ahlberg, C. and Wistrand, E. IVEE: An information visualization XXXXXX exploration environment, Proc. IEEE Information Visualization ‘85 (1995), 66–73.Google Scholar
  3. [14]
    Asahi, T., Turo, D., and Shneiderman, B. Using treemaps to visualize the analytic hierarchy process, Information Systems Research 6, 4 (December 1995), 357–375.CrossRefGoogle Scholar
  4. [15]
    Becker, R.A., Eick, S.G., and Wilks, A.R. Visualizing Network Data, IEEE Transactions onVisualization and Computer Graphics 1, 1 (March 1995), 16–28.CrossRefGoogle Scholar
  5. [16]
    Chalmers, M. and Chitson, P. Bead: Explorations in Information Visualization, in Proceedings of SIGIR ‘82 (Copenhagen, Denmark, 21–24 June 1992 ), 330–337.Google Scholar
  6. [17]
    Crow, V., Pennock, K., Pottier, M., Schur, A., Thomas, J.J., Wise, J., Lantrip, D., Fiegel, T., Struble, C., and York, J. Multidimensional Visualization and Browsing for Intelligence Analysis, in GVIZ ‘84 Proceedings of Graphics and Visualization Conference, Richland, WA, 1994.Google Scholar
  7. [18]
    Egenhofer, M. and Richards, J. Exploratory access to geographic data based on the map-overlay metaphor, Journal of Visual Languages and Computing4, 2 (1993), 105–125.Google Scholar
  8. [19]
    Eick, S.G., Steffen, J.L., and Sumner, E.E. Jr. SeeSoft–a tool for visualizing line-oriented software statistics, IEEE Transactions on Software Engineering 18, 11 (1992) 957–968.CrossRefGoogle Scholar
  9. [20]
    Fairchild, K.M., Poltrock, S.E., and Furnas, G.W. SemNet: three-dimensional representations of large knowledge bases, in Guindon, R. (ed.), Cognitive Science and its Applications for Human-Computer Interaction, Lawrence Erlbaum, Hillsdale, NJ (1988), 201–233.Google Scholar
  10. [21]
    Hearst, M.A. and Karadi, C. Cat-a-cone: an interactive interface for specifying searches and viewing retrieval results using a large category hierarchy. In Proceedings of ACM SIGIR ‘87, Philadelphia, PA, 27–31 July 1997, ACM Press.Google Scholar
  11. [22]
    Hemmje, M., Kunkel, C., and Willett, A. LyberWorld–A Visualization User Interface Supporting Full Text Retrieval, in Proceedings of SIGIR ‘84, Dublin, Ireland, 3–6 July 1994, pp. 249–259.Google Scholar
  12. [23]
    Hetzler, B., Whitney, P., Martucci, L., and Thomas, J. Multifaceted insight through interoperable visual information analysis paradigms, IEEE Information Visualization, 1998.Google Scholar
  13. [24]
    Chi, E. Huai-hsin, E., Barry, P., Riedl, J., and Konstan, J. A spreadsheet approach to information visualization. In Proceedings of IEEE Symposium on Information Visualization, InfoVis ‘87. IEEE.Google Scholar
  14. [25]
    Huang C., McDonald, J.A., and Stuetzle, W. Variable resolution bivariate plots. Journal of Computational and Graphical Statistics. 6 (4), 383–396, 1997.Google Scholar
  15. [26]
    Inselberg, A. Multidimensional detective. In Proceedings of IEEE Symposium on Information Visualization, InfoVis ‘87. IEEE.Google Scholar
  16. [27]
    Jerding, D.F. and Stasko, J.T. The information mural: A technique for displaying and navigating large information spaces, Proc. IEEE Information Visualization ‘85, 43–50.Google Scholar
  17. [28]
    Keim, D.A. and Kriegal, H. VisDB:Database exploration using multidimensional visualization, IEEE Computer Graphics and Applications (September 1994), 40–49.Google Scholar
  18. [29]
    Korfhage, R. To see or not to see–is that the query?, Communications of the ACM 34 (1991), 134–141.Google Scholar
  19. [30]
    Krohn, U. Visualization of navigational retrieval in virtual information spaces. In Proceedings of the Workshop on New Paradigms in Information Visualization and Manipulation, Baltimore, MD, 2 December 1995, pp. 26–32.Google Scholar
  20. [31]
    Miller, N.E., Hetzler, B., Nakamura, G., and Whitney, P. The need for metrics in visual information analysis, in Workshop on New Paradigms in Information Visualization and Manipulation, November 1997, Las Vegas, NV.Google Scholar
  21. [32]
    Miller, N.E., Wong, P.C., Brewster, M., and Foote, H. TOPIC ISLANDS’’m - a wavelet-based text visualization system, IEEE Visualization, 1998.Google Scholar
  22. [33]
    Mukherjea, S., Foley, J.D., and Hudson, S. Visualizing complex hypermedia networks through multiple hierarchical views, Proc. ACM CHI95 Conference: Human Factors in Computing Systems (1995), 331–337 and color plate.Google Scholar
  23. [34]
    Nowell, L.T., France, R.K., Hix, D., Heath, L.S., and Fox E.A. Visualizing search results: some alternatives to query-document similarity. Proceedings of the 19th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, Zurich, Switzerland, August 1996, pp. 67–75.Google Scholar
  24. [35]
    Olsen, K.A., Korfhage, R.R., Sochats, K.M., Spring, M.B., and Williams, J.G. Visualization of a document collection: the VIBE system. Information Processing and Management 29, 1 (1993) 69–81.CrossRefGoogle Scholar
  25. [36]
    Rushall, D. and Ilgen, M. DEPICT: documents evaluated as pictures, visualizing information using context vectors and self-organizing maps. In Proceedings of IEEE Symposium on Information Visualization, InfoVis ‘86. IEEE, 1996.Google Scholar
  26. [37]
    Spoerri, A. InfoCrystal: a visual tool for information retrieval. Proceedings of Visualization ‘83, San Jose, California, 25–29 October 1993, pp. 150–157.Google Scholar
  27. [38]
    Thomas, J.J., Shawn, B., Brown, J.C., Pennock, K., Schur, A., and Wise, J. Information visualization: data infrastructure architectures, Scientific and Statistical Database Management Conference, 28–30 September 1994.Google Scholar

Digital Libraries Paradigms

  1. [39]
    Rao, R., Pederson, J. O., Hearst, M. A., Mackinlay, J. D., Card, S. K., Masinter, L., Halvorsen, P. K., and Robertson, G. G. Rich interaction in the digital library. Communications of the ACM, 38, 4 (1995) pp. 29–39.CrossRefGoogle Scholar
  2. [40]
    Roussinov, Dmitri and Ramsey, Marshall. Information Forage through Adaptive Visualization, in Proceedings of Digital Libraries 98, The Third ACM Conference on Digital Libraries (Pittsburgh, PA, June 23–26, 1998 ) pp. 303–304.Google Scholar
  3. [41]
    Sahami, Mehran; Yusufali, Salim; and Baldonado, Michelle Q.W. SONIA: A Service for Organizing Networked Information Autonomously, in Proceedings of Digital Libraries 98, The Third ACM Conference on Digital Libraries (Pittsburgh, PA, June 23–26, 1998 ) pp. 200–209.Google Scholar

Web Visualization

  1. [42]
    Andrews, K. Visualizing cyberspace: information visualization in the Harmony Internet browser, in Proceedings of Information Visualization ‘85. Google Scholar
  2. [43]
    Card, S.K., Robertson, G.G., and York, W. The WebBook and the WebForager: An information workspace for the World-Wide Web, Proc. ACM CHI96 Conference: Human Factors in Computing Systems (1996),111–117.Google Scholar
  3. [44]
    Chi, E.H., Pitkow, J., Mackinlay, J., Pirolli, P., Gossweiler, R., and Card, S.K. Visualizing the evolution of Web ecologies, in Proceedings of CHI ‘88, Los Angeles, 18–23 April 1998, pp. 400–407.Google Scholar
  4. [45]
    Zamir, O. and Etzioni, O. Web document clustering: a feasibility demonstration, Proceedings of SIGIR ‘88, Melbourne, Australia, 24–28 August 1998, pp. 46–54.Google Scholar


  1. [46]
    Bartram, L., Ho, A., Dill, J., and Henigman, F. The continuous zoom: a constrained fisheye technique for viewing and navigating large information spaces, Proc. ACM User Interface Software and Technology ‘85 (1995), 207–215.Google Scholar
  2. [47]
    Bederson, B.B. and Hollan, J.D. PAD++: A zooming graphical user interface for exploring alternate interface physics, Proc. ACM User Interfaces Software and Technology ‘84 (1994), 17–27.Google Scholar
  3. [48]
    Chimera, R. Value bars: an information visualization and navigation tool for multiattribute listings, Proc. ACM CHI92 Conference: Human Factors in Computing Systems (1992), 293–294.Google Scholar
  4. [49]
    Cutting, D.R., Karger, D.R., and Pederson, J.O. Constant Interaction-time scatter/gather browsing of very large document collections, in Proceedings of SIGIR ‘83, Pittsburgh, PA, 27 June-1 July 1993, pp. 126–134.Google Scholar
  5. [50]
    Ebert, D., Shaw, C., Zwa, A., Miller, E., and Roberts, D.A. Minimally-immersive interactive volumetric information visualization. In Proceedings of IEEE Symposium on Information Visualization, InfoVis’96. IEEE.Google Scholar
  6. [51]
    Douthart R.J., Thomas, J.J., and Schmaltz, J.E. Simulated cloning in the CAGE environment, Nucleic Acids Research. IRL Press, Oxford, 1986, pp. 285–297.Google Scholar
  7. [52]
    Douthart, R.J., Thomas, J.J., and Schmaltz, J.E. Color Graphics Representations of large sequences in the GEM environment, Nucleic Acids Research. IRL Press, Oxford, 1988, pp. 1657–1666.Google Scholar
  8. [53]
    Fishkin, K. and Stone, M.C. Enhanced dynamic queries via movable filters, Proc. ACM CHI95 Conference: Human Factors in Computing Systems (1995), 415–420.Google Scholar
  9. [54]
    Fumas, G.W. Generalized fisheye views, Proc. ACM CHI86 Conference: Human Factors in Computing Systems (1986), 16–23.Google Scholar
  10. [55]
    Goldstein, J. and Roth, S.F. Using aggregation and dynamic queries for exploring large data sets, Proc. ACM CHI95 Conference: Human Factors in Computing Systems (1995), 23–29.Google Scholar
  11. [56]
    Hearst, M.A. TileBars: visualization of term distribution information in full text information access, in Proceedings of CHI ‘85, Denver, CO, 7–11 May 1995, pp. 59–66.Google Scholar
  12. [57]
    Inselberg, A. The plane with parallel coordinates, The Visual Computer 1 (1985),69–91.Google Scholar
  13. [58]
    Lucas, R.G., Taylor, Z.T., Miller, N.E., and Platt, R.G. Characterization of Changes in Commercial Building Structure Equipment and Occupants, PNL-7361, 1990, Pacific Northwest Laboratory, Richland, WA.Google Scholar
  14. [59]
    Mackinlay, J.D., Rao, R., and Card, S.K. An organic user interface for searching citation links, Proceedings of CHI ‘85, Denver, CO, 7–11 May 1995, pp. 67–73.Google Scholar
  15. [60]
    Pederson, J.O., Cutting, D.R., and Tukey, J.W. Snippet search: a single phrase approach to text access, in Proceedings of the 1991 Joint Statistical Meetings, American Statistical Association, 1991.Google Scholar
  16. [61]
    Pickett, R.M. and Grinstein, G.G. Iconographs displays for visualizing multidimensional data, in Proceedings IEEE Conference on Systems, Man, and Cybernetics, Beijing and Shenyang, PRC, May 1988, pp. 514–519.Google Scholar
  17. [62]
    Robertson, G.G., Card, S.K., and Mackinlay, J.D. Information visualization using 3D interactive animation, Communications of the ACM 36, 4 (April 1993), 56–71.CrossRefGoogle Scholar
  18. [63]
    Robertson, G.G. and Mackinlay, J.D. The document lens, Proc. 1993 ACM User Interface Software and Technology (1993), 101–108.Google Scholar
  19. [64]
    Sarkar, M. and Brown, M.H. Graphical fisheye views, Communications of the ACM 37, 12 (July 1994), 73–84.Google Scholar
  20. [65]
    Shneiderman, B. The eyes have it: a task by data type taxonomy for information visualizations, in Proceedings for IEEE Symposium on Visual Languages,3–6 September 1996, pp. 336–343. IEEE Service Center.Google Scholar

Physical Devices

  1. [66]
    Krueger, M. Artificial Reality II. Addison-Wesley, Reading, MA, 1990.Google Scholar
  2. [67]
    Matsushita, N. and Rekimoto, J. HoloWall: designing a finger, hand, body, and object sensitive wall, UIST ‘87 Proceedings,pp. 209–210.Google Scholar
  3. [68]
    May, R.A., Thomas, J.J., Lewis, R.R., and Decker, S.D. Physical human information workspace, Proc. Western Computer Graphics Symposium ‘88, 23–26 April 1998, pp. 25–31.Google Scholar
  4. [69]
    McNeill, D. Hand and Mind: What Gestures Reveal About Thought. University of Chicago Press, Chicago, IL, 1992.Google Scholar
  5. [70]
    Norman, D. The Psychology of Everyday Things. New York: Basic Books, 1988.Google Scholar
  6. [71]
    Omologo, M., Matassoni, M., Savaizer, P., and Giuliani, ?. Hands-free speech recognition in a noisy and reverberant environment. ESCA-NATO Workshop on Robust Speech Recognition for Unknown Communication Channels, Pont-a-Mousson, France, 17–18 April 1997.Google Scholar
  7. [72]
    Svaizer, P., Matassoni, M., and Omologo, M. Acoustic source location in a three-dimensional space using cross-power spectrum phase, Proc. ICASSP, Munich, Germany, April 1997.Google Scholar
  8. [73]
    Thomas, J.J. A New human information discourse, Fraunhofer Institute for Computer Graphics opening invited address at IGD Ceremonial Event, 28–30 October 1997.Google Scholar
  9. [74]
    Ullmer, B. and Ishii, H. The metaDESK: models and prototypes for tangible user interfaces, UIST ‘87 Proceedings, pp. 209–210, 1997.Google Scholar
  10. [75]
    Virtual Reality: Scientific and Technological Challenges, National Research Council, National Academy of Sciences, Committee on Virtual Reality Research and Development, National Academy Press, December 1994.Google Scholar
  11. [76]
    Wellner, P. Interactions with paper on the digital desk. Comm. ACM, 36 (7) (July 1993), 87–96.CrossRefGoogle Scholar

Copyright information

© Springer-Verlag London 2000

Authors and Affiliations

  • Jim Thomas
  • Kris Cook
  • Vern Crow
  • Beth Hetzler
  • Richard May
  • Dennis McQuerry
  • Renie McVeety
  • Nancy Miller
  • Grant Nakamura
  • Lucy Nowell
  • Paul Whitney
  • Pak Chung Wong

There are no affiliations available

Personalised recommendations