Visual Interaction with Electronic Art Gallery

  • Toshikazu Kato
  • Takio Kurita


This paper describes the ideas of visual interaction and their implementations on an image database system. The visual interaction includes a query by visual example (QVE) and a query by subjective descriptions (QBD). The former provides a sketch retrieval function and the latter provides a sense retrieval function. This paper shows the detail algorithms of these functions developed on our experimental database system ART MUSEUM. These functions use a pictorial index created by image analysis and a personal index automatically learned as the user model. They formed visual interaction in a truly user-friendly manner. This paper also summarizes the requirements to a multimedia data model from a cognitive aspect.


User Model Image Database Canonical Correlation Analysis Image Processing Algorithm Visual Interface 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. [1]
    Chang, S. K.: “Image Database Systems”, in “Hand Book of Pattern recognition and Image Processing”, Young, T. Y. and Fu, K. S. (ed.), Academic Press, Chap.16, pp. 371–393, 1986.Google Scholar
  2. [2]
    Iyenger, S. S. and Kashyap, R. L.(ed.): “Image Databases”, IEEE Trans on Software Engineering (special selection), Vol.SE-14, No.5, pp.608–688, May 1988.Google Scholar
  3. [3]
    Grosky, W. I. and Mehrotra, R. (ed.): “Image Database Management”, IEEE Computer (special issue), Vol.22, No.12, pp.7–71, Dec. 1989.Google Scholar
  4. [4]
    Kato, T.: “Multimedia Interaction on Advanced Image Database System — Intelligent Personal Interface—”, Proc. of Computer World’89, pp. 174–181, Sep. 1989.Google Scholar
  5. [5]
    Kato, T., Kurita, T. and Shimogaki, H.: “Multimedia Interaction with Image Database Systems”, Proc. of Advanced Database System Symposium’89, pp. 271–278, Dec. 1989.Google Scholar
  6. [6]
    Chang, N. S. and Fu, K. S.: “Query-by-Pictorial Example”, IEEE Trans. on Software Engineering, Vol.SE-6, No. 6, pp. 519–524, June 1980.CrossRefGoogle Scholar
  7. [7]
    Kasahara, H. and Abe, S.: “Image Mnemonics — Indexing and Communication —”, Proc. of Advanced Database System Symposium’89, pp. 293–300, Dec. 1989.Google Scholar
  8. [8]
    Chang, S. K., Yan, C. W., Dimitroff, D. C. and Arndt, T.: “An Intelligent Image Database System”, IEEE Trans. on Software Engineering, Vol.SE-14, No. 5, pp. 681–688, May 1988.CrossRefGoogle Scholar
  9. [9]
    Kato, T., Shimogaki, H. and Fujimura, K.: “TRADEMARK: Multimedia Image Database System with Intelligent Human Interface”, Trans. of IEICE Japan, Vol.J72-D-II, No. 4, pp. 535–544, Apr. 1989 (in Japanese).Google Scholar
  10. [10]
    Kurita, T., Shimogaki, H. and Kato, T.: “A Personal Interface for Similarity Retrieval on an Image Database System”, Trans. of IPS Japan, Vol. 31, No. 2, pp. 227–237, Feb. 1990 (in Japanese).Google Scholar
  11. [11]
    Kato, T., Kurita, T. and Sakakura, A.: “Electronic Art Museum: Full Color Image Database with Visual Interaction on Color and Sketch”, Tech. Rep. of SIG-IE of IEICE Japan, 1E88–118, pp. 31–38, Mar. 1989 (in Japanese).Google Scholar
  12. [12]
    MacLeod, D. I. A. and Thomas, J. P. (ed.): “Basic Sensory Processes I”, in “Hand Book of Perception and Human Performance (I)”, Boff, K. R., Kaufman, L. and Thomas, J. P. (ed.), Sec.2, 1986.Google Scholar
  13. [13]
    Chijiiwa, H.: “Chromatics”, Fukumura Printing Co., Chap.S, pp. 128–163, 1983 (in Japanese).Google Scholar
  14. [14]
    Cooly, W. W. and Lohnes, P. R.: “Multivariate Data Analysis”, John Wiley & Sons, Inc., 1971.Google Scholar
  15. [15]
    Rosenfeld, A. and Kak, A. C.: “Digital Picture Processing (2e)”, Academic Press, 1982.Google Scholar
  16. [16]
    Ahuja, N. and Schachter, B. J.: “Image Models”, ACM Computing Surveys, Vol. 13, No. 4, pp. 373–397, Dec. 1981.CrossRefGoogle Scholar
  17. [17]
    Masunaga, Y.: “An Object-Oriented Approach to Multimedia Database Organization and Management”, Proc. of the Int. Symp. on Database Systems for Advanced Application, pp. 190–200, Apr. 1989.Google Scholar
  18. [18]
    Kato, T. and Mizutori, T.: “Multimedia Data Model for Advanced Image Information Systems”, Proc. of Advanced Database System Symposium’89, pp. 113–120, Dec. 1989.Google Scholar

Copyright information

© Springer-Verlag/Wien 1990

Authors and Affiliations

  • Toshikazu Kato
    • 1
  • Takio Kurita
    • 1
  1. 1.Electrotechnical LaboratoryJapan

Personalised recommendations