Advertisement

Multimedia Tools and Applications

, Volume 78, Issue 14, pp 19115–19139 | Cite as

What do luthiers look at? An eye tracking study on the identification of meaningful areas in historical violins

  • Piercarlo DondiEmail author
  • Luca Lombardi
  • Marco Porta
  • Tommaso Rovetta
  • Claudia Invernizzi
  • Marco Malagodi
Article
  • 137 Downloads

Abstract

Stylistic analysis of artworks is an important practice in the field of Cultural Heritage. Over time, significant stylistic characteristics have been identified for paintings and sculptures, but not for historical musical instruments. Even if various stylistic features of instruments are well known, their importance for attributing an instrument to its maker remains unclear. In this work, we propose a study carried out in relation to 34 luthiers’ examinations recorded with an eye tracker. Our goal was to find which regions of a violin are most closely observed by experts during the attribution process. The retrieved data were used to create a multimedia presentation that shows a violin in the same way in which luthiers look at it. This application can be employed for knowledge dissemination (e.g,. inside museums) or as an educational tool for students of violin making schools. The experiments were carried out on a series of images of 17th-18th century historical violins kept at the “Museo del Violino” in Cremona (Italy).

Keywords

Eye-tracking User study Education Multimedia presentation Cultural heritage Historical violins 

Notes

Acknowledgements

We would like to thank “Fondazione Museo del Violino Antonio Stradivari”, “Friends of Stradivari”, and “Distretto Culturale di Cremona” for their collaboration. We also thank all the luthiers and volunteers who participate in the experiments.

References

  1. 1.
    Armstrong T, Olatunji BO (2012) Eye tracking of attention in the affective disorders: a meta-analytic review and synthesis. Clin Psycholo Rev 32(8):704–723.  https://doi.org/10.1016/j.cpr.2012.09.004 CrossRefGoogle Scholar
  2. 2.
    Bekele MK, Pierdicca R, Frontoni E, Malinverni ES, Gain J (2018) A survey of augmented, virtual, and mixed reality for cultural heritage. J Comput Cult Herit 11(2):7:1–7:36.  https://doi.org/10.1145/3145534 CrossRefGoogle Scholar
  3. 3.
    Bergstrom JCR, Olmsted-Hawala EL, Jans ME (2013) Age-related differences in eye tracking and usability performance: Website usability for older adults. Int J Human-Comput Interact 29(8):541–548.  https://doi.org/10.1080/10447318.2012.728493 CrossRefGoogle Scholar
  4. 4.
    Buquet C, Charlier JR, Paris V (1988) Museum application of an eye tracker. Med Biol Eng Comput 26(3):277–281.  https://doi.org/10.1007/BF02447081 CrossRefGoogle Scholar
  5. 5.
    Calandra DM, Di Mauro D, D’Auria D, Cutugno F (2016) E.Y.E. C.U.: an Emotional eYe trackEr for Cultural heritage sUpport. Springer International Publishing, Cham, pp 161–172.  https://doi.org/10.1007/978-3-319-23784-8_13
  6. 6.
    Cantoni V, Merlano L, Nugrahaningsih N, Porta M (2016) Eye tracking for cultural heritage: a gaze-controlled system for handless interaction with artworks. In: Proceedings of the 17th international conference on computer systems and technologies 2016, CompSysTech’16. ACM, New York, pp 307–314.  https://doi.org/10.1145/2983468.2983499
  7. 7.
    Cecotti H (2016) . IEEE Trans Human-Mach Syst 46(4):601–606.  https://doi.org/10.1109/THMS.2016.2537749 CrossRefGoogle Scholar
  8. 8.
    Cornelissen FW, Peters EM, Palmer J (2002) The eyelink toolbox: Eye tracking with matlab and the psychophysics toolbox. Behav Res Methods Instrum Comput 34 (4):613–617.  https://doi.org/10.3758/BF03195489 CrossRefGoogle Scholar
  9. 9.
    Damala A, Stojanovic N (2012) Tailoring the adaptive augmented reality (a2r) museum visit: Identifying cultural heritage professionals’ motivations and needs. In: 2012 IEEE international symposium on mixed and augmented reality - arts, media, and humanities (ISMAR-AMH), pp 71–80.  https://doi.org/10.1109/ISMAR-AMH.2012.6483992
  10. 10.
    Davanzo N, Dondi P, Mosconi M, Porta M (2018) Playing music with the eyes through an isomorphic interface. In: Proceedings of COGAIN ’18: workshop on communication by Gaze interaction.  https://doi.org/10.1145/3206343.3206350
  11. 11.
    DiPaola S, Riebe C, Enns JT (2010) Rembrandt’s textural agency: a shared perspective in visual art and science. Leonardo 43(2):145–151CrossRefGoogle Scholar
  12. 12.
    Dondi P, Lombardi L, Malagodi M, Licchelli M, Rovetta T, Invernizzi C (2015) An interactive tool for speed up the analysis of UV images of Stradivari violins. In: New trends in image analysis and processing - ICIAP 2015 workshops, lecture notes in computer science. Springer International Publishing, vol 9281, pp 103–110.  https://doi.org/10.1007/978-3-319-23222-5_13
  13. 13.
    Dondi P, Lombardi L, Malagodi M, Licchelli M (2017) 3D modelling and measurements of historical violins. In: ACTA IMEKO, vol 6, no 3, pp. 29–34,  https://doi.org/10.21014/acta_imeko.v6i3.455
  14. 14.
    Dondi P, Lombardi L, Invernizzi C, Rovetta T, Malagodi M, Licchelli M (2017) Automatic analysis of uv-induced fluorescence imagery of historical violins. J Comput Cult Herit 10(2):12:1–12:13.  https://doi.org/10.1145/3051472 CrossRefGoogle Scholar
  15. 15.
    Duchowski A (2007) Eye tracking methodology - theory and practice. Springer, Berlin.  https://doi.org/10.1007/978-1-84628-609-4 zbMATHGoogle Scholar
  16. 16.
    Eghbal-Azar K, Widlok T (2013) Potentials and limitations of mobile eye tracking in visitor studies. Soc Sci Comput Rev 31(1):103–118.  https://doi.org/10.1177/0894439312453565 CrossRefGoogle Scholar
  17. 17.
    Fan Z, Zheng XS, Zhang K (2015) Computational analysis and eye movement experiments of white space in chinese paintings. In: 2015 IEEE international conference on progress in informatics and computing (PIC), pp 301–306.  https://doi.org/10.1109/PIC.2015.7489858
  18. 18.
    Fiocco G, Rovetta T, Gulmini M, Piccirillo A, Licchelli M, Malagodi M (2017) Spectroscopic analysis to characterize finishing treatments of ancient bowed string instruments. Appl Spectrosc 71(11):2477–2487.  https://doi.org/10.1177/0003702817715622 CrossRefGoogle Scholar
  19. 19.
    Gartus A, Klemer N, Leder H (2015) The effects of visual context and individual differences on perception and evaluation of modern art and graffiti art. Acta Psychol 156:64–76.  https://doi.org/10.1016/j.actpsy.2015.01.005 CrossRefGoogle Scholar
  20. 20.
    Huang W (2013) Handbook of human centric visualization. Springer Science and Business Media, BerlinGoogle Scholar
  21. 21.
    Jalovec K (1963) Beautiful Italian violins. Paul Hamlyn ed., LondonGoogle Scholar
  22. 22.
    Jalovec K (1964) Italian Violin Makers: Revised edition. Paul Hamlyn ed., LondonGoogle Scholar
  23. 23.
    Liccione D, Moruzzi S, Rossi F, Manganaro A, Porta M, Nugrahaningsih N, Caserio V, Allegri N (2014) Familiarity is not notoriety: phenomenological accounts of face recognition. Front Hum Neurosci 8:672.  https://doi.org/10.3389/fnhum.2014.00672 CrossRefGoogle Scholar
  24. 24.
    Milekic S (2003) The more you look the more you get: Intention-based interface using gaze-tracking. In: Proceedings of 7th annual museum and the web conference, pp 57–72Google Scholar
  25. 25.
    Milekic S (2010) Gaze-tracking and museums: Current research and implications. In: Proceedings of museums and the web. Archives & Museum Informatics Toronto, pp 61–70Google Scholar
  26. 26.
    Mortara M, Catalano CE, Bellotti F, Fiucci G, Houry-Panchetti M, Petridis P (2014) Learning cultural heritage by serious games. J Cult Herit 15 (3):318–325.  https://doi.org/10.1016/j.culher.2013.04.004. http://www.sciencedirect.com/science/article/pii/S1296207413001349 CrossRefGoogle Scholar
  27. 27.
    Nielsen J (1994) Usability engineering. Elsevier, New YorkzbMATHGoogle Scholar
  28. 28.
    Nielsen J, Pernice K (2009) Eyetracking web usability. New Riders Press, IndianapolisGoogle Scholar
  29. 29.
    Ooms K, Dupont L, Lapon L, Popelka S (2015) Accuracy and precision of fixation locations recorded with the low-cost eye tribe tracker in different experimental set-ups. J Eye Mov Res 8(1):1–24.  https://doi.org/10.16910/jemr.8.1.5 Google Scholar
  30. 30.
    Paliokas I, Sylaiou S (2016) The use of serious games in museum visits and exhibitions: a systematic mapping study. In: 2016 8th international conference on games and virtual worlds for serious applications (VS-GAMES), pp 1–8.  https://doi.org/10.1109/VS-GAMES.2016.7590371
  31. 31.
    Piper T Violins and violin manufacture from the death of stradivari to the present time. In: Proceedings of the musical association, vol 25th Session, pp 97–114 (1898–1899)Google Scholar
  32. 32.
    Porta M (2015) A study on text entry methods based on eye gestures. J Assist Technol 9(1):48–67.  https://doi.org/10.1108/JAT-12-2013-0037 MathSciNetCrossRefGoogle Scholar
  33. 33.
    Rovetta T, Invernizzi C, Licchelli M, Cacciatori F, Malagodi M (2017) The elemental composition of Stradivari’s musical instruments: new results through non-invasive EDXRF analysis. X-Ray Spectrom 47(2):159–170.  https://doi.org/10.1002/xrs.2825 CrossRefGoogle Scholar
  34. 34.
    Sylaiou S, Patias P, Gelos L, Ziogas Y (2013) Exploring roads less traveled: eye-tracking in art. In: Proceedings of Re new 2013 conference, pp 48–55Google Scholar
  35. 35.
    Toyama T, Kieninger T, Shafait F, Dengel A (2011) Museum guide 2.0 - an eye-tracking based personal assistant for museums and exhibits. In: Ciolfi L, Scott K, Barbieri S (eds) Proceedings of re-thinking technology in museums 2011: emerging experiences. University of Limerick, pp 1–10Google Scholar
  36. 36.
    Valuch C, Ansorge U (2015) The influence of color during continuity cuts in edited movies: an eye-tracking study. Multimed Tools Appl 74(22):10161–10176.  https://doi.org/10.1007/s11042-015-2806-z CrossRefGoogle Scholar
  37. 37.
    Vik P (2013) Regression, ANOVA, and the general linear model: a statistics primer. SAGE Publications Inc., Thousand OaksGoogle Scholar
  38. 38.
    Villani D, Morganti F, Cipresso P, Ruggi S, Riva G, Gilli G (2015) Visual exploration patterns of human figures in action: an eye tracker study with art paintings. Front Psychol 6(1636):1–10.  https://doi.org/10.3389/fpsyg.2015.01636 Google Scholar
  39. 39.
    Wang CC, Hung JC, Chen SN, Chang HP (2018) Tracking students’ visual attention on manga-based interactive e-book while reading: an eye-movement approach. Multimedia Tools and Applications.  https://doi.org/10.1007/s11042-018-5754-6
  40. 40.
    Wedel M, Pieters R (2008) A review of eye-tracking research in marketing. In: Review of marketing research. Emerald group publishing limited, pp 123–147.  https://doi.org/10.1108/S1548-6435(2008)0000004009
  41. 41.
    Wessel D, Mayr E, Knipfer K (2007) Re-viewing the museum visitor’s view. In: Workshop research methods in informal and mobile learning, institute of education. London, UKGoogle Scholar
  42. 42.
    Wooding DS (2002) Eye movements of large populations: II. deriving regions of interest, coverage, and similarity using fixation maps. Behav Res Methods Instrum Comput 34(4):518–528.  https://doi.org/10.3758/BF03195481 CrossRefGoogle Scholar
  43. 43.
    Wooding DS, Mugglestone MD, Purdy KJ, Gale AG (2002) Eye movements of large populations: I. implementation and performance of an autonomous public eye tracker. Behav Res Methods Instrum Comput 34(4):509–517.  https://doi.org/10.3758/BF03195480 CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media, LLC, part of Springer Nature 2019

Authors and Affiliations

  1. 1.CISRiC - Arvedi Laboratory of Non-Invasive DiagnosticsUniversity of PaviaCremonaItaly
  2. 2.Department of Civil Engineering and ArchitectureUniversity of PaviaPaviaItaly
  3. 3.Department of Electrical, Computer and Biomedical EngineeringUniversity of PaviaPaviaItaly
  4. 4.Department of Mathematical, Physical and Computer SciencesUniversity of ParmaParmaItaly
  5. 5.Department of Musicology and Cultural HeritageUniversity of PaviaCremonaItaly

Personalised recommendations