Abstract
We propose a datamining based method for automated reverse engineering of search strategies during active visual search tasks. The method uses a genetic program (GP) that evolves populations of fuzzy decision trees and selects an optimal one. Previous psychophysical observations of subjects engaged in a simple search task result in a database of stimulus conditions and concomitant measures of eye gaze information and associated psychophysical metrics that globally describe the subjects search strategies. Fuzzy rules about the likely design properties of the components of the visual system involved in selecting fixation location during search are defined based on these metrics. A fitness function that incorporates both the fuzzy rules and the information in the database is used to conduct GP based datamining. The information extracted through the GP process is the internal design specification of the visual system vis-à-vis active visual search.
Chapter PDF
Similar content being viewed by others
Keywords
References
Cameron, E.L., Tai, J.C., Eckstein, M.P., Carrasco, M.: Signal detection theory applied to three visual search tasks—Identification, yes/no detection and localization. Spatial Vision 17, 295–325 (2004)
Duncan, J., Humphreys, G.W.: Visual search and stimulus similarity. Psychological Review 93, 433–458 (1989)
Eckstein, M.P., Thomas, J.P., Palmer, J., Shimozaki, S.S.: A signal detection model predicts the effects of set size on visual search accuracy for feature, conjunction, triple conjunction, and disjunction displays. Perception & Psychophysics 62, 425–451 (2000)
Palmer, J., Verghese, P., Pavel, M.: The psychophysics of visual search. Vision Research 40, 1227–1268 (2000)
Strasburger, H., Harvey, L.O., Harvey Jr., L.O., Rentschler, I.: Contrast thresholds for identification of numeric characters in direct and eccentric view. Perception & Psychophysics 49, 495–508 (1991)
Treisman, A.: Features and objects: The fourteenth Bartlett memorial lecture. Quarterly Journal of Experimental Psychology: A Human Experimental Psychology 40, 201–237 (1988)
Treisman, A.M., Gelade, G.: A feature-integration theory of attention. Cognitive Psychology 12, 97–136 (1980)
Wolfe, J.M., Cave, K.R., Franzel, S.L.: Guided search: An alternative to the feature integration model for visual search. Journal of Experimental Psychology: Human Perception and Performance 15, 419–433 (1989)
Wolfe, J.M., O’Neill, P., Bennet, S.C.: Why are there eccentricity effects in visual search? Visual and attentional hypotheses. Perception & Psychophysics 60, 140–156 (1998)
Findlay, J.M., Brown, V., Gilchrist, I.D.: Saccade target selection in visual search: The effect of information from the previous fixation. Vision Research 41, 87–95 (2001)
Findlay, J.M., Gilchrist, I.D.: Eye guidance and visual search. In: Underwood, G. (ed.) Eye guidance in reading, driving and scene perception, pp. 295–312. Elsevier, Oxford (1998)
Geisler, W.S., Chou, K.L.: Separation of low-level and high-level factors in complex tasks: Visual search. Psychological Review 102, 356–378 (1995)
Hooge, I.T., Erkelens, C.J.: Adjustment of fixation duration in visual search. Vision Research 38, 1295–1302 (1998)
Maioli, C., Benaglio, I., Siri, S., Sosta, K., Cappa, S.: The integration of parallel and serial processing mechanisms in visual search: Evidence from eye movement recording. European Journal of Neuroscience 13, 364–372 (2001)
Motter, B.C., Belky, E.J.: The guidance of eye movements during active visual search. Vision Research 38, 1805–1815 (1998)
Motter, B.C., Belky, E.J.: The zone of focal attention during active visual search. Vision Research 38, 1007–1022 (1998)
Najemnik, J., Geisler, W.S.: Optimal eye movement strategies in visual search. Nature 434, 387–391 (2005)
Shen, J., Reingold, E.M., Pomplun, M., Williams, D.E.: Saccadic selectivity during visual search: The influence of central processing difficulty. In: Hyönä, J., Radach, R., Deubel, H. (eds.) The mind’s eyes: Cognitive and applied aspects of eye movement research, pp. 65–88. Elsevier, Amsterdam (2003)
Zelinsky, G.J., Rao, R.P.N., Hayhoe, M.M., Ballard, D.H.: Eye movements reveal the spatiotemporal dynamics of visual search. Psychological Science 8, 448–453 (1997)
Bouma, H.: Interaction effects in parafoveal letter recognition. Nature 226, 177–178 (1970)
Pelli, D.G., Palomares, M., Majaj, N.J.: Crowding is unlike ordinary masking: Distinguishing feature integration from detection. Journal of Vision 4(12): 12, 1136–1169 (2004)
Toet, A., Levi, A.: The two-dimensional shape of spatial interaction zones in the parafovea. Vision Research 32, 1349–1357 (1992)
Motter, B.C., Holsapple, J.W.: Cortical image density determines the probability of target discovery during active search. Vision Research 40, 1311–1322 (2000)
Simoni, D.A., Motter, B.C.: Human search performance is a threshold function of cortical image separation. Journal of Vision 3(9), 228 (2003)
Motter, B.C., Simoni, D.A.: The roles of cortical image separation and size in active visual search performance. Journal of Vision 7(2): 6, 1–15 (2007)
Simoni, D.A.: Augmented Search for Clinical and Research Images. In: Dylan, D., Morrow, K., Stanney, M., Reeves, L. (eds.) Foundations of Augmented Cognition, 2nd edn., pp. 329–332. Strategic Analysis, Inc. (2006)
Green, D.M., Swets, J.A.: Signal Detection Theory and Psychophysics. Wiley, New York (1966)
Burgess, A.E., Ghandeharian, H.: Visual signal detection. II. Effect of signal-location identification. Journal of the Optical Society of America A 1, 906–910 (1984)
Geisler, W.S., Diehl, R.L.A: A Bayesian approach to the evolution of perceptual and cognitive systems. Cognitive Science 27, 379–402 (2003)
Kersten, D., Mamassian, P., Yuille, A.L.: Object perception as Bayesian inference. Annual Review of Psychology 55, 271–304 (2004)
Tsoukalas, L.H., Uhrig, R.E.: Fuzzy and Neural Approaches in Engineering, Ch. 5. John Wiley and Sons, New York (1997)
Bigus, J.P.: Data Mining with Neural Nets, Ch. 1. McGraw-Hill, New York (1996)
Goldberg, D.E.: Genetic Algorithms. In: Search, Optimization and Machine Learning, Addison-Wesley, London (1989)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Simoni, D.A. (2007). Reverse Engineering the Visual System Via Genetic Programs. In: Schmorrow, D.D., Reeves, L.M. (eds) Foundations of Augmented Cognition. FAC 2007. Lecture Notes in Computer Science(), vol 4565. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-73216-7_22
Download citation
DOI: https://doi.org/10.1007/978-3-540-73216-7_22
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-73215-0
Online ISBN: 978-3-540-73216-7
eBook Packages: Computer ScienceComputer Science (R0)