Abstract
Computational models of visual attention have attracted strong interest by accurately predicting how humans deploy attention. However, little research has utilized these models to detect clinical populations whose attention control has been affected by neurological disorders. We designed a framework to decypher disorders from the joint analysis of video and patients’ natural eye movement behaviors (watch television for 5 minutes). We employ convolutional deep neural networks to extract visual features in real-time at the point of gaze, followed by SVM and Adaboost to classify typically developing children vs. children with fetal alcohol spectrum disorder (FASD), who exhibit impaired attentional control. The classifier achieved 74.1% accuracy (ROC: 0.82). Our results demonstrate that there is substantial information about attentional control in even very short recordings of natural viewing behavior. Our new method could lead to high-throughput, low-cost screening tools for identifying individuals with deficits in attentional control.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Corbetta, M., Patel, G., Shulman, G.L.: The reorienting system of the human brain: from environment to theory of mind. Neuron 58(3), 306–324 (2008)
Fletcher-Watson, S., Leekam, S.R., Benson, V., Frank, M.C., Findlay, J.M.: Eye-movements reveal attention to social information in autism spectrum disorder. Neuropsychologia 47(1), 248–257 (2009)
Foulsham, T., Barton, J.J.S., Kingstone, A., Dewhurst, R., Underwood, G.: Modeling eye movements in visual agnosia with a saliency map approach: bottom-up guidance or top-down strategy? Neural Networks 24(6), 665–677 (2011)
Freund, Y., Schapire, R.: A desicion-theoretic generalization of on-line learning and an application to boosting. Computational Learning Theory 904(1), 23–37 (1995)
Hyvärinen, A., Hoyer, P.O., Inki, M.: Topographic independent component analysis. Neural Computation 13(7), 1527–1558 (2001)
Itti, L., Dhavale, N., Pighin, F.: Realistic Avatar Eye and Head Animation Using a Neurobiological Model of Visual Attention. In: Bosacchi, B., Fogel, D.B., Bezdek, J.C. (eds.) Proc. of the SPIE 48th Annual International Symposium on Optical Science and Technology, vol. 5200, pp. 64–78. SPIE Press, Bellingham (2003)
Itti, L., Koch, C., Niebur, E.: A model of saliency-based visual attention for rapid scene analysis. IEEE Transactions on Pattern Analysis and Machine Intelligence 20(11), 1254–1259 (1998)
Karatekin, C.: Eye tracking studies of normative and atypical development. Developmental Review 27(3), 283–348 (2007)
Le, Q.Q., Ngiam, J., Chen, Z., Hao Chia, D.J., Koh, P.W., Ng, A.Y., Chia, D.: Tiled convolutional neural networks. In: Lafferty, J., Williams, C.K.I., Shawe-Taylor, J., Zemel, R.S., Culotta, A. (eds.) Advances in Neural Information Processing Systems, vol. 23, pp. 1279–1287 (2010)
Li, Z., Itti, L.: Saliency and Gist Features for Target Detection in Satellite Images. IEEE Transactions on Image Processing (December 2010)
Mannan, S.K., Kennard, C., Husain, M.: The role of visual salience in directing eye movements in visual object agnosia. Current Biology 19(6), R247–R248 (2009)
Tseng, P.H., Cameron, I.G.M., Pari, G., Reynolds, J.N., Munoz, D.P., Itti, L.: High-throughput classification of clinical populations from natural viewing eye movements. Journal of Neurology (August 2012)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Tseng, PH., Paolozza, A., Munoz, D.P., Reynolds, J.N., Itti, L. (2013). Deep Learning on Natural Viewing Behaviors to Differentiate Children with Fetal Alcohol Spectrum Disorder. In: Yin, H., et al. Intelligent Data Engineering and Automated Learning – IDEAL 2013. IDEAL 2013. Lecture Notes in Computer Science, vol 8206. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-41278-3_22
Download citation
DOI: https://doi.org/10.1007/978-3-642-41278-3_22
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-41277-6
Online ISBN: 978-3-642-41278-3
eBook Packages: Computer ScienceComputer Science (R0)