Interactive Image Segmentation Method of Eye Movement Data and EEG Data
Interactive image segmentation method plays a vital role in various applications, such as image processing, computer vision and other fields. Traditional interactive image segmentation methods focus on using the way of manually adding interactive information, such as sketching the edges, distinguishing foreground backgrounds with dotted frames, and so on. The information acquisition and decoding technology has become more mature, such as in eye movement and electroencephalogram, and based on which, this paper presents an interactive image segmentation method that uses eye movement trajectory and EEG as interactive information. While observing the image, it collects the data from EEG and eye movement, based on these physiological signals to establish a more natural interactive image object segmentation method. The results show that the method of brain-computer interaction based image segmentation has advantages in the following aspects: first, it is hand-free, and can be applied to special occasions; second, there will be higher efficiency and better results in multi-target image segmentation. This research provides a new way to establish a new method of image segmentation based on human-computer cooperation.
KeywordsInteractive image segmentation method Human-computer cooperation
This work is supported by the NSFC Key Program (91520202), and General Program (61375116). This work is also supported by Beijing Advanced Innovation Center For Future Education with grant No. BJAICFE2016IR-003.
- Vezhnevets, V., Konouchine, V.: GrowCut: interactive multi-label ND image segmentation by cellular automata. In: Proceedings of Graphicon, vol. 1, pp. 150–156 (2005)Google Scholar
- Hernández-Vela, A., Hernández-Vela, A., Primo, C., et al.: Automatic user interaction correction via multi-label graph cuts. In: 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops), pp. 1276–1281. IEEE (2011)Google Scholar
- Mortensen, E.N., Barrett, W.A.: Toboggan-based intelligent scissors with a four-parameter edge model. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 2, pp. 452–458. IEEE (1999)Google Scholar
- Boykov, Y.Y., Jolly, M.P.: Interactive graph cuts for optimal boundary & region segmentation of objects in ND images. In: Proceedings of Eighth IEEE International Conference on Computer Vision, ICCV 2001, vol. 1, pp. 105–112. IEEE (2001)Google Scholar
- Rother, C., Kolmogorov, V., Blake, A.: Grabcut: interactive foreground extraction using iterated graph cuts. In: ACM Transactions on Graphics (TOG), vol. 23, no. 3, pp. 309–314. ACM (2004)Google Scholar
- Worden, M.S., Foxe, J.J., Wang, N., et al.: Anticipatory biasing of visuospatial attention indexed by retinotopically specific-band electroencephalography increases over occipital cortex. J. Neurosci. 20(RC63), 1–6 (2000)Google Scholar
- Wengert, C., Douze, M., Jégou, H.: Bag-of-colors for improved image search. In: Proceedings of the 19th ACM International Conference on Multimedia, pp. 1437–1440. ACM (2011)Google Scholar
- Kanwisher, N., McDermott, J., Chun, M.M.: The fusiform face area: a module in human extrastriate cortex specialized for face perception. J. Neurosci. 17(11), 4302–4311 (1997)Google Scholar