Panel Tracking for the Extraction and the Classification of Speech Balloons

  • Hadi S. JomaaEmail author
  • Mariette Awad
  • Lina Ghaibeh
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9280)


Searching for texts inside a full comic strip may be exhaustive, and can be simplified by restricting the scope of the search to single panels, and better yet to within individual speech balloon. In this paper, a novel approach is devised where a tracking algorithm is employed for panel extraction, and speech balloons are identified using ‘Roberts’ edge detection operator as well as a classifier to find the number of balloons within every panel using a non-exhaustive projection method. Two main objectives in the field of comic strip understanding are achieved through our panel tracking for the extraction and classification of speech balloons (PaTEC). PaTEC may be incorporated as a precursor to text extraction and recognition reducing the computational time and effort of searching the whole image to the speech balloon area itself. PaTEC accuracy for panel extraction is 88.78% while balloon classification accuracy is 81.49% on a homegrown comic database.


Comic strip Panel Classification Speech balloon extraction Comic page segmentation Text detection 


  1. 1.
    Ho, A.K.N., Burie, J.-C., Ogier, J.: Panel and speech balloon extraction from comic books. In: 2012 10th IAPR International Workshop on Document Analysis Systems (DAS). IEEE (2012)Google Scholar
  2. 2.
    Chan, C.H., Leung, H., Komura, T.: Automatic panel extraction of color comic images. In: Ip, H.H.-S., Au, O.C., Leung, H., Sun, M.-T., Ma, W.-Y., Hu, S.-M. (eds.) PCM 2007. LNCS, vol. 4810, pp. 775–784. Springer, Heidelberg (2007)Google Scholar
  3. 3.
    Han, E., Chun, S., Park, A., Jung, K.: Automatic conversion system for mobile cartoon contents. In: Fox, E.A., Neuhold, E.J., Premsmit, P., Wuwongse, V. (eds.) ICADL 2005. LNCS, vol. 3815, pp. 416–423. Springer, Heidelberg (2005)Google Scholar
  4. 4.
    Rigaud, C., et al.: An active contour model for speech balloon detection in comics. In: 2013 12th International Conference on Document Analysis and Recognition (ICDAR). IEEE (2013)Google Scholar
  5. 5.
    Ponsard, C., Fries, V.: An accessible viewer for digital comic books. Springer, Heidelberg (2008)Google Scholar
  6. 6.
    Ishii, D., Watanabe, H.: A study on frame position detection of digitized comics images. In: Proc. Workshop on Picture Coding and Image Processing, PCSJ2010/IMPS2010, Nagoya, Japan (2010)Google Scholar
  7. 7.
    Han, E., Kim, K., Yang, H.-K., Jung, K.: Frame segmentation used MLP-based X-Y recursive for mobile cartoon content. In: Jacko, J.A. (ed.) HCI 2007. LNCS, vol. 4552, pp. 872–881. Springer, Heidelberg (2007)Google Scholar
  8. 8.
    Tanaka, T., et al.: Layout Analysis of Tree-Structured Scene Frames in Comic Images. In: IJCAI, vol. 7 (2007)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2015

Authors and Affiliations

  1. 1.Electrical Engineering DepartmentAmerican University of BeirutBeirutLebanon

Personalised recommendations