Skip to main content
SpringerLink
Log in

Comic storyboard extraction via edge segment analysis

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Comic storyboard extraction aims to decompose the comic image into several storyboards (or frames), which is the key technique to produce the digital comic documents suitable for mobile reading. Previous methods fail either to detect overlapped storyboards or to produce storyboards without blank margins. To tackle these problems, we propose a novel comic storyboard extraction method based on edge segment analysis. First, we extract edge segments (i.e. contiguous chains of Canny edge points) from the input comic image; second, we detect line segments within each obtained edge segment with a top-down scheme; third, we detect storyboards through line segments combination and storyboard validation, and perform post-processing to handle some special cases. We test the proposed method on two datasets comprising 2237 comic pages from 11 printed comic series. Experimental results demonstrate that the proposed method achieves satisfactory results and outperformed the existing methods on the storyboard and page level.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15

Similar content being viewed by others

References

  1. Akinlar C, Topal C (2011) EDLines: a real-time line segment detector with a false detection control. Pattern Recogn Lett 32(13):1633–1642

    Article  Google Scholar 

  2. Arai K, Tolle H (2010) Automatic e-comic content adaptation. Int J Ubiquit Comput 1(1):1–11

    Google Scholar 

  3. Canny J (1986) A computational approach to edge detection. IEEE Trans Pattern Anal Mach Intell 6:679–698

    Article  Google Scholar 

  4. Chan CH, Leung H, Komura T (2007) Automatic panel extraction of color comic images. In: Advances in Multimedia Information Processing–PCM 2007 (pp. 775–784). Springer Berlin Heidelberg

  5. Desolneux A, Moisan L, Morel JM (2000) Meaningful alignments. Int J Comput Vis 40(1):7–23

    Article  MATH  Google Scholar 

  6. Han EJ, Wong CO, Jung KC, Lee KH, Kim EY (2009) Efficient page layout analysis on small devices. J Zhejiang Univ Sci A 10(6):800–804

    Article  Google Scholar 

  7. Ho AKN, Burie JC, Ogier J (2012) Panel and speech balloon extraction from comic books. In: Document Analysis Systems (DAS), 2012 10th IAPR International Workshop on (pp. 424–428). IEEE

  8. Ishii D, Watanabe H (2010). A study on frame position detection of digitized comics images. In: Workshop on Picture Coding and Image Processing (PCSJ), Nagoya (Vol. 2010, pp. 124–125)

  9. Li L, Wang Y, Tang Z, Gao L (2014) Automatic comic page segmentation based on polygon detection. Multimedia Tools Appl 69(1):171–197

    Article  Google Scholar 

  10. Li L, Wang Y, Tang Z, Liu D (2013) Comic image understanding based on polygon detection. In: IS&T/SPIE Electronic Imaging (pp. 86580B–86580B). International Society for Optics and Photonics

  11. Liu D, Wang Y, Tang Z, Li L, Gao L. Automatic comic page image understanding based on edge segment analysis. DRR 2014: 90210J-90210J-12

  12. Liu D, Wang Y, Tang Z, Lu X (2014) A robust and fast line segment detector based on top-down smaller eigenvalue analysis. In: Fifth International Conference on Graphic and Image Processing (pp. 906916–906916). International Society for Optics and Photonics

  13. Ponsard C, Fries V (2009) Enhancing the accessibility for all of digital comic books. Int J Hum Comput Interact 1(5):127–144

    Google Scholar 

  14. Rigaud C, Tsopze N, Burie JC, Ogier JM (2013) Robust frame and text extraction from comic books. In: Graphics Recognition. New Trends and Challenges (pp. 129–138). Springer Berlin Heidelberg

  15. Tanaka T, Shoji K, Toyama F, Miyamichi J (2007) Layout analysis of tree-structured scene frames in comic images. In: IJCAI 7:2885–2890

  16. Von Gioi RG, Jakubowicz J, Morel JM, Randall G (2010) LSD: a fast line segment detector with a false detection control. IEEE Trans Pattern Anal Mach Intell 32(4):722–732

    Article  Google Scholar 

  17. Yamada M, Budiarto R, Mamoru ENDO, Miyazaki S (2004) Comic image decomposition for reading comics on cellular phones. IEICE Trans Inf Syst 87(6):1370–1376

    Google Scholar 

Download references

Acknowledgments

This work is supported by National Natural Science Foundation of China under Grant 61300061, and Beijing Natural Science Foundation under Grant 4132033.

Author information

Authors and Affiliations

  1. Institute of Computer Science and Technology, Peking University, Beijing, China

    Yongtao Wang, Yafeng Zhou, Dong Liu & Zhi Tang

Authors
  1. Yongtao Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yafeng Zhou
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Dong Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Zhi Tang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Yongtao Wang.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Wang, Y., Zhou, Y., Liu, D. et al. Comic storyboard extraction via edge segment analysis. Multimed Tools Appl 75, 2637–2654 (2016). https://doi.org/10.1007/s11042-015-2680-8

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-015-2680-8

Keywords

Search

Navigation