Skip to main content
SpringerLink
Log in

Water-Filling: An Efficient Algorithm for Digitized Document Shadow Removal

  • Conference paper
  • First Online:
Book cover Computer Vision – ACCV 2018 (ACCV 2018)

Part of the book series: Lecture Notes in Computer Science ((LNIP,volume 11361))

Included in the following conference series:

Abstract

In this paper, we propose a novel algorithm to rectify illumination of the digitized documents by eliminating shading artifacts. Firstly, a topographic surface of an input digitized document is created using luminance value of each pixel. Then the shading artifact on the document is estimated by simulating an immersion process. The simulation of the immersion process is modeled using a novel diffusion equation with an iterative update rule. After estimating the shading artifacts, the digitized document is reconstructed using the Lambertian surface model. In order to evaluate the performance of the proposed algorithm, we conduct rigorous experiments on a set of digitized documents which is generated using smartphones under challenging lighting conditions. According to the experimental results, it is found that the proposed method produces promising illumination correction results and outperforms the results of the state-of-the-art methods.

This research was supported by Hancom Inc.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Athimethphat, M.: A review on global binarization algorithms for degraded document images. AU JT 14(3), 188–195 (2011)

    Google Scholar 

  2. Azmi, M.H., Iqbal Saripan, M., Azmir, R.S., Abdullah, R.: Illumination compensation for document images using local-global block analysis. In: Badioze Zaman, H., Robinson, P., Petrou, M., Olivier, P., Schröder, H., Shih, T.K. (eds.) IVIC 2009. LNCS, vol. 5857, pp. 636–644. Springer, Heidelberg (2009). https://doi.org/10.1007/978-3-642-05036-7_60

    Chapter  Google Scholar 

  3. Bako, S., Darabi, S., Shechtman, E., Wang, J., Sunkavalli, K., Sen, P.: Removing shadows from images of documents. In: Lai, S.-H., Lepetit, V., Nishino, K., Sato, Y. (eds.) ACCV 2016. LNCS, vol. 10113, pp. 173–183. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-54187-7_12

    Chapter  Google Scholar 

  4. Brown, M.S., Tsoi, Y.C.: Geometric and shading correction for images of printed materials using boundary. IEEE Trans. Image Process. 15(6), 1544–1554 (2006)

    Article  Google Scholar 

  5. Bukhari, S.S., Shafait, F., Breuel, T.M.: Foreground-background regions guided binarization of camera-captured document images. In: Proceedings of the International Workshop on Camera Based Document Analysis and Recognition, vol. 7. Citeseer (2009)

    Google Scholar 

  6. Chandrasekhar, V.R., et al.: The stanford mobile visual search data set. In: Proceedings of the Second Annual ACM Conference on Multimedia Systems, pp. 117–122. ACM (2011)

    Google Scholar 

  7. Fan, J.: Enhancement of camera-captured document images with watershed segmentation. In: CBDAR07 pp. 87–93 (2007)

    Google Scholar 

  8. Fan, K.C., Wang, Y.K., Lay, T.R.: Marginal noise removal of document images. Pattern Recogn. 35(11), 2593–2611 (2002)

    Article  Google Scholar 

  9. Forsyth, D.A., Ponce, J.: Computer Vision: A Modern Approach (2003)

    Google Scholar 

  10. Gatos, B., Pratikakis, I., Perantonis, S.J.: Adaptive degraded document image binarization. Pattern Recogn. 39(3), 317–327 (2006)

    Article  Google Scholar 

  11. Kim, B.S., Koo, H.I., Cho, N.I.: Document dewarping via text-line based optimization. Pattern Recogn. 48(11), 3600–3614 (2015)

    Article  Google Scholar 

  12. Kligler, N., Katz, S., Tal, A.: Document enhancement using visibility detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 2374–2382 (2018)

    Google Scholar 

  13. Lee, J.S., Chen, C.H., Chang, C.C.: A novel illumination-balance technique for improving the quality of degraded text-photo images. IEEE Trans. Circuits Syst. Video Technol. 19(6), 900–905 (2009)

    Article  Google Scholar 

  14. Lu, S., Su, B., Tan, C.L.: Document image binarization using background estimation and stroke edges. IJDAR 13(4), 303–314 (2010)

    Article  Google Scholar 

  15. Lu, S., Tan, C.L.: Binarization of badly illuminated document images through shading estimation and compensation. In: Ninth International Conference on Document Analysis and Recognition, 2007. ICDAR 2007, vol. 1, pp. 312–316. IEEE (2007)

    Google Scholar 

  16. Meng, G., Pan, C., Xiang, S., Duan, J.: Metric rectification of curved document images. IEEE Trans. Pattern Anal. Mach. Intell. 34(4), 707–722 (2012)

    Article  Google Scholar 

  17. Meng, G., Xiang, S., Zheng, N., Pan, C.: Nonparametric illumination correction for scanned document images via convex hulls. IEEE Trans. Pattern Anal. Mach. Intell. 35(7), 1730–1743 (2013)

    Article  Google Scholar 

  18. Oliveira, D.M., Lins, R.D.: Generalizing tableau to any color of teaching boards. In: 2010 International Conference on Pattern Recognition, pp. 2411–2414. IEEE (2010)

    Google Scholar 

  19. Oliveira, D.M., Lins, R.D.: A new method for shading removal and binarization of documents acquired with portable digital cameras. In: Proceedings of Third International Workshop on Camera-Based Document Analysis and Recognition, Barcelona, Spain, pp. 3–10 (2009)

    Google Scholar 

  20. Oliveira, D.M., Lins, R.D., de França Pereira e Silva, G.: Shading removal of illustrated documents. In: Kamel, M., Campilho, A. (eds.) ICIAR 2013. LNCS, vol. 7950, pp. 308–317. Springer, Heidelberg (2013). https://doi.org/10.1007/978-3-642-39094-4_35

    Chapter  Google Scholar 

  21. Otsu, N.: A threshold selection method from gray-level histograms. Automatica 11(285–296), 23–27 (1975)

    Google Scholar 

  22. Rais, N.B., Hanif, M.S., Taj, R., et al.: Adaptive thresholding technique for document image analysis. In: Multitopic Conference, 2004. Proceedings of INMIC 2004. 8th International, pp. 61–66. IEEE (2004)

    Google Scholar 

  23. Roerdink, J.B., Meijster, A.: The watershed transform: definitions, algorithms and parallelization strategies. Fundam. Inform. 41(1–2), 187–228 (2000)

    MathSciNet  MATH  Google Scholar 

  24. Sauvola, J., Pietikäinen, M.: Adaptive document image binarization. Pattern Recogn. 33(2), 225–236 (2000)

    Article  Google Scholar 

  25. Shafait, F., van Beusekom, J., Keysers, D., Breuel, T.M.: Page frame detection for marginal noise removal from scanned documents. In: Ersbøll, B.K., Pedersen, K.S. (eds.) SCIA 2007. LNCS, vol. 4522, pp. 651–660. Springer, Heidelberg (2007). https://doi.org/10.1007/978-3-540-73040-8_66

    Chapter  Google Scholar 

  26. Smith, R.W.: Hybrid page layout analysis via tab-stop detection. In: 10th International Conference on Document Analysis and Recognition, 2009. ICDAR 2009, pp. 241–245. IEEE (2009)

    Google Scholar 

  27. Sternberg, S.R.: Biomedical image processing. Computer 16(1), 22–34 (1983)

    Article  Google Scholar 

  28. Tan, C.L., Zhang, L., Zhang, Z., Xia, T.: Restoring warped document images through 3D shape modeling. IEEE Trans. Pattern Anal. Mach. Intell. 28(2), 195–208 (2006)

    Article  Google Scholar 

  29. Tian, Y., Narasimhan, S.G.: Rectification and 3D reconstruction of curved document images. In: 2011 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 377–384. IEEE (2011)

    Google Scholar 

  30. Tsoi, Y.C., Brown, M.S.: Geometric and shading correction for images of printed materials: a unified approach using boundary. In: Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR 2004, pp. 240–246. IEEE (2004)

    Google Scholar 

  31. Vincent, L., Soille, P.: Watersheds in digital spaces: an efficient algorithm based on immersion simulations. IEEE Trans. Pattern Anal. Mach. Intell. 6, 583–598 (1991)

    Article  Google Scholar 

  32. Wada, T., Ukida, H., Matsuyama, T.: Shape from shading with interreflections under proximal light source-3D shape reconstruction of unfolded book surface from a scanner image. In: Fifth International Conference on Computer Vision, 1995. Proceedings, pp. 66–71. IEEE (1995)

    Google Scholar 

  33. Zhang, L.: Restoring warped document images using shape-from-shading and surface interpolation. In: 18th International Conference on Pattern Recognition, 2006. ICPR 2006, vol. 1, pp. 642–645. IEEE (2006)

    Google Scholar 

  34. Zhang, L., Yip, A.M., Brown, M.S., Tan, C.L.: A unified framework for document restoration using inpainting and shape-from-shading. Pattern Recogn. 42(11), 2961–2978 (2009)

    Article  Google Scholar 

  35. Zhang, L., Yip, A.M., Tan, C.L.: Removing shading distortions in camera-based document images using inpainting and surface fitting with radial basis functions. In: Ninth International Conference on Document Analysis and Recognition, 2007. ICDAR 2007, vol. 2, pp. 984–988. IEEE (2007)

    Google Scholar 

  36. Zhang, L., Yip, A.M., Tan, C.L.: A restoration framework for correcting photometric and geometric distortions in camera-based document images. In: IEEE 11th International Conference on Computer Vision, 2007. ICCV 2007, pp. 1–8. IEEE (2007)

    Google Scholar 

  37. Zhang, L., Zhang, Z., Tan, C.L., Xia, T.: 3D geometric and optical modeling of warped document images from scanners. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2005. CVPR 2005, vol. 1, pp. 337–342. IEEE (2005)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. KAIST, Daejeon, Republic of Korea

    Seungjun Jung & Changick Kim

  2. University of South Australia, Adelaide, SA, Australia

    Muhammad Abul Hasan

Authors
  1. Seungjun Jung
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Muhammad Abul Hasan
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Changick Kim
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Changick Kim .

Editor information

Editors and Affiliations

  1. IIIT Hyderabad, Hyderabad, India

    C. V. Jawahar

  2. ANU, Canberra, ACT, Australia

    Hongdong Li

  3. Simon Fraser University, Burnaby, BC, Canada

    Greg Mori

  4. ETH Zurich, Zurich, Zürich, Switzerland

    Konrad Schindler

1 Electronic supplementary material

Below is the link to the electronic supplementary material.

Supplementary material 1 (zip 99112 KB)

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Jung, S., Hasan, M.A., Kim, C. (2019). Water-Filling: An Efficient Algorithm for Digitized Document Shadow Removal. In: Jawahar, C., Li, H., Mori, G., Schindler, K. (eds) Computer Vision – ACCV 2018. ACCV 2018. Lecture Notes in Computer Science(), vol 11361. Springer, Cham. https://doi.org/10.1007/978-3-030-20887-5_25

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-20887-5_25

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-20886-8

  • Online ISBN: 978-3-030-20887-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation