Skip to main content
SpringerLink
Log in

Multi-resolution Parallel Aggregation Network for Single Image Deraining

  • Conference paper
  • First Online:
Image and Graphics Technologies and Applications (IGTA 2022)

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 1611))

Included in the following conference series:

  • 468 Accesses

Abstract

Single image deraining is an important preprocessing task, as rain streaks awfully reduce the image quality and hinder the subsequence outdoor multimedia issues. In this paper, we explore the multi-resolution representation for rain streaks through parallel hierarchical structure and multi-scale feature extraction and fusion, termed Multi-resolution Parallel Aggregation Network (MPA-Net) in end-to-end manner. Specially, considering the significant role of multi-resolution, we employ the first stage to capture the high-resolution features, progressively introduce high-to-low resolution streams to produce more stages, and then connect all stages in parallel. In each stage, Densely Connected Residual (DCR) block is involved to guide the feature extraction. Besides, Cross-Scale Feature Fusion (CSFF) is first introduced to receive and consolidate the correlated features from different scales followed with Squeeze-and-Excitation (SE) blocks, leading to rich the resolution representations. Extensive experiments demonstrate that our method outperforms the recent comparing approaches on the frequent-use synthetic and real-world datasets.

This work was supported by Innovation project of College students (S202110143005, X202110143128).

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 79.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 99.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Li, Y., et al.: Rain streak removal using layer priors. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 2736–2744 (2016)

    Google Scholar 

  2. Lei, J., et al.: An Image Rain Removal algorithm based on the depth of field and sparse coding. In: 24th International Conference on Pattern Recognition (ICPR), pp. 2368–2373 (2018)

    Google Scholar 

  3. Zhang, H., Patel, V.M.: Convolutional sparse and low-rank coding-based rain streak removal. In: IEEE Winter Conference on Applications of Computer Vision (WACV), pp. 1259–1267 (2017)

    Google Scholar 

  4. Zhang, L., Zuo, W.: Image restoration: from sparse and low-rank priors to deep priors [lecture notes]. IEEE Sig. Process. Mag. 34(5), 172–179 (2017)

    Article  Google Scholar 

  5. Lian, Q., et al.: Single image rain removal using image decomposition and a dense network. IEEE/CAA J. Automatica Sin. 6(6), 1428–1437 (2019)

    Google Scholar 

  6. Chen, X., Huang, Y., Xu, L.: Multi-scale attentive residual dense network for single image rain removal. In: Ishikawa, H., Liu, C.-L., Pajdla, T., Shi, J. (eds.) ACCV 2020. LNCS, vol. 12623, pp. 286–300. Springer, Cham (2021). https://doi.org/10.1007/978-3-030-69532-3_18

    Chapter  Google Scholar 

  7. Wang, F.L., et al.: When a conventional filter meets deep learning: basis composition learning on image filters. ArXiv, abs/2203.00258 (2022)

    Google Scholar 

  8. Zheng, X., Liao, Y., Guo, W., Fu, X., Ding, X.: Single-image-based rain and snow removal using multi-guided filter. In: Lee, M., Hirose, A., Hou, Z.-G., Kil, R.M. (eds.) ICONIP 2013. LNCS, vol. 8228, pp. 258–265. Springer, Heidelberg (2013). https://doi.org/10.1007/978-3-642-42051-1_33

    Chapter  Google Scholar 

  9. Zhang, X., et al.: Rain removal in video by combining temporal and chromatic properties. In: 2006 IEEE International Conference on Multimedia and Expo, pp. 461–464 (2006)

    Google Scholar 

  10. Chen, X., Huang, Y., Xu, L.: Multi-scale hourglass hierarchical fusion network for single image deraining. In: IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), pp. 872–879 (2021)

    Google Scholar 

  11. Fu, X., et al.: Clearing the skies: a deep network architecture for single-image rain removal. IEEE Trans. Image Process. 26(6), 2944–2956 (2017)

    Article  MathSciNet  Google Scholar 

  12. Fu, X., et al.: Removing rain from single images via a deep detail network, pp. 1715–1723 (2017)

    Google Scholar 

  13. Li, X., Wu, J., Lin, Z., Liu, H., Zha, H.: Recurrent squeeze-and-excitation context aggregation net for single image deraining. In: Ferrari, V., Hebert, M., Sminchisescu, C., Weiss, Y. (eds.) ECCV 2018. LNCS, vol. 11211, pp. 262–277. Springer, Cham (2018). https://doi.org/10.1007/978-3-030-01234-2_16

    Chapter  Google Scholar 

  14. Ren, D., et al.: Progressive image deraining networks: a better and simpler baseline. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 3937–3946 (2019)

    Google Scholar 

  15. Wang, T., et al.: Spatial attentive single-image deraining with a high quality real rain dataset. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 12270–12279 (2019)

    Google Scholar 

  16. Jiang, K., et al.: Multi-scale progressive fusion network for single image deraining, pp. 8346–8355 (2020)

    Google Scholar 

  17. Wang, H., et al.: A model-driven deep neural network for single image rain removal. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 3103–3112 (2020)

    Google Scholar 

  18. Park, Y., et al.: MARA-Net: single image deraining network with multi-level connection and adaptive regional attention. arXiv preprint arXiv:2009.13990 (2020)

  19. Wei, Y., et al.: A coarse-to-fine multi-stream hybrid deraining network for single image deraining. In: 2019 IEEE International Conference on Data Mining (ICDM), pp. 628–637 (2019)

    Google Scholar 

  20. Huang, G., et al.: Densely connected convolutional networks, pp. 2261–2269 (2017)

    Google Scholar 

  21. He, K., et al.: Deep residual learning for image recognition, pp. 770–778 (2016)

    Google Scholar 

  22. Hu, J., Shen, L., Sun, G.: Squeeze-and-excitation networks, pp. 7132–7141 (2018)

    Google Scholar 

  23. Yang, W., et al.: Deep joint rain detection and removal from a single image, pp. 1685–1694 (2017)

    Google Scholar 

  24. Zhang, H., Sindagi, V., Patel, V.M.: Image de-raining using a conditional generative adversarial network. IEEE Trans. Circ. Syst. Video Technol. 30(11), 3943–3956 (2020)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. College of Electronic and Information Engineering, Shenyang Aerospace University, Shenyang, 110136, China

    Man Qi & Yufeng Huang

Authors
  1. Man Qi
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yufeng Huang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Yufeng Huang .

Editor information

Editors and Affiliations

  1. Beijing Institute of Technology, Beijing, China

    Yongtian Wang

  2. University of Science and Technology Beijing, Beijing, China

    Huimin Ma

  3. Peking University, Beijing, China

    Yuxin Peng

  4. Beijing Institute of Technology, Beijing, China

    Yue Liu

  5. Institute of Automation, Chinese Academy of Sciences, Beijing, China

    Ran He

Rights and permissions

Reprints and permissions

Copyright information

© 2022 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Qi, M., Huang, Y. (2022). Multi-resolution Parallel Aggregation Network for Single Image Deraining. In: Wang, Y., Ma, H., Peng, Y., Liu, Y., He, R. (eds) Image and Graphics Technologies and Applications. IGTA 2022. Communications in Computer and Information Science, vol 1611. Springer, Singapore. https://doi.org/10.1007/978-981-19-5096-4_1

Download citation

  • DOI: https://doi.org/10.1007/978-981-19-5096-4_1

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-19-5095-7

  • Online ISBN: 978-981-19-5096-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation