Skip to main content
SpringerLink
Log in

Animating Chinese Paintings through Stroke-based Decomposition

  • Chapter
A Computational Approach to Digital Chinese Painting and Calligraphy

Part of the book series: Advanced Topics in Science and Technology in China ((ATSTC))

  • 949 Accesses

Abstract

This chapter proposes a technique to animate a “Chinese style” painting given its image. We first extract descriptions of the brush strokes that hypothetically produced it. The key to the extraction process is the use of a brush stroke library, which is obtained by digitizing single brush strokes drawn by an experienced artist. The steps in our extraction technique are to first segment the input image, to then find the best set of brush strokes that fit the regions, and finally to refine these strokes to account for local appearance. We model a single brush stroke using its skeleton and contour, and we characterize texture variation within each stroke by sampling perpendicularly along its skeleton. Once these brush descriptions have been obtained, the painting can be animated at the brush stroke level. In this chapter we focus on Chinese paintings with relatively sparse strokes. The animation is produced using a graphical application we developed. We present several animations of real paintings using our technique.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
USD 169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Marc Alexa, Daniel Cohen-Or, and David Levin. As-rigid-as-possible shape interpolation. In SIGGRAPH’ 00: Proceedings of the 27th Annual Conference on Computer Graphics and Interactive Techniques, New Orleans, LA, USA: ACM Press/Addison-Wesiey Publishing Co., pages 157–164, 2000.

    Chapter  Google Scholar 

  2. William A. Barrett and Alan S. Cheney. Object-based image editing. In SIGGRAPH’ 02: Proceedings of the 29th Annual Conference on Computer Graphics and Interactive Techniques, San Antonio, TX, USA: ACM Press, pages 777–784, 2002.

    Chapter  Google Scholar 

  3. Dorothea Blostein and Lippold Haken. Using diagram generation software to improve diagram recognition: A case study of music notation. IEEE Transactions on Pattern Analysis and Machine Intelligence, 21(11):1121–1136, 1999.

    Article  Google Scholar 

  4. Bill Baxter, Vincent Scheib, Ming C. Lin, and Dinesh Manocha. DAB: Interactive haptic painting with 3D virtual brushes. In SIGGRAPH’ 01: Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques, Los Angeles, CA, USA: ACM Press, pages 461–468, 2001.

    Chapter  Google Scholar 

  5. Huangmei Chen, editor. Encyclopaedia of China, Film Volume (in Chinese). Beijing, China: Encyclopaedia of China. Press, 1994.

    Google Scholar 

  6. Yap S. Chua A Bayesian approach to digital matting. In CVPR’2001: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, volume II, Kauai, Hawaii: IEEE Computer Society, pages 264–271, 2001.

    Google Scholar 

  7. Dorin Comaniciu and Peter Meer. Mean shift: A robust approach toward feature space analysis. IEEE Transactions on Pattern Analysis and Machine Intelligence, 24(5):603–619, 2002.

    Article  Google Scholar 

  8. Jihua Chen and Junxiang Zhang, editors. Dictionary of Chinese Films (in Chinese). Shanghai, China: Shanghai Dictionary Press, 1995.

    Google Scholar 

  9. Eric Daniels. Deep canvas in Disney’s Tarzan. In SIGGRAPH’ 99: ACM SIGGRAPH 99 Conference Abstracts and Applications, Los Angeles, CA, USA: ACM Press, page 200, 1999.

    Chapter  Google Scholar 

  10. Doug DeCarlo and Anthony Santella. Stylisation and abstraction of photographs. In SIGGRAPH’ 02: Proceedings of the 29th Annual Conference on Computer Graphics and Interactive Techniques, San Antonio, TX, USA: ACM Press, pages 769–776, 2002.

    Chapter  Google Scholar 

  11. Hany Farid and Edward H. Adelson. Separating reflections from images by use of independent components analysis. Journal of the Optical Society of America, 16(9):2136–2145, 1999.

    Article  Google Scholar 

  12. David A. Forsyth and Jean Ponce. Computer Vision: A Modern Approach. Prentice Hall, 2002.

    Google Scholar 

  13. Jerome A. Feldman and Yoram Yakimovsky. Decision theory and artificial intelligence: I. a semantics-based region analyzer. Artificial Intelligence, 5(4):349–371, 1974.

    Article  MATH  Google Scholar 

  14. Bruce Gooch, Greg Coombe, and Peter Shirley. Artistic vision: painterly rendering using computer vision techniques. In NPAR’ 02: Proceedings of the 2nd International Symposium on Non-photorealistic Animation and Rendering, Annecy, France: ACM Press, pages 83–90, 2002.

    Chapter  Google Scholar 

  15. Youichi Horry, Ken-Ichi Anjyo, and Kiyoshi Arai. Tour into the picture: using a spidery mesh interface to make animation from a single image. In S1GGRAPH’ 97: Proceedings of the 24th Annual Conference on Computer Graphics and. Interactive Techniques, Los Angeles, CA, USA: ACM Press/Addison-Wesley Publishing Co., pages 225–232, 1997.

    Chapter  Google Scholar 

  16. Aaron Hertzmann. Introduction to 3D non-photorealistic rendering: silhouettes and outlines. In Ed. Non-photorealistic Rendering. SIGGRAPH 99, Course Notes, Los angeles, CA, USA: ACM Press, 1999.

    Google Scholar 

  17. Siu-Chi Hsu and Irene H. H. Lee. Drawing and animation using skeletal strokes. In SIGGRAPH’ 94: Proceedings of the 21st Annual Conference on Computer Graphics and. Interactive Techniques, Orlando, FL, USA: ACM Press, pages 109–118, 1994.

    Chapter  Google Scholar 

  18. S.C. Hsu, I.H.H. Lee, C.W. Lou, and S.L. Siu. Software. In Creature House (www.creaiurehouse.com), 1999.

    Google Scholar 

  19. Anil K. Jain. Fundamentals of Digital Image Processing. Prentice Hall, 1989.

    Google Scholar 

  20. S. H. Joseph and T. P. Pridmore. Knowledge-directed interpretation of mechanical engineering drawings. IEEE Transactions on Pattern Analysis and Machine Intelligence, 14(9):928–940, 1992.

    Article  Google Scholar 

  21. DeaneB. Judd and Gunther Wyszecki. Color in Business. Science,and Industry. John Wiley & Sons, Inc., 1975.

    Google Scholar 

  22. Sunil K. Kumar and Uday B. Desai. Joint segmentation and image interpretation. Pattern Recognition, 32(4):577–589, 1999.

    Article  Google Scholar 

  23. [KMM+02]_Robert D. Kalnins, Lee Markosian, Barbara J. Meier, Michael A. Kowalski, Joseph C. Lee, Philip L. Davidson, Matthew Webb, John F. Hughes, and Adam Finkelstein. WYSIWYG NPR: drawing strokes directly on 3D models. In SIGGRAPH’ 02: Proceedings of the 29th Annual Conference on Computer Graphics and, Interactive Techniques, San Antonio, TX, USA: ACM Press, pages 755–762, 2002.

    Chapter  Google Scholar 

  24. Lifeng Liu and Stan Sclaroff. Region segmentation via de-formable model-guided split and merge. In ICCV 2001 Proceedings of the International Conference on Computer Vision, Vancouver, Canada: IEEE Computer Society, volume 1, pages 98–104, 2001.

    Chapter  Google Scholar 

  25. Peter Litwinowicz and Lance Williams. Animating images with drawings. In SIGGRAPH’ 94: Proceedings of the 21st Annual Conference on Computer Graphics and Interactive Techniques, Orlando, FL, USA: ACM Press, pages 409–412, 1994.

    Chapter  Google Scholar 

  26. Anat Levin and Yair Weiss. User-assisted separation of reflections from a single image using a sparsity prior. In EGCV’2004-European Conference on Computer Vision, Prague, Czech Republic, pages 602–613, 2004.

    Google Scholar 

  27. Anat Levin, Assaf Zomet, and Yair Weiss. Separating reflections from a single image using local features. In CVPR’2004: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA: IEEE Computer Society, pages 306–313, 2004.

    Google Scholar 

  28. Jan A. Mulder, Alan K. Mackworth, and Willian S. Havens. Knowledge structuring and constraint satisfaction: the mapsee approach. IEEE Transactions on Pattern Analysis and Machine Intelligence, 10(6):366–379, 1988.

    Article  Google Scholar 

  29. Jose L. Marroquin, Edgar A. Santana, and Salvador Botello. Hidden Markov measure field models for image segmentation. IEEE Transactions on Pattern Analysis and Machine Intelligence, 25(11):1380–1387, 2003.

    Article  Google Scholar 

  30. Anke Neumann. Graphical Gaussian shape models and their application to image segmentation. IEEE Transactions on Pattern Analysis and Machine Intelligence, 25(3):316–329, 2003.

    Article  Google Scholar 

  31. Thomas Porter and Tom Duff. Compositing digital images. In SIGGRAPH’ 84: Proceedings of the 11th Annual Conference on Computer Graphics and Interactive Techniques, Minneapolis, MN, USA: ACM Press, pages 253–259, 1984.

    Chapter  Google Scholar 

  32. Richard Szeliski, Shai Avidan, and P. Anandan. Layer extraction from multiple images containing reflections and transparency. In CVPR 2000: IEEE Computer Society Conference on Computer Vision and, Pattern Recognition, Hilton Head Island, SC, USA: IEEE Computer Society, volume I, pages 246–253, 2000.

    Google Scholar 

  33. Michael P. Salisbury, Sean E. Anderson, Ronen Barzel, and David H. Salesin. Interactive pen-and-ink illustration. In SIGGRAPH’ 94: Proceedings of the 21st Annual Conference on Computer Graphics and, Interactive Techniques, Orlando, FL, USA: ACM Press, pages 101–108, 1994.

    Chapter  Google Scholar 

  34. Philip J. Schneider. An algorithm for automatically fitting digitized curves. Graphics Gems, ed. A. S. Glassner, London, UK: Academic Press, pages 612–626, 1990.

    Google Scholar 

  35. Thomas W. Sederberg and Rida T. Farouki. Approximation by interval Bézier curves. IEEE Computer Graphics and Applications, 12(5):87–95, 1992.

    Article  Google Scholar 

  36. Ray Smith and Elizabeth Lloyd. Art School. Dorling Kindersley Ltd., Inc., 1997.

    Google Scholar 

  37. Stan Sclaroff and Lifeng Liu. Deformable shape detection and description via model-based region grouping. IEEE Transactions on Pattern Analysis and Machine Intelligence, 23(5):475–489, 2001.

    Article  Google Scholar 

  38. Steve Strassmann. Hairy brushes. In SIGGRAPH’ 86: Proceedings of the 13th Annual Conference on Computer Graphics and Interactive Techniques, Dallas. TX, USA: ACM Press, pages 225–232, 1986.

    Chapter  Google Scholar 

  39. Sara L. Su, Ying-Qing Xu, Heung-Yeung Shum, and Falai Chen. Simulating artistic brushstrokes using interval splines. In Proceedings of the 5th IASTED International Conference on Computer Graphics and Imaging, Kauai, Hawaii, USA, pages 85–90, 2002.

    Google Scholar 

  40. Jay M. Tenenbaum, and Harry G. Barrow. Experiments in interpret at ion-guided segmentation. In Artificial Intelligence, 8(3):241–274, 1977.

    Article  Google Scholar 

  41. R. C. Veltkamp and M. Hagedoorn. State of the art in shape matching. In Technical Report UU-CS-1999-27, Netherlands: Utrecht University, 1999.

    Google Scholar 

  42. Jin Wang and Jack Jean. Segmentation of merged characters by neural networks and shortest-path. In SAC’ 93: Proceedings of the 1993 ACM/SIGAPP Symposium on Applied Computing: States of the Art and Practice, Indianapolis, IN, USA: ACM Press, pages 762–769, 1993.

    Chapter  Google Scholar 

  43. Ching-Huei Wang and Sargur N. Srihari. A framework for object recognition in a visually complex environment and its application to locating address blocks on mail pieces. International Journal of Computer Vision, 2(2):125–151, 1988.

    Article  Google Scholar 

  44. Song Wang and Jeffrey M. Siskind. Image segmentation with ratio cut. IEEE Transactions on Pattern Analysis and Machine Intelligence, 25(6):675–690, 2003.

    Article  Google Scholar 

  45. Songhua Xu, Min Tang, Francis C. M. Lau, and Yunhe Pan. Virtual hairy brush for painterly rendering. Graphical Models, 66(5):263–302, 2004.

    Article  MATH  Google Scholar 

  46. Richard Zanibbi, Dorothea Blostein, and James R. Cordy. Recognizing mathematical expressions using tree transformation. IEEE Transactions on Pattern Analysis and, Machine Intelligence, 24(11):1455–1467, 2002.

    Article  Google Scholar 

  47. R. W. Zhou, C. Quek, and G. S. Ng. A novel single-pass thinning algorithm and an effective set of performance criteria. Pattern Recognition Letters, 16(12):1267–1275, 1995.

    Article  Google Scholar 

Download references

Rights and permissions

Reprints and permissions

Copyright information

© 2009 Zhejiang University Press, Hangzhou and Springer-Verlag GmbH Berlin Heidelberg

About this chapter

Cite this chapter

(2009). Animating Chinese Paintings through Stroke-based Decomposition. In: A Computational Approach to Digital Chinese Painting and Calligraphy. Advanced Topics in Science and Technology in China. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-88148-3_11

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-88148-3_11

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-88147-6

  • Online ISBN: 978-3-540-88148-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation