A low-cost projector-based hand-held flexible display system


In this paper, we propose a low-cost hand-held flexible display system which uses a projector to project display content onto an ordinary white paper that can be twisted freely. The ultimate goal is to develop an interactive viewing tool for displaying content on flexible surface that can be deformed by the user, i.e., when the user twists the paper, the display content on the paper deforms simultaneously. This system has a lot of potential in the entertainment and education industries. A pair of cameras is employed to track the pattern printed on the back of paper. The cameras and the projector are calibrated off-line via a simple and convenient method. A real-time algorithm is proposed to recover the 3D surface of the paper. The display content is then pre-warped according to the recovered surface and projected onto the front of the paper. Two demonstrative applications are elaborated to illustrate the potential of the proposed system. Our system is easy to set up and runs in real-time. Experimental results show that the flexible display is created with satisfactory accuracy and robustness.

This is a preview of subscription content, log in to check access.

Access options

Buy single article

Instant unlimited access to the full article PDF.

US$ 39.95

Price includes VAT for USA

Subscribe to journal

Immediate online access to all issues from 2019. Subscription will auto renew annually.

US$ 199

This is the net price. Taxes to be calculated in checkout.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13


  1. 1.

    Bouguet JY. Pyramidal implementation of the lucas kanade feature tracker

  2. 2.

    Bregler C, Hertzmann A, Biermann H (200) Recovering non-rigid 3d shape from image streams. In Proceedings of intl. Conf. on Computer Vision and Pattern Recognition

  3. 3.

    Cassinelli A, Ishikawa M (2009) Volume slicing display. In ACM SIGGRAPH ASIA 2009 Art Gallery & Emerging Technologies: Adaptation (Yokohama, Japan, December 16–19, 2009). SIGGRAPH ASIA '09. ACM, New York, NY, 88–88

  4. 4.

    Ilic S, Fua P (2006) Implicit meshes for surface reconstruction. IEEE Trans Pattern Anal Mach Intell 28(2):328–333

  5. 5.

    Intel. OpenCV.

  6. 6.

    Konieczny J, Shimizu C, Meyer G, Colucci D (2005) A hand-held flexible display system. IEEE Visualization Conference, pp 591–597

  7. 7.

    Lee JC, Hudson SE, Tse E (2008) Foldable interactive displays. In Proceedings of the 21st annual ACM symposium on User Interface Software and Technology, pp 287–290

  8. 8.

    Leung MC, Lee KK, Wong KH, Chang MY (2009) A projector based movable hand-held display system. in Proceedings of intl. Conf. on Computer Vision and Pattern Recognition

  9. 9.

    Levmar. “levmar: levenberg-marquardt non-linear least squares algorithms in c/c++”,

  10. 10.

    Raskar R. Jeroen van B (2005) Low-cost multi-projector curved screen displays. In International Symposium Society for Information Display (SID)

  11. 11.

    Raskar R, Welch G, Low KL, Bandyopadhyay D (2001) Shader lamps: Animating real objects with image-based illumination. In Proceedings of the 12th Eurographics Workshop on Rendering techniques, pp 89–102

  12. 12.

    Salzmann M, Hartley R, Fua P (2007) Convex optimization for deformable surface 3d tracking. in Proceedings of Intl. Conf. on Computer Vision

  13. 13.

    Salzmann M, Pilet J, Ilic S, Fua P (2007) Suface deformation models for non-rigid 3d shape recovery. IEEE Trans Pattern Anal Mach Intell 29(8):1481–1487

  14. 14.

    Sukthankar R, Stockton RG, Mullin MD (2001) Smarter presentations: Exploiting homography in camera-projector systems. In Proceedings of Intl. Conf. on Computer Vision

  15. 15.

    Summet J, Sukthankar R (2005) Tracking locations of moving hand-held displays using projected light. In Proceedings of Pervasive, pp 37–46

  16. 16.

    Xiao J, Baker S, Matthews I, Kanade T (2004) Real-time combined 2d + 3d active appearance models. In Proceedings of intl. Conf. on Computer Vision and Pattern Recognition

  17. 17.

    Zhang Z (2000) A flexible new technique for camera calibration. IEEE Trans Pattern Anal Mach Intell 22(11):1330–1334

Download references

Author information

Correspondence to Zhaorong Li.

Electronic Supplementary Material

Below is the link to the electronic supplementary material.

(AVI 13.8 mb)

Supplementary video

(AVI 13.8 mb)

Rights and permissions

Reprints and Permissions

About this article

Cite this article

Li, Z., Wong, K., Gong, Y. et al. A low-cost projector-based hand-held flexible display system. Multimed Tools Appl 59, 129–148 (2012).

Download citation


  • Flexible display
  • Interactive display system
  • Multi-view reconstruction
  • 3D non-rigid surface tracking