In this paper, we propose a low-cost hand-held flexible display system which uses a projector to project display content onto an ordinary white paper that can be twisted freely. The ultimate goal is to develop an interactive viewing tool for displaying content on flexible surface that can be deformed by the user, i.e., when the user twists the paper, the display content on the paper deforms simultaneously. This system has a lot of potential in the entertainment and education industries. A pair of cameras is employed to track the pattern printed on the back of paper. The cameras and the projector are calibrated off-line via a simple and convenient method. A real-time algorithm is proposed to recover the 3D surface of the paper. The display content is then pre-warped according to the recovered surface and projected onto the front of the paper. Two demonstrative applications are elaborated to illustrate the potential of the proposed system. Our system is easy to set up and runs in real-time. Experimental results show that the flexible display is created with satisfactory accuracy and robustness.
This is a preview of subscription content, log in to check access.
Buy single article
Instant unlimited access to the full article PDF.
Price includes VAT for USA
Subscribe to journal
Immediate online access to all issues from 2019. Subscription will auto renew annually.
This is the net price. Taxes to be calculated in checkout.
Bouguet JY. Pyramidal implementation of the lucas kanade feature tracker
Bregler C, Hertzmann A, Biermann H (200) Recovering non-rigid 3d shape from image streams. In Proceedings of intl. Conf. on Computer Vision and Pattern Recognition
Cassinelli A, Ishikawa M (2009) Volume slicing display. In ACM SIGGRAPH ASIA 2009 Art Gallery & Emerging Technologies: Adaptation (Yokohama, Japan, December 16–19, 2009). SIGGRAPH ASIA '09. ACM, New York, NY, 88–88
Ilic S, Fua P (2006) Implicit meshes for surface reconstruction. IEEE Trans Pattern Anal Mach Intell 28(2):328–333
Intel. OpenCV. http://www.intel.com/technology/computing/opencv
Konieczny J, Shimizu C, Meyer G, Colucci D (2005) A hand-held flexible display system. IEEE Visualization Conference, pp 591–597
Lee JC, Hudson SE, Tse E (2008) Foldable interactive displays. In Proceedings of the 21st annual ACM symposium on User Interface Software and Technology, pp 287–290
Leung MC, Lee KK, Wong KH, Chang MY (2009) A projector based movable hand-held display system. in Proceedings of intl. Conf. on Computer Vision and Pattern Recognition
Levmar. “levmar: levenberg-marquardt non-linear least squares algorithms in c/c++”, http://www.ics.forth.gr/lourakis/levmar/
Raskar R. Jeroen van B (2005) Low-cost multi-projector curved screen displays. In International Symposium Society for Information Display (SID)
Raskar R, Welch G, Low KL, Bandyopadhyay D (2001) Shader lamps: Animating real objects with image-based illumination. In Proceedings of the 12th Eurographics Workshop on Rendering techniques, pp 89–102
Salzmann M, Hartley R, Fua P (2007) Convex optimization for deformable surface 3d tracking. in Proceedings of Intl. Conf. on Computer Vision
Salzmann M, Pilet J, Ilic S, Fua P (2007) Suface deformation models for non-rigid 3d shape recovery. IEEE Trans Pattern Anal Mach Intell 29(8):1481–1487
Sukthankar R, Stockton RG, Mullin MD (2001) Smarter presentations: Exploiting homography in camera-projector systems. In Proceedings of Intl. Conf. on Computer Vision
Summet J, Sukthankar R (2005) Tracking locations of moving hand-held displays using projected light. In Proceedings of Pervasive, pp 37–46
Xiao J, Baker S, Matthews I, Kanade T (2004) Real-time combined 2d + 3d active appearance models. In Proceedings of intl. Conf. on Computer Vision and Pattern Recognition
Zhang Z (2000) A flexible new technique for camera calibration. IEEE Trans Pattern Anal Mach Intell 22(11):1330–1334
Electronic Supplementary Material
Below is the link to the electronic supplementary material.
(AVI 13.8 mb)
About this article
Cite this article
Li, Z., Wong, K., Gong, Y. et al. A low-cost projector-based hand-held flexible display system. Multimed Tools Appl 59, 129–148 (2012). https://doi.org/10.1007/s11042-010-0692-y
- Flexible display
- Interactive display system
- Multi-view reconstruction
- 3D non-rigid surface tracking