Natural and Fluid 3D Operations with Multiple Input Channels of a Digital Pen

  • Chuanyi LiuEmail author
  • Jiali Zhang
  • Kang Ma
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 10956)


We propose six 3D operation patterns with multiple input channels of a digital pen: these patterns allow users to transfer pre-existing knowledge of physical pens to digital pens on performing 3D operations simply, naturally, intuitively, and fluidly. A prototype system was designed under the patterns and implemented. An informal user study showed that eight novices grasped to perform 3D operations with the prototype system within several minutes and gained more fun than with the typical interfaces.


3D operation Pen input channels Tilt Azimuth Rolling angle 



Supported by the Fundamental Research Funds for the Central Universities Grants No. lzujbky-2016-k07.


  1. 1.
    Bi, X., Moscovich, T., Ramos, G., Balakrishnan, R., Hinckley, K.: An exploration of pen rolling for pen-based interaction. In: Proceedings of UIST 2008, pp. 191–200. ACM (2008)Google Scholar
  2. 2.
    Grandi, J.G., Debarba, H.G., Nedel, L., Maciel, A.: Design and evaluation of a handheld-based 3D user interface for collaborative object manipulation. In: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems - CHI 20117, pp. 5881–5891. ACM Press (2017).
  3. 3.
    Harada, S., Saponas, T.S., Landay, J.A.: Voicepen: augmenting pen input with simultaneous non-linguistic vocalization. In: Proceedings of ICMI 2007, pp. 178–185. ACM (2007)Google Scholar
  4. 4.
    Jacob, R.J., Girouard, A., Hirshfield, L.M., Horn, M.S., Shaer, O., Solovey, E.T., Zigelbaum, J.: Reality-based interaction: a framework for post-wimp interfaces. In: Proceeding of the Twenty-Sixth Annual CHI Conference on Human Factors in Computing Systems - CHI 2008, pp. 201–210. ACM Press (2008)Google Scholar
  5. 5.
    Joseph, J., LaViola, J.: Sketching and gestures 101. In: Proceedings of ACM SIGGRAPH 2007 courses, p. 2. ACM Press (2007)Google Scholar
  6. 6.
    Kazi, R.H., Grossman, T., Cheong, H., Hashemi, A., Fitzmaurice, G.: Dreamsketch: Early stage 3D design explorations with sketching and generative design. In: Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology - UIST 2017, pp. 401–414. ACM Press (2017)Google Scholar
  7. 7.
    Kolhoff, P., Preuß, J., Loviscach, J.: Walking with pens. In: Proceedings of EUROGRAPHICS 2005, pp. 33–36 (2005)Google Scholar
  8. 8.
    Li, Y., Luo, X., Zheng, Y., Xu, P., Fu, H.: Sweepcanvas: sketch-based 3D prototyping on an rgb-d image. In: Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology - UIST 2017, pp. 387–399. ACM Press (2017)Google Scholar
  9. 9.
    Liu, C., Ren, X.: Making pen-based operation more seamless and continuous. In: Gross, T., Gulliksen, J., Kotzé, P., Oestreicher, L., Palanque, P., Prates, R.O., Winckler, M. (eds.) INTERACT 2009. LNCS, vol. 5726, pp. 261–273. Springer, Heidelberg (2009). Scholar
  10. 10.
    Nealen, A., Igarashi, T., Sorkine, O., Alexa, M.: Fibermesh: designing freeform surfaces with 3D curves. In: Proceedings of ACM SIGGRAPH, pp. 41–50. ACM Press (2007)Google Scholar
  11. 11.
    Okawa, M., Yoshida, K.: Text and user generic model for writer verification using combined pen pressure information from ink intensity and indented writing on paper. IEEE Trans. Hum.-Mach. Syst. 45(3), 339–349 (2015)CrossRefGoogle Scholar
  12. 12.
    Oshita, M.: Pen-to-mime: a pen-based interface for interactive control of a human figure. In: Proceedings of Eurographics Workshop on Sketch-Based Interfaces and Modeling 2004, pp. 43–52. Eurographics Association (2004)Google Scholar
  13. 13.
    Pereira, J.P., Jorge, J.A., Branco, V.A., Ferreira, F.N.: Calligraphic interfaces: mixed metaphors for design. In: Proceedings of Interactive Systems: Design, Specification and Verification, DSV-IS 2003, pp. 154–170 (2003)CrossRefGoogle Scholar
  14. 14.
    Ramos, G., Boulos, M., Balakrishnan, R.: Pressure widgets. In: Proceedings of CHI 2004, pp. 487–494. ACM (2004)Google Scholar
  15. 15.
    Schmidt, R., Singh, K., Balakrishnan, R.: Sketching and composing widgets for 3D manipulation. In: Proceedings of EUROGRAPHICS 2008, vol. 27, pp. 3–12. Blackwell Publishing, Hoboken (2008)CrossRefGoogle Scholar
  16. 16.
    Tian, F., Xu, L., Wang, H., Zhang, X., Liu, Y., Setlur, V., Dai, G.: Tilt menu: using the 3D orientation information of pen devices to extend the selection capability of pen-based user interfaces. In: Proceedings of CHI 2008, pp. 1371–1380. ACM (2008)Google Scholar
  17. 17.
    Tompkin, J., Muff, S., McCann, J., Pfister, H., Kautz, J., Alexa, M., Matusik, W.: Joint 5D pen input for light field displays. In: Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology - UIST 2015, pp. 637– 647. ACM Press (2015)Google Scholar
  18. 18.
    Wang, X.M., Wang, P., Liu, C.Y.: PP-menus: localizing pie menus by pressure. In: Proceedings of International Conference on Control and Automation, pp. 532–540. DEStech Publications, Inc., Lancaster (2016)Google Scholar
  19. 19.
    Wigdor, D., Balakrishnan, R.: Tilttext: using tilt for text input to mobile phones. In: Proceedings of UIST 2003, pp. 81–90. ACM (2003)Google Scholar
  20. 20.
    Wu, P.C., Wang, R., Kin, K., Twigg, C., Han, S., Yang, M.H., Chien, S.Y.: Dodecapen: accurate 6dof tracking of a passive stylus. In: Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology - UIST 2017, pp. 365–374. ACM Press (2017).
  21. 21.
    Zakaria, M.N., Shukri, S.R.M.: A sketch-and-spray interface for modeling trees. In: Butz, A., Fisher, B., Krüger, A., Olivier, P., Owada, S. (eds.) SG 2007. LNCS, vol. 4569, pp. 23–35. Springer, Heidelberg (2007). Scholar
  22. 22.
    Zeleznik, R.C., Herndon, K.P., Hughes, J.F.: Sketch: an interface for sketching 3D scenes. In: Proceedings of ACM SIGGRAPH 2007 Courses, pp. 19–24. ACM (2007)Google Scholar
  23. 23.
    Zhu, H., Song, Y., Nie, D., Peng, X.: Real-time 3D collaborative satellite orbit design system based on message queue and p2p structure. In: 2017 IEEE 21st International Conference on Computer Supported Cooperative Work in Design (CSCWD), pp. 503–508. IEEE, April 2017.

Copyright information

© Springer International Publishing AG, part of Springer Nature 2018

Authors and Affiliations

  1. 1.School of Information Science and EngineeringLanzhou UniversityLanzhouChina

Personalised recommendations