Abstract
The authors propose a system that supports children to learn new concepts of familiar topics via their sketches on an interaction surface. The proposed system has two main subcomponents: a system of interaction surface with touch detection from depth images captured by a Kinect and a sketch recognition module based on the idea of bag-of-word model. The system provides a natural and intuitive interface for children because they can learn new concepts via sketching. With the dataset of 70 common concepts, the accuracy of the sketch recognition is 78.21% and the average response time to recognize a sketch is 0.86s. The sketch database can also be easily customized to teach new concepts to children.
Chapter PDF
Similar content being viewed by others
References
Lightwell, http://lightwell.com.au/projects/dangerous-australians/
Enterprise Irregulars, http://www.enterpriseirregulars.com/66218/idc-87-connected-devices-2017-will-tablets-smartphones/
Truong, C.T., Nguyen-Huynh, D.-H., Tran, M.-T., Duong, A.-D.: Collaborative smart virtual keyboard with word predicting function. In: Kurosu, M. (ed.) Human-Computer Interaction, Part IV, HCII 2013. LNCS, vol. 8007, pp. 513–522. Springer, Heidelberg (2013)
Eitz, M., Hays, J., Alexa, M.: How do humans sketch objects? ACM Transactions on Graphics (TOG) - SIGGRAPHÂ 31(4) (July 2012)
Bhat, A., Hammond, T.: Using entropy to distinguish shape versus text in hand-drawn diagrams. In: IJCAI 2009 Proceedings of the 21st International Jont Conference on Artifical Intelligence, San Francisco (2009)
Rubine, D.: Specifying gestures by example. In: SIGGRAPH (July 1991)
Hammond, T., Heeyoul, C.: Sketch recognition based on manifold learning. In: AAAI 2008 Proceedings of the 23rd National Conference on Artificial Intelligence (2008)
Corey, P., Hammond, T.: GLADDER: combining gesture and geometric sketch recognition. In: AAAI 2008 Proceedings of the 23rd National Conference on Artificial Intelligence (2008)
Schwirten, T.: radarTOUCH., http://www.radar-touch.com/
Marquardt, N., Kiemer, J., Greenberg, S.: What caused that touch?: Expressive interaction with a surface through fiduciary-tagged gloves. In: ITS 2010 ACM International Conference on Interactive Tabletops and Surfaces (2010)
Andrew, W.D.: Using a depth camera as a touch sensor. In: ITS 2010 ACM International Conference on Interactive Tabletops and Surface (2010)
Hartmann, B., Morris, M.R., Benko, H., Wilson, D.A.: Augmenting interactive tables with mice & keyboards. In: UIST 2009 Proceedings of the 22nd Annual ACM Symposium on User Interface Software and Technology (2009)
Li, F.-F., Fergus, R., Torralba, A.: Recognizing and Learning Object Categories
Lowe, D.G.: Distinctive Image Features from Scale-Invariant Keypoints. International Journal of Computer Vision 60(2), 91–110 (2004)
Grauman, K., Darrell, T.: The Pyramid Match Kernel: Discriminative Classification with Sets of Image Features. In: ICCV 2005 Proceedings of the Tenth IEEE International Conference on Computer Vision (2005)
Lin, L., Luo, P., Chen, X., Zeng, K.: Representing and recognizing objects with massive local image patches. Pattern Recognition 45(1), 231–240 (2012)
Cortes, C., Vapnik, V.: Support-Vector Networks. Machine Learning 20(3), 273–297 (1995)
Tuddenham, P., Davies, I., Robinson, P.: WebSurface: An interface for co-located collaborative information gathering. In: ITS 2009 Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces (2009)
Klinkhammer, D., Nitsche, M., Specht, M., Reiterer, H.: Adaptive personal territories for co-located tabletop interaction in a museum setting. In: ITS 2011 Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces (2011)
Dippon, A., Echtler, F., Klinker, G.: Multi-touch Table as Conventional Input Device. In: Stephanidis, C. (ed.) Posters, Part II, HCII 2011. CCIS, vol. 174, pp. 237–241. Springer, Heidelberg (2011)
Grauman, K., Darrell, T.: The Pyramid Match Kernel: Efficient Learning with Sets of Features. The Journal of Machine Learning Research 8, 725–760 (2007)
Lazebnik, S., Schmid, C., Ponce, J.: Beyond Bags of Features: Spatial Pyramid Matching for Recognizing Natural Scene Categories. In: CVPR 2006 Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (2006)
Bosch, A., Zisserman, A., Muñoz, X.: Scene classification via pLSA. In: Leonardis, A., Bischof, H., Pinz, A. (eds.) ECCV 2006. LNCS, vol. 3954, pp. 517–530. Springer, Heidelberg (2006)
Morris, M.R., Lombardo, J., Wigdor, D.: WeSearch: Supporting collaborative search and sensemaking on a tabletop display. In: CSCW 2010 Proceedings of the 2010 ACM Conference on Computer Supported Cooperative Work (2010)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this paper
Cite this paper
Truong, C.T., Nguyen-Huynh, DH., Tran, MT. (2014). How Do We Teach Young Children New Concepts via Sketching?. In: Streitz, N., Markopoulos, P. (eds) Distributed, Ambient, and Pervasive Interactions. DAPI 2014. Lecture Notes in Computer Science, vol 8530. Springer, Cham. https://doi.org/10.1007/978-3-319-07788-8_28
Download citation
DOI: https://doi.org/10.1007/978-3-319-07788-8_28
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-07787-1
Online ISBN: 978-3-319-07788-8
eBook Packages: Computer ScienceComputer Science (R0)