Skip to main content

Machine Interpretation of Students’ Hand-Drawn Mathematical Representations

  • Chapter
  • First Online:

Part of the book series: Human–Computer Interaction Series ((HCIS))

Abstract

The INK-12: Interactive Ink Inscriptions in K-12 project is investigating the use of a pen- based wireless classroom interaction system in upper elementary math and science classrooms. This chapter reports on the progress made on the machine interpretation of students’ drawings created using that system in learning multiplication and division. The problem addressed is that of finding the balance between freehand drawing and structured drawing, e.g., with pre-defined machine-readable icons. The innovation reported is what we call a stamp, which enables students to draw an image, then duplicate the image to create a mathematical representation, e.g., four groups of six. The stamp contains a hand-drawn image, but also creates a structured vocabulary that a machine can interpret. The resulting interpretation can be used to sort and group student work in order to help teachers in identifying students who need assistance and in choosing pedagogically interesting examples for class discussion.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
USD   54.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Carruthers, E., & Worthington, M. (2006). Children’s mathematics: Making marks, making meaning. London: Sage Publications.

    Google Scholar 

  2. Design-Based Research Collective. (2003). Design-based research: An emerging paradigm for educational inquiry. Educational Researcher, 32(1), 5–8.

    Article  Google Scholar 

  3. Koile, K., Reider, D., & Rubin, A. (2010). INK-12: a pen-based wireless classroom interaction system for K-12. In R. Reed & D. Berque (Eds.), The impact of tablet pcs and pen-based technology on education: Evidence and outcomes. West Lafayette: Purdue University Press.

    Google Scholar 

  4. Koile, K., & Rubin, A. (2013). Machine interpretation of students' hand-drawn mathematical representations. In Proceedings of WIPTTE.

    Google Scholar 

  5. Smith, S. P. (2003). Representation in school mathematics: Children’s representations of problems. In J. Kilpatrick, W. G. Martin, & D. Schifter (Eds.), A research companion to principles and standards for school mathematics (pp. 263–274). Reston: National Council of Teachers of Mathematics.

    Google Scholar 

  6. Woleck, K. R. (2001). Listen to their pictures: An investigation of children’s mathematical drawings. In A. Cuoco (Ed.), The roles of representation in school mathematics (pp. 215–227). Reston: National Council of Teachers of Mathematics.

    Google Scholar 

Download references

Acknowledgments

This research is funded by NSF DRK-12 collaborative awards DRL-1020152 (Koile), DRL-1019841 (Rubin); many thanks to program officers Michael Haney and Robert Gibbs for their support. The PIs gratefully acknowledge the contributions from the MIT CLP research group: Steve Diles, Claire DeRosa, Eryn Maynard, Jessie Mueller, Kelsey Von Tish; Lily Ko and Judy Storeygard at TERC; Katie Sawrey at Tufts; and David Reider at Education Design, Inc.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Kimberle Koile .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2015 Springer International Publishing Switzerland

About this chapter

Cite this chapter

Koile, K., Rubin, A. (2015). Machine Interpretation of Students’ Hand-Drawn Mathematical Representations. In: Hammond, T., Valentine, S., Adler, A., Payton, M. (eds) The Impact of Pen and Touch Technology on Education. Human–Computer Interaction Series. Springer, Cham. https://doi.org/10.1007/978-3-319-15594-4_5

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-15594-4_5

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-15593-7

  • Online ISBN: 978-3-319-15594-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics