Skip to main content

Score Improvement Distribution When Using Sketch Recognition Software (Mechanix) as a Tutor: Assessment of a High School Classroom Pilot

  • Chapter
  • First Online:
Frontiers in Pen and Touch

Part of the book series: Human–Computer Interaction Series ((HCIS))

Abstract

Effectively communicating engineering concepts in high school classrooms is an important goal of many curricula in secondary education since the material can help prepare students for future study in Science, Technology, Engineering, and Math (STEM) fields. However, the material can be challenging. This work describes the deployment of Mechanix to a high school environment with the intent of improving the effectiveness of student practice regarding free body diagrams, vector analysis, and truss problem solving. Mechanix is a globally-available, Internet-connected digital tutor that provides immediate, constructive feedback to the learner while also providing student-level metrics to the instructor. It was made available to students in a STEM-infused classroom as part of Project Lead the Way (PLTW). The focus of this study is to evaluate the progress realized by differing academic levels of students. We used pre- and post-testing to assess progress, which showed an average increase of 1.65 points on a 12 point scale (p < 0. 005). A greater increase was found in the ‘A-level’ high school students while historical, college-level studies suggest significant progress may be realized at all levels versus current tutoring techniques as the students continue to utilize Mechanix.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

eBook
USD 16.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    Presented by Randy Brooks in TCEA 2015 http://www.slideshare.net/RandyBrooks3/tcea-the-next-giant-leapfrom-flipped-to-online.

  2. 2.

    http://www.pearsonschool.com.

  3. 3.

    http://www.bridgecontest.org.

References

  1. Atilola, O., Field, M., McTigue, E., Hammond, T., Linsey, J.: Mechanix: a sketch recognition truss tutoring system. In: ASME 2011 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference, pp. 645–654. American Society of Mechanical Engineers (2011)

    Google Scholar 

  2. Atilola, O., Vides, F., Mctigue, E.M., Linsey, J.S., Hammond, T.A.: Automatic identification of student misconceptions and errors for truss analysis. In: American Society for Engineering Education. American Society for Engineering Education (2012)

    Google Scholar 

  3. Atilola, O., McTigue, E.M., Hammond, T., Linsey, J.: Mechanix: evaluating the effectiveness of a sketch recognition truss tutoring program against other truss programs. In: 120th American Society for Engineering Education Annual Conference & Exposition (ASEE) (2013)

    Google Scholar 

  4. Bergmann, J., Sams, A.: Flip Your Classroom: Reach Every Student in Every Class Every Day. International Society for Technology in Education, Eugene/Arlington (2012)

    Google Scholar 

  5. Bishop, J.L., Verleger, M.A.: The flipped classroom: a survey of the research. In: ASEE National Conference Proceedings, Atlanta (2013)

    Google Scholar 

  6. Christensen, C.M., Horn, M.B., Johnson, C.W.: Disrupting Class: How Disruptive Innovation Will Change the Way the World Learns, vol. 98. McGraw-Hill, New York (2008)

    Google Scholar 

  7. Field, M., Valentine, S., Linsey, J., Hammond, T.: Sketch recognition algorithms for comparing complex and unpredictable shapes. In: IJCAI, vol. 11, pp. 2436–2441 (2011)

    Google Scholar 

  8. Green, M.G., Caldwell, B.W., Helms, M., Linsey, J.S., Hammond, T.A.: Using natural sketch recognition software to provide instant feedback on statics homework (truss free body diagrams): assessment of a classroom pilot. In: 2015 ASEE Annual Conference and Exposition. ASEE Conferences, Seattle (2015). 10.18260/p.25007, https://peer.asee.org/25007

  9. Hammond, T.A.: Ladder: a perceptually-based language to simplify sketch recognition user interface development. Ph.D. thesis, Massachusetts Institute of Technology (2007)

    Google Scholar 

  10. Lee, W., de Silva, R., Peterson, E.J., Calfee, R.C., Stahovich, T.F.: Newton’s pen: a pen-based tutoring system for statics. Comput. Graph. 32(5), 511–524 (2008)

    Article  Google Scholar 

  11. Nelligan, T., Polsley, S., Ray, J., Helms, M., Linsey, J., Hammond, T.: Mechanix: a sketch-based educational interface. In: Proceedings of the 20th International Conference on Intelligent User Interfaces Companion, pp. 53–56. ACM (2015)

    Google Scholar 

  12. Tripp, S.D., Bichelmeyer, B.: Rapid prototyping: an alternative instructional design strategy. Educ. Technol. Res. Dev. 38(1), 31–44 (1990)

    Article  Google Scholar 

  13. Valentine, S., Field, M., Smith, A., Hammond, T.: A shape comparison technique for use in sketch-based tutoring systems. In: Proceedings of the 2011 Intelligent User Interfaces Workshop on Sketch Recognition, IUI 2011, Palo Alto, vol. 11, no. 5 (2011)

    Google Scholar 

  14. Valentine, S., Vides, F., Lucchese, G., Turner, D., Kim, H.H., Li, W., Linsey, J., Hammond, T.: Mechanix: a sketch-based tutoring and grading system for free-body diagrams. AI Mag. 34(1), 55 (2012)

    Article  Google Scholar 

  15. Valentine, S., Vides, F., Lucchese, G., Turner, D., Kim, H.H., Li, W., Linsey, J., Hammond, T.: Mechanix: a sketch-based tutoring system for statics courses. In: IAAI (2012)

    Google Scholar 

  16. Valentine, S., Lara-Garduno, R., Linsey, J., Hammond, T.: Mechanix: a sketch based tutoring system that automatically corrects hand-sketched statics homework. In: Hammond, T., Valentine, S., Adler, A., Payton, M. (eds.) The Impact of Pen and Touch Technology on Education. Springer, New York (2015)

    Google Scholar 

  17. VanLehn, K.: The relative effectiveness of human tutoring, intelligent tutoring systems, and other tutoring systems. Educ. Psychol. 46(4), 197–221 (2011)

    Article  Google Scholar 

  18. Yin, P., Forbus, K.D., Usher, J.M., Sageman, B., Jee, B.D.: Sketch worksheets: a sketch-based educational software system. In: IAAI (2010)

    Google Scholar 

Download references

Acknowledgements

The authors would like to thank the Lovejoy Independent School District, Texas A&M University, and the Sketch Recognition Lab for their unceasing support and assistance throughout this study. This work was supported in part by an NSF RET Supplement on project NSF EEC 1129525.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Randy Brooks .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer International Publishing AG

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Brooks, R., Koh, J.I., Polsley, S., Hammond, T. (2017). Score Improvement Distribution When Using Sketch Recognition Software (Mechanix) as a Tutor: Assessment of a High School Classroom Pilot. In: Hammond, T., Adler, A., Prasad, M. (eds) Frontiers in Pen and Touch. Human–Computer Interaction Series. Springer, Cham. https://doi.org/10.1007/978-3-319-64239-0_9

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-64239-0_9

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-64238-3

  • Online ISBN: 978-3-319-64239-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics