Abstract
We propose a multiple instance learning approach to content-based retrieval of classroom video for the purpose of supporting human assessing the learning environment. The key element of our approach is a mapping between the semantic concepts of the assessment system and features of the video that can be measured using techniques from the fields of computer vision and speech analysis. We report on a formative experiment in content-based video retrieval involving trained experts in the Classroom Assessment Scoring System, a widely used framework for assessment and improvement of learning environments. The results of this experiment suggest that our approach has potential application to productivity enhancement in assessment and to broader retrieval tasks.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Qiao, Q., Beling, P.A.: Localized content based image retrieval with self-taught multiple instance learning. In: Proceedings 2009 IEEE International Conference on Data Mining Workshop, pp. 170–175 (2009)
Uijlings, J.R.R., Smeulders, A.W.M., Scha, R.J.H.: Real-time visual concept classification. IEEE Trans. On Multimedia 12(7), 665–682 (2010)
Fan, J., Luo, H., Elmagarmid, A.K.: Concept-oriented indexing of video databases: Toward semantic sensitive retrieval and browsing. IEEE Transactions On Image Processing 13(7), 974–992 (2004)
Pianta, R.C., La Paro, K.M., Hamre, B.K.: Classroom Assessment Scoring System (CLASS) Manual: K-3. Brookes Publishing (2008)
Pianta, R.C., Belsky, J., Houts, R., Morrison, F.: Opportunities to learn in america’s elementary classrooms. Science 315, 1795–1796 (2007)
Pianta, R.C., Howes, C., Burchinal, M., Bryant, D.M., Clifford, R.M., Early, D.M., Barbarin, O.: Features of pre-kindergarten programs, classrooms, and teachers: Do they predict observed classroom quality and child-teacher interactions? Applied Developmental Science 9(3), 144–159 (2005)
Wang, F., Ngo, C.-W., Pong, T.-C.: Lecture video enhancement and editing by integrating posture, gesture, and text. IEEE Trans. on Multimedia 9(2), 397–409 (2007)
Mahmood, T.S., Srinivasan, S.: Detecting topical events in digital video. In: MULTIMEDIA 2000 Proceedings of the Eighth ACM International Conference on Multimedia, pp. 85–95. ACM, New York (2000)
Ju, S.X., Black, M.J., Minneman, S., Kimber, D.: Summarization of videotaped presentations: Automatic analysis of motion and gesture. IEEE Trans. on Circuits and Systems for Video Technology 8, 686–696 (1998)
Thomas, G., Dietterich, R.H., Lozano-Përez, T.: Solving the multiple instance problem with axis-parallel rectangles. Artificial Intelligence 1446, 1–8 (1998)
Andrews, S., Tsochantaridis, I., Hofmann, T.: Support vector machines for multiple-instance learning. Advances in Neural Information Processing System 15, 561–568 (2003)
Rahmani, R., Goldman, S.A., Zhang, H., Cholleti, S.R., Fritts, J.E.: Localized content based image retrieval. IEEE Trans. on Pattern Analysis and Machine Intelligence (2008)
Fleiss, J.L.: Measuring Nominal Scale Agreement Among Many Raters. Psychological Bulletin 76(5), 378–382 (1971)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Qiao, Q., Beling, P.A. (2011). Classroom Video Assessment and Retrieval via Multiple Instance Learning. In: Biswas, G., Bull, S., Kay, J., Mitrovic, A. (eds) Artificial Intelligence in Education. AIED 2011. Lecture Notes in Computer Science(), vol 6738. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-21869-9_36
Download citation
DOI: https://doi.org/10.1007/978-3-642-21869-9_36
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-21868-2
Online ISBN: 978-3-642-21869-9
eBook Packages: Computer ScienceComputer Science (R0)