Skip to main content

A New Conceptual Framework for Measuring Online Listening in Asynchronous Discussion Forums

  • Chapter
  • First Online:
Artificial Intelligence Supported Educational Technologies

Part of the book series: Advances in Analytics for Learning and Teaching ((AALT))

Abstract

Learner interactions are the key to understanding how learning occurs in asynchronous discussion forums. Most of the existing studies, however, only pay attention to the visible aspect of interaction (online speaking, i.e., creating posts); little is known about online listening, the invisible one that refers to viewing existing posts. Online listening, often used interchangeably with reading and lurking, is an active, personally driven, and inseparable component in the participation of online discussions. Its main measurement method is objective one based on log-file data, which can be subdivided into individual- and social perspectives-oriented. Two key problems that occur are the lack of concern for the quality of online listening and the unavailability of temporal information in most existing forums. To address these gaps, this chapter presents a conceptual framework from theoretical perspective that aims to comprehensively measure learners’ online listening in asynchronous discussion forums. In order to understand the invisible aspect of learner interactions, the proposed framework first develops a semantic network-based discussions grounded on assimilation theory of meaningful learning. Then a combination of extracted analytics, SNA, and content analysis is proposed to comprehensively analyze online listening from individual, social, and cognitive perspectives. We believe that this proposed framework will contribute to an in-depth insight into learner interactions in online discussions.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 139.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 179.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 179.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  • Almatrafi, O., & Johri, A. (2018). Systematic review of discussion forums in massive open online courses (MOOCs). IEEE Transactions on Learning Technologies, 12(3), 413–428.

    Article  Google Scholar 

  • Ausubel, D. P., Novak, J. D., & Hanesian, H. (1968). Educational psychology: A cognitive view. New York: Holt, Rinehart and Winston.

    Google Scholar 

  • Beaudoin, M. F. (2002). Learning or lurking? Tracking the “invisible” online student. The Internet and Higher Education, 5(2), 147–155.

    Article  Google Scholar 

  • Belcher, A., Hall, B. M., Kelley, K., & Pressey, K. L. (2015). An analysis of faculty promotion of critical thinking and peer interaction within threaded discussions. Online Learning, 19(4), 1–10.

    Article  Google Scholar 

  • Bodie, G. D., Worthington, D., Imhof, M., & Cooper, L. O. (2008). What would a unified field of listening look like? A proposal linking past perspectives and future endeavors. The International. Journal of Listening, 22(2), 103–122.

    Article  Google Scholar 

  • Brett, C., & Wilton, L. (2013, April). Online reading patterns and their relationship to online writing activity. In annual meeting of the American Educational Research Association, San Francisco, CA, USA.

    Google Scholar 

  • Brooks, C., Greer, J., & Gutwin, C. (2014). The data-assisted approach to building intelligent technology-enhanced learning environments. In Learning analytics (pp. 123–156). New York: Springer.

    Chapter  Google Scholar 

  • Burleson, B. R. (2011). A constructivist approach to listening. The International Journal of Listening, 25(1–2), 27–46.

    Article  Google Scholar 

  • Caspi, A., Chajut, E., Saporta, K., & Beyth-Marom, R. (2006). The influence of personality on social participation in learning environments. Learning and Individual Differences, 16(2), 129–144.

    Article  Google Scholar 

  • Chiu, K. F. T., & Hew, K. F. T. (2018). Factors influencing peer learning and performance in MOOC asynchronous online discussion forum. Australasian Journal of Educational Technology, 34(4), 16–28.

    Article  Google Scholar 

  • Coates, D., & Humphreys, B. R. (2001). Evaluation of computer-assisted instruction in principles of economics. Educational Technology & Society, 4(2), 133–144.

    Google Scholar 

  • Dado, M., & Bodemer, D. (2017). A review of methodological applications of social network analysis in computer-supported collaborative learning. Educational Research Review, 22, 159–180.

    Article  Google Scholar 

  • Damşa, C. I. (2014). The multi-layered nature of small-group learning: Productive interactions in object-oriented collaboration. International Journal of Computer-Supported Collaborative Learning, 9(3), 247–281.

    Article  Google Scholar 

  • De Wever, B., Schellens, T., Valcke, M., & Van Keer, H. (2006). Content analysis schemes to analyze transcripts of online asynchronous discussion groups: A review. Computers & Education, 46(1), 6–28.

    Article  Google Scholar 

  • Dennen, V. P. (2008). Pedagogical lurking: Student engagement in non-posting discussion behavior. Computers in Human Behavior, 24(4), 1624–1633.

    Article  Google Scholar 

  • Fritsch, H. (1997). Host contacted, waiting for reply. Retrieved from https://files.eric.ed.gov/fulltext/ED407603.pdf

  • Garrison, D. R., Anderson, T., & Archer, W. (2001). Critical thinking, cognitive presence, and computer conferencing in distance education. American Journal of Distance Education, 15(1), 7–23.

    Article  Google Scholar 

  • Garrison, J. (1996). A Deweyan theory of democratic listening. Educational Theory, 46(4), 429–451.

    Article  Google Scholar 

  • Gunawardena, C. N., Lowe, C. A., & Anderson, T. (1997). Analysis of a global online debate and the development of an interaction analysis model for examining social construction of knowledge in computer conferencing. Journal of Educational Computing Research, 17(4), 397–431.

    Article  Google Scholar 

  • Hernández-García, Á., González-González, I., Jiménez-Zarco, A. I., & Chaparro-Peláez, J. (2015). Applying social learning analytics to message boards in online distance learning: A case study. Computers in Human Behavior, 47, 68–80.

    Article  Google Scholar 

  • Hewitt, J., Brett, C., & Peters, V. (2007). Scan rate: A new metric for the analysis of reading behaviors in asynchronous computer conferencing environments. American Journal of Distance Education, 21(4), 215–231.

    Article  Google Scholar 

  • Hodson, D., & Hodson, J. (1998). From constructivism to social constructivism: A Vygotskian perspective on teaching and learning science. School Science Review, 79(289), 33–41.

    Google Scholar 

  • Jan, S. K., Vlachopoulos, P., & Parsell, M. (2019). Social network analysis and online learning communities in higher education: A systematic literature review. Online Learning, 23(1), 249–264.

    Google Scholar 

  • Kang, L., Liu, Z., Su, Z., Li, Q., & Liu, S. (2018, December). Analyzing the relationship among learners’ social characteristics, sentiments in a course forum and learning outcomes. In 2018 seventh international conference of educational innovation through technology (EITT) (pp. 210–213). Auckland, New Zealand: IEEE.

    Google Scholar 

  • Kim, M. K., & Ketenci, T. (2019). Learner participation profiles in an asynchronous online collaboration context. The Internet and Higher Education, 41, 62–76.

    Article  Google Scholar 

  • Kovanović, V., Joksimović, S., Waters, Z., Gašević, D., Kitto, K., Hatala, M., et al. (2016, April). Towards automated content analysis of discussion transcripts: A cognitive presence case. In Proceedings of the sixth international conference on learning analytics & knowledge (pp. 15–24). New York, NY, USA: ACM.

    Google Scholar 

  • Liu, S., Chai, H., Liu, Z., Pinkwart, N., Han, X., & Hu, T. (2019, May). Effects of proactive personality and social centrality on learning performance in SPOCs. In Proceedings of the 11th international conference on computer supported education (pp. 481–487). Crete, Greece: Heraklion.

    Chapter  Google Scholar 

  • Liu, Z., Kang, L., Domanska, M., Liu, S., Sun, J., & Fang, C. (2018). Social network characteristics of learners in a course forum and their relationship to learning outcomes. In Proceedings of the 10th international conference on computer supported education (pp. 15–21). Madeira, Portugal: Funchal.

    Chapter  Google Scholar 

  • Majid, S., Yang, P., Lei, H., & Haoran, G. (2014, November). Knowledge sharing by students: Preference for online discussion board vs face-to-face class participation. In International conference on Asian digital libraries (pp. 149–159). Cham: Springer.

    Google Scholar 

  • Marbouti, F., & Wise, A. F. (2016). Starburst: A new graphical interface to support purposeful attention to others’ posts in online discussions. Educational Technology Research and Development, 64(1), 87–113.

    Article  Google Scholar 

  • Nagel, L., Blignaut, A. S., & Cronjé, J. C. (2009). Read-only participants: A case for student communication in online classes. Interactive Learning Environments, 17(1), 37–51.

    Article  Google Scholar 

  • Nonnecke, B., Preece, J., Andrews, D., & Voutour, R. (2004). Online lurkers tell why. In Bullen, C., Stohr, E. (Eds.). Proceedings of the Tenth American Conference on Information Systems 2004 (pp. 1–7). New York: Association for Information Systems.

    Google Scholar 

  • Novak, J. D. (1990). Concept maps and Vee diagrams: Two metacognitive tools to facilitate meaningful learning. Instructional Science, 19(1), 29–52.

    Article  Google Scholar 

  • Novak, J. D. (1998). Learning, creating and using knowledge: Concept maps as facilitative tools in schools and corporations. Mahwah, NJ: Lawrence Erlbaum Associates.

    Book  Google Scholar 

  • Novak, J. D., Cañas, A. J. (2008). The theory underlying concept maps and how to construct and use them (Technical Report IHMC CmapTools 2006-01 Rev 01-2008). Retrieved from the Florida Institute for Human and Machine Cognition website: http://cmap.ihnc.us/Publications/

  • Peters, V. L., & Hewitt, J. (2010). An investigation of student practices in asynchronous computer conferencing courses. Computers & Education, 54(4), 951–961.

    Article  Google Scholar 

  • Preece, J., Nonnecke, B., & Andrews, D. (2004). The top five reasons for lurking: Improving community experiences for everyone. Computers in Human Behavior, 20(2), 201–223.

    Article  Google Scholar 

  • Qiu, M., Hewitt, J., & Brett, C. (2012). Online class size, note reading, note writing and collaborative discourse. International Journal of Computer-Supported Collaborative Learning, 7(3), 423–442.

    Article  Google Scholar 

  • Rafaeli, S., & Kent, C. (2015). Network-structured discussions for collaborative concept mapping and peer learning. IBM Journal of Research and Development, 59(6), 1–7.

    Article  Google Scholar 

  • Rafaeli, S., Ravid, G., & Soroka, V. (2004, January). De-lurking in virtual communities: A social communication network approach to measuring the effects of social and cultural capital. In Proceedings of the 37th Annual Hawaii International Conference on System Sciences (pp. 10–19). Big Island, Havaii: IEEE.

    Google Scholar 

  • Rodriguez, M. A. (2014). Content analysis as a method to assess online discussions for learning. SAGE Open, 4(4), 1–13.

    Article  Google Scholar 

  • Scardamalia, M., & Bereiter, C. (2006). Knowledge building: Theory, pedagogy, and technology. In R. K. Sawyer (Ed.), Cambridge handbook of the learning sciences. (pp. 97–118). New York, NY: Cambridge University Press.

    Google Scholar 

  • Sutton, L. A. (2001). The principle of vicarious interaction in computer-mediated communications. International Journal of Educational Telecommunications, 7(3), 223–242.

    Google Scholar 

  • Thomas, M. J. W. (2002). Learning within incoherent structures: The space of online discussion forums. Journal of Computer Assisted Learning, 18(3), 351–366.

    Article  Google Scholar 

  • Van Boxtel, C., Van der Linden, J., & Kanselaar, G. (2000). Collaborative learning tasks and the elaboration of conceptual knowledge. Learning and Instruction, 10(4), 311–330.

    Article  Google Scholar 

  • Wang, Z., Anderson, T., Chen, L., & Barbera, E. (2017). Interaction pattern analysis in cMOOCs based on the connectivist interaction and engagement framework. British Journal of Educational Technology, 48(2), 683–699.

    Article  Google Scholar 

  • Wise, A. F., Hausknecht, S. N., & Zhao, Y. (2014). Attending to others’ posts in asynchronous discussions: Learners’ online “listening” and its relationship to speaking. International Journal of Computer-Supported Collaborative Learning, 9(2), 185–209.

    Article  Google Scholar 

  • Wise, A. F., & Hsiao, Y. (2019). Self-regulation in online discussions: Aligning data streams to investigate relationships between speaking, listening, and task conditions. Computers in Human Behavior, 96, 273–284.

    Article  Google Scholar 

  • Wise, A. F., Hsiao, Y. T., Marbouti, F., Speer, J., & Perera, N. (2012, April). Building a taxonomy of ’listening’ behaviors in online discussions: Case studies of high- and low- activity students. Paper presented at the Annual Meeting of the American Educational Research Association, Vancouver, B.C.

    Google Scholar 

  • Wise, A. F., Hsiao, Y. T., Marbouti, F., Speer, J., & Perera, N. (2012). Initial validation of ‘listening’ behavior typologies for online discussions using microanalytic case studies. In J. van Aalst, K. Thompson, M. Jacobson & P. Reimann (Eds.), The future of learning: Proceedings of the 10th International Conference of the Learning Sciences, vol. 1, Full papers (pp. 56–63). Sydney, Australia: ISLS.

    Google Scholar 

  • Wise, A. F., Marbouti, F., Hsiao, Y. T., & Hausknecht, S. (2012). A survey of factors contributing to learners’ “listening” behaviors in asynchronous online discussions. Journal of Educational Computing Research, 47(4), 461–480.

    Article  Google Scholar 

  • Wise, A. F., Marbouti, F., Speer, J., & Hsiao, Y. T. (2011). Towards an understanding of ‘listening’ in online discussions: A cluster analysis of learners’ interaction patterns. In H. Spada, G. Stahl, N. Miyake, & N. Law (Eds.), Proceedings of the international conference on computer-supported collaborative learning (pp. 88–95). Hong Kong, China: International Society of the Learning Sciences.

    Google Scholar 

  • Wise, A. F., Perera, N., Hsiao, Y., Speer, J., & Marbouti, F. (2012). Microanalytic case studies of individual participation patterns in an asynchronous online discussion in an undergraduate blended course. The Internet and Higher Education, 15(2), 108–117.

    Article  Google Scholar 

  • Wise, A. F., Speer, J., Marbouti, F., & Hsiao, Y. (2013). Broadening the notion of participation in online discussions: Examining patterns in learners’ online listening behaviors. Instructional Science, 41(2), 323–343.

    Article  Google Scholar 

  • Wise, A. F., Zhao, Y., & Hausknecht, S. N. (2014). Learning analytics for online discussions: Embedded and extracted approaches. Journal of Learning Analytics, 1(2), 48–71.

    Article  Google Scholar 

  • Wu, D., & Hiltz, S. R. (2004). Predicting learning from asynchronous online discussions. Journal of Asynchronous Learning Networks, 8(2), 139–152.

    Google Scholar 

  • Yang, D., Wen, M., Kumar, A., Xing, E. P., & Rosé, C. P. (2014). Towards an integration of text and graph clustering methods as a lens for studying social interaction in MOOCs. International Review of Research in Open and Distance Learning, 15(5), 214–234.

    Article  Google Scholar 

  • Yücel, Ü. A., & Usluel, Y. K. (2016). Knowledge building and the quantity, content and quality of the interaction and participation of students in an online collaborative learning environment. Computers & Education, 97, 31–48.

    Article  Google Scholar 

Download references

Acknowledgments

This work was supported by the Research Funds from National Natural Science Foundation of China (Grant No. 61977030, 61702207, L1724007), National Key Research and Development Program of China (Grant No. 2017YFB1401303), National Social Science Fund Project of China (Grant No. 14BGL131), and Ministry of Education-China Mobile (Grant No. MCM20160401).

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Chai, H., Liu, Z., Hu, T., Li, Q. (2020). A New Conceptual Framework for Measuring Online Listening in Asynchronous Discussion Forums. In: Pinkwart, N., Liu, S. (eds) Artificial Intelligence Supported Educational Technologies. Advances in Analytics for Learning and Teaching. Springer, Cham. https://doi.org/10.1007/978-3-030-41099-5_4

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-41099-5_4

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-41098-8

  • Online ISBN: 978-3-030-41099-5

  • eBook Packages: EducationEducation (R0)

Publish with us

Policies and ethics