Skip to main content

Visual Interaction Patterns of Students’ Feedback: Reliability and Usability of Teaching and Supervision Evaluation System (TESES)

  • Conference paper
Advances in Visual Informatics (IVIC 2013)

Part of the book series: Lecture Notes in Computer Science ((LNIP,volume 8237))

Included in the following conference series:

Abstract

Teaching and Supervision Evaluation System (TESES), is a system to evaluate the quality of teaching and supervision from students’ perspective. It is an official student feedback system used to evaluate efficiency and effectiveness of the Quality Management System (QMS) MS ISO 9001:2008 for management of undergraduate and graduate studies. In addition, the input obtained from the students will be used to continually improve and enhance the quality of teaching and learning at Universiti Kebangsaan Malaysia. Although the feedback from the system can contribute to improving the quality of the programs but the usability issues in terms of effectiveness and efficiency of the system design along with the reliability of the inputs and feedbacks from the students are disputable. Subsequently, these issues are studied in order to improve the system. This study use a triangulation method which is an integration of the three techniques; namely survey, observation through eye tracking technique and interviews, carried out on a sample consists of 30 students from the Faculty of Information Science and Technology. The visual interaction patterns, usability problems and the reliability level of student feedback are identified at the end of the study.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Hussein, A.: The use of Triangulation in Social Sciences Research: can qualitative and quantitative methods be combined? Journal of Comparative Social Work 2009(1) (2009)

    Google Scholar 

  2. Jaafar, A., Abdullah, S., Latif, A.A., Paraidathathu, T., Ahmad, W.N.W., Abdullah, N., Daud, S., Salima, J., Lee, C.S.: Reliability of student feedback on the course teaching evaluation system (CTES) and system usability. Procedia Social and Behavioral Sciences 18(2011), 24–32 (2010)

    Google Scholar 

  3. Mohamed, A.O., Da Silva, M.P., Courboulay, V.: A history of eye gaze tracking (2007)

    Google Scholar 

  4. Andrews, D.H., Goodson, L.A.: A comparative analysis of model of instructional design. Journal of Instructional Development 3(4), 2–16 (1980)

    Article  Google Scholar 

  5. ACM SIGCHI Curricula for Human-Computer Interaction, http://www.acm.org/sigchi/cdg/cdg3.html (November 23, 2012)

  6. Emam, A., Youssef, A.E.: Do Females Read Faster than Males? An Empirical Study Using Eye Tracking Systems (2012)

    Google Scholar 

  7. Byrne, M.D., Anderson, J.R., Douglass, S., Matessa, M.: Eye Tracking the Visual Search of Click-Down Menus. In: Human Factors In Computing Systems CHI 1999 Conference Proceedings, pp. 402–409 (1999)

    Google Scholar 

  8. Bevan, N.: Human-Computer Interaction Standards. In: Anzai, Y., Ogawa (eds.) Proceedings of the 6th International Conference on Human Computer Interaction. Elsevier, United Kingdom (1995)

    Google Scholar 

  9. Bednarik, R.: Methods to Analyze Visual Attention Strategies: Applications in the Studies of Programming (2007)

    Google Scholar 

  10. Duchowski, A.T.: Eye Tracking Methodology. Theory and Practice (2007)

    Google Scholar 

  11. Eivazi, S., Bednarik, R.: Predicting Problem-Solving Behavior and Performance Levels from Visual Attention Data. In: 2nd Workshop on Eye Gaze in Intelligent Human Machine Interaction, pp. 9–16 (2011)

    Google Scholar 

  12. Zenga, F., Hub, Z., Chenb, R., Yang, Z.: Determinants of online service satisfaction and their impacts on behavioural intentions. Total Quality Management 20(9), 953–969 (2009)

    Article  Google Scholar 

  13. Gommans, M., Krishnan, K.S., Scheffold, K.B.: From Brand Loyalty to E-Loyalty: A Conceptual Framework. Journal of Economic and Social Research 3(1), 43–58 (2001)

    Google Scholar 

  14. Holmqvist, K., Nystrom, M., Andersson, R., Dewhurst, R., Jarodzka, H., Weijer, J.V.D.: Eye Tracking: A Comprehensive Guide to Methods and Measures, New York (2011)

    Google Scholar 

  15. Jeng, J.: Usability Assessment of Academic Digital Libraries: Effectiveness, Efficiency, Satisfaction, and Learnability. Libri 55, 96–121 (2005)

    Article  Google Scholar 

  16. Just, M.A., Carpenter, P.A.: A Theory of Reading: From Eye Fixations to Comprehension (1980)

    Google Scholar 

  17. Just, M.A., Carpenter, P.A.: Eye Fixations and Cognitive Processes. Cognitive Psychology 8, 441–480 (1979)

    Article  Google Scholar 

  18. Kuutti, K.: HCI and design: uncomfortable bedfellows (Re)searching the Digital Bauhaus, 43–59 (2009)

    Google Scholar 

  19. Shahzad, M.I., Mehmood, S.: Control of Articulated Robot Arm by Eye Tracking, Sweden (2010)

    Google Scholar 

  20. Macdonald, N.: what is web design? Switzerland (2003)

    Google Scholar 

  21. Omar, M.H.: Proses Pengajaran-Pembelajaran dimantapkan Menerusi Penggabungan SPK Prasiswazah dan Siswazah. Buletin Pembangunan Akademik Bil Julai – Dis. 1.24 (2009)

    Google Scholar 

  22. Mansour, J.K., Flowe, H.D.: Eye tracking and Eyewitness Memory (2010)

    Google Scholar 

  23. Mansour, J.K., Flowe, H.D.: Eye tracking and eyewitness memory. Forensic Update 101 – Autumn, 11-15 (2010)

    Google Scholar 

  24. Neilsen, J., Pernice, K.: Eye Tracking Web Usability, USA (2010)

    Google Scholar 

  25. Poole, A., Ball, L.J.: Eye tracking in HCI and usability research, United Kingdom (2006)

    Google Scholar 

  26. Poole, A., Ball, L.J.: Eye Tracking in Human-Computer Interaction and Usability Research: Current Status and Future Prospects, United Kingdom (2005)

    Google Scholar 

  27. Melayu, P.R.P.: http://prpm.dbp.gov.my/Search.aspx?k=reading

  28. Review and Analysis of Human Computer Interaction (HCI) Principles 1-13, http://arxiv.org/ftp/arxiv/papers/0707/0707.3638.pdf

  29. Radach, R., Hyona, J., Deube, J.: The Mind’s Eye: Cognitive and Applied Aspects of Eye Movement Research, Holland (2003)

    Google Scholar 

  30. Rayner, K.: Eye Movements in Reading and Information Processing: 20 Years of Research. Psychological Bulletin 1998 124(3), 372–422 (1998)

    Google Scholar 

  31. Sensomotoric Instrument. Experiment Center 2 Manual Version 2.1, Germany (2008)

    Google Scholar 

  32. Sensomotoric Instrument. 2008. BeGaze 2 Manual. Version 2.2, Germany (2008)

    Google Scholar 

  33. Sensomotoric Instrument. 2008. I View X System Manual. Version 2.2, Germany (2008)

    Google Scholar 

  34. Szymanski, D.M., Hise, R.T.: E-satisfaction: An initial examination. Journal of Retailing 76(3), 309–322 (2000)

    Article  Google Scholar 

  35. Salvucci, D.D., Goldberg, J.H.: Identifying fixations and saccades in eye-tracking protocols. In: Proceedings of the Eye Tracking Research and Applications Symposium, pp. 71–78 (2000)

    Google Scholar 

  36. Salvucci, D.D.: An Interactive Model-Based Environment for Eye-Movement Protocol Analysis and Visualization. In: Eye Tracking Research & Applications Symposium, pp. 57–63 (2000)

    Google Scholar 

  37. Shelly, G.B., Nappier, H.A., Rivers, O.N.: Web Design: Introductory Concepts and Techniques, USA (2008)

    Google Scholar 

  38. Sistem Penilaian Pengajaran dan Penyeliaan, https://smp.ukm.my/sppk/

  39. Yeasmin, S., Rahman, K.F.: Triangulation’ Research Method as the Tool of Social Science Research. Bup Journal 1(1) (September 2012) ISSN: 2219-4851

    Google Scholar 

  40. Usability of Interactive Products, http://www2.uiah.fi/projekti/metodi/158.htm

  41. Usability Testing: Developing Useful and Usable Products, http://www.units.muohio.edu/mtsc/usabilitytestingrevisedFINAL.pdf

  42. Usability.gov, http://www.usability.gov/how-to-and-tools/methods/usability-testing.html

  43. Wang, Y.D., Emurian, H.H.: An overview of online trust: Concepts, elements, and implications. Computers in Human Behavior 21(1), 105–125 (2005)

    Article  Google Scholar 

  44. Wedel, M., Pieters, R.: Eye Tracking For Visual Marketing, USA (2006)

    Google Scholar 

  45. Zambarbieri, D., Carniglia, E., Robino, C.: Eye Tracking Analysis in Reading Online Newspapers. Journal of Eye Movement Research 2(4):7, 1–8 (2008)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2013 Springer International Publishing Switzerland

About this paper

Cite this paper

Bakar, U., Jaafar, A. (2013). Visual Interaction Patterns of Students’ Feedback: Reliability and Usability of Teaching and Supervision Evaluation System (TESES). In: Zaman, H.B., Robinson, P., Olivier, P., Shih, T.K., Velastin, S. (eds) Advances in Visual Informatics. IVIC 2013. Lecture Notes in Computer Science, vol 8237. Springer, Cham. https://doi.org/10.1007/978-3-319-02958-0_70

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-02958-0_70

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-02957-3

  • Online ISBN: 978-3-319-02958-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics