Abstract
Teaching and Supervision Evaluation System (TESES), is a system to evaluate the quality of teaching and supervision from students’ perspective. It is an official student feedback system used to evaluate efficiency and effectiveness of the Quality Management System (QMS) MS ISO 9001:2008 for management of undergraduate and graduate studies. In addition, the input obtained from the students will be used to continually improve and enhance the quality of teaching and learning at Universiti Kebangsaan Malaysia. Although the feedback from the system can contribute to improving the quality of the programs but the usability issues in terms of effectiveness and efficiency of the system design along with the reliability of the inputs and feedbacks from the students are disputable. Subsequently, these issues are studied in order to improve the system. This study use a triangulation method which is an integration of the three techniques; namely survey, observation through eye tracking technique and interviews, carried out on a sample consists of 30 students from the Faculty of Information Science and Technology. The visual interaction patterns, usability problems and the reliability level of student feedback are identified at the end of the study.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Hussein, A.: The use of Triangulation in Social Sciences Research: can qualitative and quantitative methods be combined? Journal of Comparative Social Work 2009(1) (2009)
Jaafar, A., Abdullah, S., Latif, A.A., Paraidathathu, T., Ahmad, W.N.W., Abdullah, N., Daud, S., Salima, J., Lee, C.S.: Reliability of student feedback on the course teaching evaluation system (CTES) and system usability. Procedia Social and Behavioral Sciences 18(2011), 24–32 (2010)
Mohamed, A.O., Da Silva, M.P., Courboulay, V.: A history of eye gaze tracking (2007)
Andrews, D.H., Goodson, L.A.: A comparative analysis of model of instructional design. Journal of Instructional Development 3(4), 2–16 (1980)
ACM SIGCHI Curricula for Human-Computer Interaction, http://www.acm.org/sigchi/cdg/cdg3.html (November 23, 2012)
Emam, A., Youssef, A.E.: Do Females Read Faster than Males? An Empirical Study Using Eye Tracking Systems (2012)
Byrne, M.D., Anderson, J.R., Douglass, S., Matessa, M.: Eye Tracking the Visual Search of Click-Down Menus. In: Human Factors In Computing Systems CHI 1999 Conference Proceedings, pp. 402–409 (1999)
Bevan, N.: Human-Computer Interaction Standards. In: Anzai, Y., Ogawa (eds.) Proceedings of the 6th International Conference on Human Computer Interaction. Elsevier, United Kingdom (1995)
Bednarik, R.: Methods to Analyze Visual Attention Strategies: Applications in the Studies of Programming (2007)
Duchowski, A.T.: Eye Tracking Methodology. Theory and Practice (2007)
Eivazi, S., Bednarik, R.: Predicting Problem-Solving Behavior and Performance Levels from Visual Attention Data. In: 2nd Workshop on Eye Gaze in Intelligent Human Machine Interaction, pp. 9–16 (2011)
Zenga, F., Hub, Z., Chenb, R., Yang, Z.: Determinants of online service satisfaction and their impacts on behavioural intentions. Total Quality Management 20(9), 953–969 (2009)
Gommans, M., Krishnan, K.S., Scheffold, K.B.: From Brand Loyalty to E-Loyalty: A Conceptual Framework. Journal of Economic and Social Research 3(1), 43–58 (2001)
Holmqvist, K., Nystrom, M., Andersson, R., Dewhurst, R., Jarodzka, H., Weijer, J.V.D.: Eye Tracking: A Comprehensive Guide to Methods and Measures, New York (2011)
Jeng, J.: Usability Assessment of Academic Digital Libraries: Effectiveness, Efficiency, Satisfaction, and Learnability. Libri 55, 96–121 (2005)
Just, M.A., Carpenter, P.A.: A Theory of Reading: From Eye Fixations to Comprehension (1980)
Just, M.A., Carpenter, P.A.: Eye Fixations and Cognitive Processes. Cognitive Psychology 8, 441–480 (1979)
Kuutti, K.: HCI and design: uncomfortable bedfellows (Re)searching the Digital Bauhaus, 43–59 (2009)
Shahzad, M.I., Mehmood, S.: Control of Articulated Robot Arm by Eye Tracking, Sweden (2010)
Macdonald, N.: what is web design? Switzerland (2003)
Omar, M.H.: Proses Pengajaran-Pembelajaran dimantapkan Menerusi Penggabungan SPK Prasiswazah dan Siswazah. Buletin Pembangunan Akademik Bil Julai – Dis. 1.24 (2009)
Mansour, J.K., Flowe, H.D.: Eye tracking and Eyewitness Memory (2010)
Mansour, J.K., Flowe, H.D.: Eye tracking and eyewitness memory. Forensic Update 101 – Autumn, 11-15 (2010)
Neilsen, J., Pernice, K.: Eye Tracking Web Usability, USA (2010)
Poole, A., Ball, L.J.: Eye tracking in HCI and usability research, United Kingdom (2006)
Poole, A., Ball, L.J.: Eye Tracking in Human-Computer Interaction and Usability Research: Current Status and Future Prospects, United Kingdom (2005)
Melayu, P.R.P.: http://prpm.dbp.gov.my/Search.aspx?k=reading
Review and Analysis of Human Computer Interaction (HCI) Principles 1-13, http://arxiv.org/ftp/arxiv/papers/0707/0707.3638.pdf
Radach, R., Hyona, J., Deube, J.: The Mind’s Eye: Cognitive and Applied Aspects of Eye Movement Research, Holland (2003)
Rayner, K.: Eye Movements in Reading and Information Processing: 20 Years of Research. Psychological Bulletin 1998 124(3), 372–422 (1998)
Sensomotoric Instrument. Experiment Center 2 Manual Version 2.1, Germany (2008)
Sensomotoric Instrument. 2008. BeGaze 2 Manual. Version 2.2, Germany (2008)
Sensomotoric Instrument. 2008. I View X System Manual. Version 2.2, Germany (2008)
Szymanski, D.M., Hise, R.T.: E-satisfaction: An initial examination. Journal of Retailing 76(3), 309–322 (2000)
Salvucci, D.D., Goldberg, J.H.: Identifying fixations and saccades in eye-tracking protocols. In: Proceedings of the Eye Tracking Research and Applications Symposium, pp. 71–78 (2000)
Salvucci, D.D.: An Interactive Model-Based Environment for Eye-Movement Protocol Analysis and Visualization. In: Eye Tracking Research & Applications Symposium, pp. 57–63 (2000)
Shelly, G.B., Nappier, H.A., Rivers, O.N.: Web Design: Introductory Concepts and Techniques, USA (2008)
Sistem Penilaian Pengajaran dan Penyeliaan, https://smp.ukm.my/sppk/
Yeasmin, S., Rahman, K.F.: Triangulation’ Research Method as the Tool of Social Science Research. Bup Journal 1(1) (September 2012) ISSN: 2219-4851
Usability of Interactive Products, http://www2.uiah.fi/projekti/metodi/158.htm
Usability Testing: Developing Useful and Usable Products, http://www.units.muohio.edu/mtsc/usabilitytestingrevisedFINAL.pdf
Usability.gov, http://www.usability.gov/how-to-and-tools/methods/usability-testing.html
Wang, Y.D., Emurian, H.H.: An overview of online trust: Concepts, elements, and implications. Computers in Human Behavior 21(1), 105–125 (2005)
Wedel, M., Pieters, R.: Eye Tracking For Visual Marketing, USA (2006)
Zambarbieri, D., Carniglia, E., Robino, C.: Eye Tracking Analysis in Reading Online Newspapers. Journal of Eye Movement Research 2(4):7, 1–8 (2008)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer International Publishing Switzerland
About this paper
Cite this paper
Bakar, U., Jaafar, A. (2013). Visual Interaction Patterns of Students’ Feedback: Reliability and Usability of Teaching and Supervision Evaluation System (TESES). In: Zaman, H.B., Robinson, P., Olivier, P., Shih, T.K., Velastin, S. (eds) Advances in Visual Informatics. IVIC 2013. Lecture Notes in Computer Science, vol 8237. Springer, Cham. https://doi.org/10.1007/978-3-319-02958-0_70
Download citation
DOI: https://doi.org/10.1007/978-3-319-02958-0_70
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-02957-3
Online ISBN: 978-3-319-02958-0
eBook Packages: Computer ScienceComputer Science (R0)