Skip to main content

Survey Analyser: Effective Processing of Academic Questionnaire Data

  • Conference paper
  • First Online:

Part of the book series: Advances in Intelligent Systems and Computing ((AISC,volume 852))

Abstract

Many universities conduct survey research in order to evaluate and improve quality of their education processes. Surprisingly, replacing traditional paper-based questionnaires with electronic ones usually decreases response rates and thus negatively affects overall reliability of results. In the paper, this issue is addressed and an effective approach to academic surveying is described, including a recommended strategy, matrix-based questionnaire representation, methods and technical framework for data handling. A crucial part of this method is the Survey Analyser – an innovative application, which automates the processing of questionnaire results using information extraction and transformation. The proposed surveying method and the corresponding software were successfully implemented into production environments at two universities, showing good performance based on real-life results.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Notes

  1. 1.

    Response rate is the number of responders, who actually answered a survey, divided by the overall number of authorized participants.

  2. 2.

    Including the reports described in Sect. 2.3.

References

  1. Adams, M.J.D., Umbach, P.D.: Nonresponse and online student evaluations of teaching: understanding the influence of salience, fatigue, and academic environments. Res. High. Educ. 53(5), 576–591 (2012). https://doi.org/10.1007/s11162-011-9240-5

    Article  Google Scholar 

  2. Bienkowska, A.: Teaching Quality Assurance in the Faculty of Computer Science and Management - A Report for the Academic Year 2014–2015. Wroclaw University of Technology, Wroclaw (2016). (in Polish)

    Google Scholar 

  3. Blair, E., Inniss, K.: Student evaluation questionnaires and the developing world: an examination of the move from a hard copy to online modality. Stud. Educ. Eval. 40, 36–42 (2014). https://doi.org/10.1016/j.stueduc.2014.01.001

    Article  Google Scholar 

  4. Bootstrap Core Team: Bootstrap. https://getbootstrap.com

  5. Cano-Hurtado, J.J., Carot-Sierra, J.M., Fernandez-Prada, M.A., Fargueta, F.: An Evaluation Model of the Teaching Activity of Academic Staff. Valencia University of Technology, Valencia (2009)

    Google Scholar 

  6. Ciesielski, P.: Remarks for Students’ Questionnaire Evaluation of Teaching. Jagiellonian University, Krakow (2012). (in Polish)

    Google Scholar 

  7. Cork, D.L., Cohen, M.L., Groves, R., Kalsbeek, W. (eds.): Survey Automation: Report and Workshop Proceedings. The National Academies Press, Washington, DC (2003). https://doi.org/10.17226/10695

    Book  Google Scholar 

  8. Dudek, D.: Automated information extraction and classification of matrix-based questionnaire data. In: Swiatek, J., Tomczak, J.M. (eds.) Advances in Systems Science, Proceedings of the International Conference on Systems Science 2016 (ICSS 2016), Advances in Intelligent Systems and Computing, vol. 539, pp. 109–120. Springer, Heidelberg (2017). https://doi.org/10.1007/978-3-319-48944-5_11

  9. Hazel, P.: PCRE – Perl Compatib. Regular Expressions (2018). http://www.pcre.org

  10. Inter-University Computerization Center: USOS – University Study-Oriented System (2018). http://muci.edu.pl. (in Polish)

  11. Izdebski, A., et al.: Report of the all-university teaching quality assessment survey. University of Warsaw, Poland (2015). (in Polish)

    Google Scholar 

  12. Kirchner, A., Norman, A.D.: Evaluation of electronic assessment systems within the USA and their ability to meet the National Council for Accreditation of Teacher Education (NCATE) Standard 2. Educ. Assess. Eval. Acc. 26(4), 393–407 (2014). https://doi.org/10.1007/s11092-014-9204-3

    Article  Google Scholar 

  13. Leung, D.Y.P., Kember, D.: Comparability of data gathered from evaluation questionnaires on paper and through the internet. Res. High. Educ. 46(5), 571–591 (2005)

    Article  Google Scholar 

  14. Mistry, R., Misner, S.: Introducing Microsoft SQL Server 2014: Technical Overview. Microsoft Press, Redmond (2014)

    Google Scholar 

  15. Moreno-Murcia, J.A., Torregrosa, Y.S., Pedreno, N.B.: Questionnaire evaluating teaching competencies in the university environment. Evaluation of teaching competencies in the university. New Approaches Educ. Res. 4(1), 54–61 (2015). https://doi.org/10.7821/naer.2015.1.106

    Article  Google Scholar 

  16. Nikolaidis, Y., Dimitriadis, S.G.: On the student evaluation of university courses and faculty members’ teaching performance. Eur. J. Oper. Res. 238, 199–207 (2014). https://doi.org/10.1016/j.ejor.2014.03.018

    Article  MathSciNet  MATH  Google Scholar 

  17. Nulty, D.D.: The adequacy of response rates to online and paper surveys: what can be done? Assess. Eval. High. Educ. 33(3), 301–314 (2008)

    Article  Google Scholar 

  18. Przybylski, W., Rudnicki, S., Szwed, A. (eds.): Evaluating Teaching Quality in Higher Education - Methods, Tools, Best Practice. Tischner European University, Krakow (2010). (in Polish)

    Google Scholar 

  19. Schmitz, C.: LimeSurvey: An Open Source Survey Tool. LimeSurvey Project Team, Hamburg, Germany (2018). https://www.limesurvey.org

  20. Stein, S.J., Spiller, D., Terry, S., Harris, T., Deaker, L., Kennedy, J.: Tertiary teachers and student evaluations: never the twain shall meet? Assess. Eval. High. Educ. (2013). https://doi.org/10.1080/02602938.2013.767876

  21. Stupans, I., McGuren, T., Babey, A.M.: Student evaluation of teaching: a study exploring student rating instrument free-form text comments. Innovative High. Educ. 41(1), 33–42 (2016). https://doi.org/10.1007/s10755-015-9328-5

    Article  Google Scholar 

  22. Szaban, D., Kolodziej, T.: Report of academic teachers assessment 2016/2017. University of Zielona Gora, Poland (2017). (in Polish)

    Google Scholar 

  23. Tarasiuk, J.: Survey research in AGH - the system and sample results. The Fourth All-Poland Meeting of the Rectors’ Proxies for Education Quality, Wroclaw, Poland (2017). (in Polish)

    Google Scholar 

  24. The jQuery Foundation: jQuery. https://jquery.com

  25. The PHP Group: PHP page. http://php.net

  26. Thielsch, M.T., Brinkmoeller, B., Forthmann, B.: Reasons for responding in student evaluation of teaching. Stud. Educ. Eval. 56, 189–196 (2018). https://doi.org/10.1016/j.stueduc.2017.11.008

    Article  Google Scholar 

  27. UMCS: Report of the evaluation survey of classes in the summer semester 2015–2016. Maria Curie-Sklodowska University, Lublin (2016). (in Polish)

    Google Scholar 

Download references

Acknowledgments

The author wishes to thank the Karkonosze College in Jelenia Góra for sharing the results of survey research, which were presented in this paper.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Damian Dudek .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Dudek, D. (2019). Survey Analyser: Effective Processing of Academic Questionnaire Data. In: Borzemski, L., Świątek, J., Wilimowska, Z. (eds) Information Systems Architecture and Technology: Proceedings of 39th International Conference on Information Systems Architecture and Technology – ISAT 2018. ISAT 2018. Advances in Intelligent Systems and Computing, vol 852. Springer, Cham. https://doi.org/10.1007/978-3-319-99981-4_23

Download citation

Publish with us

Policies and ethics