Skip to main content
SpringerLink
Log in

The Usability of Multiple Devices for Assessment in Psychological Research: Salience of Reasons Underlying Usability

  • Conference paper
  • First Online:
Methodologies and Intelligent Systems for Technology Enhanced Learning, 8th International Conference (MIS4TEL 2018)

Part of the book series: Advances in Intelligent Systems and Computing ((AISC,volume 804))

Abstract

Focusing on an online survey in psychological research, we evaluated the usability of the device chosen to complete the survey and examined underlying reasons through a usability enquiry method. The participants were 149 undergraduate students who completed a questionnaire for assessing achievement emotions and motivation, with open-ended and closed-ended questions. They also evaluated the usability of the device chosen to complete the survey and reported underlying reasons. We analyzed the data with Generalized Linear Mixed Models. The devices chosen to complete the survey were perceived as highly usable, even if usability was lower for smartphones compared to other devices such as personal computers, notebooks, and tablets. The most relevant reasons regarded characteristics of the tools, followed by those of the tasks and then of users and environments. The findings are discussed taking into account their theoretical and applied relevance for monitoring and improving online psychological assessment.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Bates, D., Mächler, M., Bolker, B., Walker, S.: Fitting linear mixed-effects models using lme4. J. Stat. Softw. 67(1), 1–48 (2015). https://doi.org/10.18637/jss.v067.i01

    Article  Google Scholar 

  2. Bianchi, I., Savardi, U., Burro, R., Martelli, M.F.: Doing the opposite to what another person is doing. Acta Psychologica 151, 117–133 (2014). https://doi.org/10.1016/j.actpsy.2014.06.003

    Article  Google Scholar 

  3. Branchini, E., Burro, R., Bianchi, I., Savardi, U.: Contraries as an effective strategy in geometrical problem solving. Think. Reason. 21(4), 397–430 (2015). https://doi.org/10.1080/13546783.2014.994035

    Article  Google Scholar 

  4. Brondino, M., Raccanello, D., Pasini M.: Achievement goals as antecedents of achievement emotions: the 3 X 2 achievement goal model as a framework for learning environments design. In: Advances in Intelligent and Soft Computing, vol. 292, pp. 53–60. https://doi.org/10.1007/978-3-319-07698-0

    Google Scholar 

  5. Burro, R., Raccanello, D., Pasini, M., Brondino, M.: An estimation of a nonlinear dynamic process using Latent Class extended Mixed Models. Affect profiles after terrorist attacks. Nonlinear Dyn. Psychol. Life Sci. 22(1), 35–52 (2018)

    Google Scholar 

  6. Dombrowsky, U., Wagner, T.: Mental strain as field of action in the 4th industrial revolution. Procedia CIRP 17, 100–105 (2014)

    Article  Google Scholar 

  7. Ham, D.H.: A model-based framework for classifying and diagnosing usability problems. Cogn. Technol. Work 16, 373–388 (2014). https://doi.org/10.1007/s10111-013-0267-6

    Article  Google Scholar 

  8. Iwarsson, S., Stahl, A.: Accessibility, usability and universal design – positioning and definition of concepts describing person-environment relationships. Disabil. Rehabil. 25(2), 57–66 (2003)

    Google Scholar 

  9. Kenward, M.G., Roger, J.H.: An improved approximation to the precision of fixed effects from restricted maximum likelihood. Comput. Stat. Data Anal. 53, 2583–2595 (2009)

    Article  MathSciNet  Google Scholar 

  10. Lenth, R.V.: Least-squares means: the R package lsmeans. J. Stat. Softw. 69(1), 1–33 (2016). https://doi.org/10.18637/jss.v069.i01

    Article  MathSciNet  Google Scholar 

  11. Nolen, S.B.: Young children’s motivation to read and write: development in social contexts. Cogn. Instr. 25(2–3), 219–270 (2007). https://doi.org/10.1080/07370000701301174

    Article  Google Scholar 

  12. Olivier, J., May, W.L., Bell, M.L.: Relative effect sizes for measures of risk. Commun. Stat. Theory Methods, 1–8 (2017). https://doi.org/10.1080/03610926.2015.1134575

    Article  MathSciNet  Google Scholar 

  13. Pasini, M., Brondino, M., Burro, R., Raccanello, D., Gallo, S. (2016). The use of different multiple devices for an ecological assessment in psychological research: an experience with a daily affect assessment. In: Advances in Intelligent and Soft Computing, vol. 478, pp. 121–129. https://doi.org/10.1007/978-3-319-40165-2_13

    Google Scholar 

  14. Raccanello, D.: Students’ expectations about interviewees’ and interviewers’ achievement emotions in job selection interviews. J. Employ. Couns. 52(2), 50–64 (2015). https://doi.org/10.1002/joec.12004

    Article  Google Scholar 

  15. Raccanello, D., Brondino, M., Pasini, M.: Achievement emotions in technology enhanced learning: development and validation of self-report instruments in the Italian context. Interact. Des. Archit. J. IxD&A 23, 68–81 (2014)

    Google Scholar 

  16. Raccanello, D., Brondino, M., Pasini, M.: On-line assessment of pride and shame: relationships with cognitive dimensions in university students. Adv. Intell. Soft Comput. 374, 17–24 (2015). https://doi.org/10.1007/978-3-319-19632-9_3

    Article  Google Scholar 

  17. Raccanello, D., Brondino, M., Pasini, M.: Two neglected moral emotions in university settings: Some preliminary data on pride and shame. J. Beliefs Values Stud. Relig. Educ. 36(2), 231–238 (2015). https://doi.org/10.1080/13617672.2015.1031535

    Article  Google Scholar 

  18. Raccanello, D., Burro, R., Brondino, M., Pasini, M.: Relevance of terrorism for Italian students not directly exposed to it: the affective impact of the 2015 Paris and the 2016 Brussels attacks. Stress and Health 34, 338–343 (2017). https://doi.org/10.1002/smi.2793

    Article  Google Scholar 

  19. Raccanello, D., Burro, R., Brondino, M., Pasini, M.: Use of internet and wellbeing: a mixed-device survey. In: Advances in Intelligent and Soft Computing, vol. 617, pp. 65–73 (2017). https://doi.org/10.1007/978-3-319-60819-8_8

    Google Scholar 

  20. Raccanello, D., Burro, R., Hall, R.: Children’s emotional experience two years after an earthquake: an exploration of knowledge of earthquakes and associated emotions. PLoS ONE 12(2), 1–21 (2017). https://doi.org/10.1371/journal.pone.0189633

    Article  Google Scholar 

  21. Schmitz, C.: LimeSurvey: an open source survey tool. LimeSurvey Project Hamburg, Germany (2015). http://www.limesurvey.org

  22. Shackel, B.: Usability – Context, framework, definition, design and evaluation. Interact. Comput. 21, 339–346 (2009). https://doi.org/10.1016/j.intcom.2009.04.007

    Article  Google Scholar 

  23. Singmann, H., Bolker, B., Westfall, J., Aust, F.: Afex: analysis of factorial experiments (2016). https://CRAN.R-project.org/package=afex

  24. Zhang, Z.: Overview of usability evaluation method (2011). https://www.usabilityhome.com

Download references

Author information

Authors and Affiliations

  1. Department of Human Sciences, University of Verona, Verona, Italy

    Daniela Raccanello, Margherita Brondino, Margherita Pasini, Maria Gabriella Landuzzi, Diego Scarpanti, Giada Vicentini, Mara Massaro & Roberto Burro

Authors
  1. Daniela Raccanello
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Margherita Brondino
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Margherita Pasini
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Maria Gabriella Landuzzi
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Diego Scarpanti
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Giada Vicentini
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Mara Massaro
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Roberto Burro
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Daniela Raccanello .

Editor information

Editors and Affiliations

  1. Department of Information Engineering, Computer Science and Mathematics, University of L’Aquila, L’Aquila, Italy

    Tania Di Mascio

  2. Department of Life, Health and Environmental Sciences, University of L’Aquila, L’Aquila, Italy

    Pierpaolo Vittorini

  3. Computer Science Faculty, Free University of Bozen-Bolzano, Bolzano, Italy

    Rosella Gennari

  4. BISITE Digital Innovation Hub, University of Salamanca, Salamanca, Spain

    Fernando De la Prieta

  5. BISITE Digital Innovation Hub, University of Salamanca, Salamanca, Spain

    Sara Rodríguez

  6. Dipartimento di Ingegneria Informatica, Sapienza Università di Roma, Rome, Italy

    Marco Temperini

  7. Department of Computer Science and Statistics, Federal University of Santa Catarina, Florianópolis, Brazil

    Ricardo Azambuja Silveira

  8. Faculty of Automation Computers and Electronics Computers and Information Technology Department, University of Craiova, Craiova, Romania

    Elvira Popescu

  9. Department of Life, Health and Environmental Sciences, University of L’Aquila, Coppito, Holy See (Vatican City State)

    Loreto Lancia

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Raccanello, D. et al. (2019). The Usability of Multiple Devices for Assessment in Psychological Research: Salience of Reasons Underlying Usability. In: Di Mascio, T., et al. Methodologies and Intelligent Systems for Technology Enhanced Learning, 8th International Conference. MIS4TEL 2018. Advances in Intelligent Systems and Computing, vol 804. Springer, Cham. https://doi.org/10.1007/978-3-319-98872-6_10

Download citation

Publish with us

Policies and ethics

Search

Navigation