Abstract
Public organizations have invested heavily in information technology (IT) and have created internal specialized IT services departments which must be managed from the perspective of the provision of services. The people involved in these organizations can be grouped by demographic characteristics such as gender, age and level of formal education. Thus, the study has two objectives. The first is to test, in the context of the public sector, the validity of the ISS-QUAL, a new scale developed to measure the IT service quality provided by internal IT departments. The second objective is to analyze the role of the variables of gender, age and the level of education of public servants on the perception of IT service quality provided by internal departments. For this purpose, we used structural equation modeling to perform a confirmatory factorial analysis with a sample of 879 IT users, as well as to identify the role of gender, age and level of users’ formal education on perceived service quality. The results confirm the validity and the high explanatory power of the ISS-QUAL within the scope of public organizations, and indicate that the demographic characteristics of public servants differentially affect service quality factors. The study presents the implications of the results for researchers in the field and for managers of internal IT departments in the public sector.
Similar content being viewed by others
References
Agarwal R, Prasad J (1999) Are individual differences germane to the acceptance of new information technologies? Decis Sci 30(2):361–391
Al-Hawari M, Ward T (2006) The effect of automated service quality on Australian banks’ financial performance and the mediating role of customer satisfaction. Mark Intell Plan 24(2):127–147
Al-Hawari M, Hartley N, Ward T (2005) Measuring banks’ automated service quality: a confirmatory factor analysis approach. Mark Bull 16(1):1–19
Anderson JC, Gerbing DW (1988) Structural equation modeling in practice: a review and recommended two-step approach. Psychol Bull 103(3):411
Baarspul HC, Wilderom CP (2011) Do employees behave differently in public-vs private-sector organizations? A state-of-the-art review. Public Manag Rev 13(7):967–1002
Babakus E, Boller GW (1992) An empirical assessment of the SERVQUAL scale. J Bus Res 24(3):253–268
Barnett JH, Karson MJ (1989) Managers, values, and executive decisions: an exploration of the role of gender, career stage, organizational level, function, and the importance of ethics, relationships and results in managerial decision-making. J Bus Ethics 8(10):747–771
Brady MK, Cronin JJ Jr (2001) Some new thoughts on conceptualizing perceived service quality: a hierarchical approach. J Mark 65(3):34–49
Brown TJ, Churchill GA, Peter JP (1993) Improving the measurement of service quality. J Retail 69(1):127–139
Bitner MJ (1992) Servicescapes: the impact of physical surroundings on customers and employees. J Mark 56:57–71
Buckley J (2003) E-service quality and the public sector. MSQ 13(6):453–462
Burton-Jones A, Hubona GS (2005) Individual differences and usage behavior: revisiting a technology acceptance model assumption. ACM Sigmis Database 36(2):58–77
Carman JM (1990) Consumer perceptions of service quality: an assessment of T. J Retail 66(1):33
Cronin JJ Jr, Taylor SA (1992) Measuring service quality: a re-examination and extension. J Mark 56:55–68
Dillon A (2001) User acceptance of information technology. In: Karwowski W (ed) Encyclopedia of human factors and ergonomics. Taylor and Francis, London
Elie-dit-Cosaque C, Pallud J, Kalika M (2011) The influence of individual, contextual, and social factors on perceived behavioral control of information technology: a field theory approach. JMIS 28(3):201–234
Fountain JE (2001) Paradoxes of public sector customer service. Governance 14(1):55–73
Ford N, Miller D, Moss N (2001) The role of individual differences in Internet searching: an empirical study. J Assoc Inf Sci Technol 52(12):1049–1066
Garicano L, Heaton P (2010) Information technology, organization, and productivity in the public sector: evidence from police departments. J Labour Econ 28(1):167–201
Grönroos C (1982) Strategic Management and marketing in the service sector. Helsinki/Helsingfors, Swedish School of Economics, Finland
Grönroos C (1984) A service quality model and its marketing implications. Eur J Mark 18(4):36–44
Hair JF Jr, Babin B, Money A, Samouel P (2005) Fundamentos de métodos de pesquisa em administração. Bookman, Porto Alegre
Hair JF, Black W, Babin BJ, Anderson RE, Tatham RL (2009) Análise multivariada de dados. Bookman, Porto Alegre
Harrison-Walker JL (2002) Examination of the factorial structure of service quality: a multi-firm analysis. Serv Ind J 22(2):59–72
Holden H, Rada R (2011) Understanding the influence of perceived usability and technology self-efficacy on teachers’ technology acceptance. J Res Technol Educ 43(4):343–367
Hung CJ, Chang HH, Eng CJ, Wong KH (2013) Service quality and perceived value of technology-based service encounters: evaluation of clinical staff satisfaction in Taiwan. Health Inf Manag J 42(1):29
Ives B, Olson MH, Baroudi JJ (1983) The measurement of user information satisfaction. Commun ACM 26(10):785–793
Jöreskog KG, Goldberger AS (1975) Estimation of a model with multiple indicators and multiple causes of a single latent variable. J Am Stat Assoc 70(351a):631–639
Khalil OE, Ghanim HG (2013) Perceived technical service quality and information satisfaction at the Ministry of Communications, Kuwait. IRMJ 26(2):64–90
Khalil OE, Ghanim HG, Abdel-Razek R (2014) The influence of individual characteristics on perceived information systems qualities and effectiveness at the Ministry of Communication, Kuwait. AJAS 21(1):7–42
Kettinger WJ, Lee CC (1994) Perceived service quality and user satisfaction with the information services function*. Decis Sci 25(5–6):737–766
Kettinger WJ, Lee CC (2005) Zones of tolerance: alternative scales for measuring information systems service quality. MIS Q 29:607–623
Kettinger WJ, Lee CC (1997) Pragmatic perspectives on the measurement of information systems service quality. MIS Q 21:223–240
Korobili S, Togia A, Malliari A (2010) Computer anxiety and attitudes among undergraduate students in Greece. Comput Hum Behav 26(3):399–405
Ladhari R (2009) A review of twenty years of SERVQUAL research. Int J Qual Serv Sci 1(2):172–198
Marôco J (2014) Análise de equações estruturais. Pêro Pinheiro, Report number
Miller RE, Hardgrave BC, Jones TW (2013) ISS-QUAL: a measure of service quality for the information systems function. Inf Syst Manag 30(3):250–262
Mikkelsen A, Øgaard T, Lindøe PH, Olsen OE (2002) Job characteristics and computer anxiety in the production industry. Comput Hum Behav 18(3):223–239
Mithas S, Tafti AR, Bardhan I, Goh JM (2012) Information technology and firm profitability: mechanisms and empirical evidence. MIS Q 21:205–224
Morris MG, Venkatesh V, Ackerman PL (2005) Gender and age differences in employee decisions about new technology: an extension to the theory of planned behavior. IEEE Trans Eng Manag 52(1):69–84
Mulaik SA, James LR, Van Alstine J, Bennett N, Lind S, Stilwell CD (1989) Evaluation of goodness-of-fit indices for structural equation models. Psychol Bull 105(3):430
Ng TW, Feldman DC (2009) How broadly does education contribute to job performance? Pers Psychol 62(1):89–134
Palvia PC, Palvia SC (1999) An examination of the IT satisfaction of small-business users. Inf Manag 35(3):127–137
Parasuraman A, Zeithaml VA, Berry LL (1988) Servqual. J Retail 64(1):12–40
Pitt LF, Watson RT, Kavan CB (1995) Service quality: a measure of information systems effectiveness. MIS Q 19:173–187
Parayitam S, Desai KJ, Desai MS, Eason MK (2010) Computer attitude as a moderator in the relationship between computer anxiety, satisfaction, and stress. Comput Hum Behav 26(3):345–352
UNPAN (2016) UN e-Government Survey 2016. E-Government in Support of Sustainable Development. UNPAN, New York. https://publicadministration.un.org/egovkb/Portals/egovkb/Documents/un/2016-Survey/Executive%20Summary.pdf. Retrieved 03 Aug 2017
Peppard J (2003) Managing IT as a portfolio of services. Eur Manag J 21(4):467–483
Prensky M (2001) Digital natives, digital immigrants part 1. Horiz 9(5):1–6
Ragu-Nathan TS, Tarafdar M, Ragu-Nathan BS, Tu Q (2008) The consequences of technostress for end users in organizations: conceptual development and empirical validation. Inf Syst Res 19(4):417–433
Rainey HG, Chun YH (2005) Public and private management compared. The Oxford handbook of public management. Oxford University Press, Oxford
Rust RT, Oliver RL (1994) Service quality: insights and managerial implications from the frontier. In: Rust RT, Oliver RL (eds) Service quality: new dimensions in theory and practice. Sage, Thousand Oaks, pp 1–19
Schreiber JB, Nora A, Stage FK, Barlow EA, King J (2006) Reporting structural equation modeling and confirmatory factor analysis results: a review. J Educ Res 99(6):323–338
Scott JE, Walczak S (2009) Cognitive engagement with a multimedia ERP training tool: assessing computer self-efficacy and technology acceptance. Inf Manag 46(4):221–232
Seth N, Deshmukh SG, Vrat P (2005) Service quality models: a review. IJQRM 22(9):913–949
Sylvester A, Tate M, Johnstone D (2007) Re-presenting the literature review: a rich picture of service quality research in information systems. In: PACIS 2007 proceedings, p 113
Tarafdar M, Tu Q, Ragu-Nathan TS, Ragu-Nathan BS (2011) Crossing to the dark side: examining creators, outcomes, and inhibitors of technostress. Commun ACM 54(9):113–120
Tate M, Evermann J (2010) The end of SERVQUAL in online services research: where to from here? e-Serv J 7(1):60–85
Teas RK (1994) Expectations as a comparison standard in measuring service quality: an assessment of a reassessment. J Mark 58:132–139
Van Dyke TP, Kappelman LA, Prybutok VR (1997) Measuring information systems service quality: concerns on the use of the SERVQUAL questionnaire. MIS Q 21:195–208
Vargo SL, Lusch RF (2008) Service-dominant logic: continuing the evolution. JAMS 36(1):1–10
Venkatesh V, Morris MG (2000) Why don’t men ever stop to ask for directions? Gender, social influence, and their role in technology acceptance and usage behavior. MIS Q 24:115–139
Venkatesh V, Morris MG, Davis GB, Davis FD (2003) User acceptance of information technology: toward a unified view. MIS Q 27:425–478
Venkatesh V, Thong JY, Xu X (2012) Consumer acceptance and use of information technology: extending the unified theory of acceptance and use of technology. MIS Q 36(1):157–178
Whitmore A (2012) A statistical analysis of the construction of the United Nations e-government development index. GIQ 29(1):68–75
Wisniewski M (1996) Measuring service quality in the public sector: the potential for SERVQUAL. TQM 7(4):357–366
Zeithaml VA, Parasuraman A, Berry LL (1990) Delivering quality service: Balancing customer perceptions and expectations. Simon and Schuster, New York
Zeithaml VA, Parasuraman A, Malhotra A (2002) Service quality delivery through web sites: a critical review of extant knowledge. JAMS 30(4):362–375
Zemke R, Raines C, Filipczak B (2000) Generations at work: managing the clash of Veterans, Boomers, Xers, and Nexters in your workplace. Amacom, New York
Zviran M (2003) User satisfaction in ERP systems: some empirical evidence. J Acad Bus Econ 2(1):1–23
Author information
Authors and Affiliations
Corresponding author
Appendix
Appendix
1.1 Psychometric items
- SED1:
-
The credibility/capacity to provide services delivered by the employees of the IT department.
Much lower than I expected ( ) 1 ( ) 2 ( ) 3 ( ) 4 ( ) 5 Much higher than I expected ( ) I do not know or it is non-applicable.
- SED2:
-
The willingness of employees of the IT department to provide services.
- SED3:
-
The courtesy of the IT department employees.
- SED4:
-
The honesty/reliability of employees of the IT department.
- SED5:
-
The personalized service offered by employees of the IT department.
- SED6:
-
The ability of the IT department employees to communicate comprehensibly.
- SED7*:
-
Professional appearance of IT department employees.
- SEP1:
-
The offer of services provided by the IT department.
- SEP2:
-
The variety of services provided by the IT department.
- SEP3:
-
The usefulness of the services provided by the IT department.
- SEP4:
-
The degree of innovation of the services provided by the IT department.
- SEE1:
-
The number of ways to interact with the IT department (phone, email, service center, etc.).
- SEE2:
-
The ease of interaction with the IT department via phone, email, service center, etc.
- SEE3:
-
The convenience of the interaction with the IT department via phone, email, service center, etc.
- SEE4:
-
The efficient use of phone, email, service center, etc., to interact with the IT department.
- SEE5:
-
The variety of ways to interact with the IT department (phone, email, service center, etc.).
- OSQ1:
-
I would rate our IT department as an excellent service provider.
- OSQ2:
-
I am very satisfied with the services provided by our IT department.
- OSQ3:
-
Overall, our IT department offers a service of excellent quality.
* The results of analysis detected a low factor loading for variable SED7 (r = 0.49 and r2 = 0.24). We suggest the removal of the item.
Rights and permissions
About this article
Cite this article
Marchiori, D.M., Mainardes, E.W. & Rodrigues, R.G. Validation of the ISS-QUAL and the role of gender, age and education on it service quality in the public sector. Inf Technol Manag 19, 217–230 (2018). https://doi.org/10.1007/s10799-017-0281-0
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10799-017-0281-0