Abstract
We examined the largely unexplored issue of strong associations between multiple specific climates (e.g., for safety and for service). Given that workplaces are likely to have more than one specific climate present, it is important to understand how and why these perceptions overlap. Individual ratings (i.e., at the psychological climate level) for seven specific climates and a general positive climate were obtained from 353 MTurk Workers employed in various industries. We first observed strong correlations among a larger set of specific climates than typically studied: climates for collaboration, communication, fair treatment, fear, safety, service, and work-life balance were all strongly correlated. Second, we found that two methodological mechanisms—common method variance (CMV) due to (a) measurement occasion and (b) self-report—and a theoretical mechanism, general climate, each account for covariance among the specific climate measures. General positive climate had a primary (i.e., larger) impact on the relationships between specific climates, but CMV—especially due to measurement occasion—also accounted for significant and non-negligible covariance between climates. We discuss directions for continued research on and practice implementing specific climates in order to accurately model and modify perceptions of multiple climates.
Similar content being viewed by others
References
Ashkanasy, N. M., & Nicholson, G. J. (2003). Climate of fear in organisational settings: Construct definition, measurement and a test of theory. Australian Journal of Psychology, 55, 24–29. https://doi.org/10.1080/00049530412331312834.
Bacharach, S. B., & Bamberger, P. A. (2007). 9/11 and New York City firefighters’ post hoc unit support and control climates: A context theory of the consequences of involvement in traumatic work-related events. Academy of Management Journal, 50, 849–868. https://doi.org/10.5465/AMJ.2007.26279180.
Behson, S. J. (2005). The relative contribution of formal and informal organizational work–family support. Journal of Vocational Behavior, 66, 487–500. https://doi.org/10.1016/j.jvb.2004.02.004.
Bowen, D. E., & Ostroff, C. (2004). Understanding HRM-firm performance linkages: The role of the “strength” of the HRM system. Academy of Management Review, 29, 203–221.
Brawley, A. M., & Pury, C. L. S. (2014). De-balkanization: A molar organizational climate framework based on situational affordances. Honolulu, HI: Society of Industrial and Organizational Psychology.
Brawley, A. M., & Pury, C. L. S. (2017). All climates are highly prioritized? Depends on how you ask. Orlando, FL: Society of Industrial and Organizational Psychology.
Buhrmester, M., Kwang, T., & Gosling, S. D. (2011). Amazon’s Mechanical Turk: A new source of inexpensive, yet high-quality, data? Perspectives on Psychological Science, 6, 3–5.
Byrne, B. M., Shavelson, R. J., & Muthén, B. (1989). Testing for the equivalence of factor covariance and mean structures: The issue of partial measurement invariance. Psychological Bulletin, 105, 456–466.
Casler, K., Bickel, L., & Hackett, E. (2013). Separate but equal? A comparison of participants and data gathered via Amazon’s MTurk, social media, and face-to-face behavioral testing. Computers in Human Behavior, 29, 2156–2160.
Cheung, J. H., Burns, D. K., Sinclair, R. R., & Sliter, M. (2017). Amazon Mechanical Turk in organizational psychology: An evaluation and practical recommendations. Journal of Business and Psychology, 32, 347–361.
Clarke, S. (2006). The relationship between safety climate and safety performance: A meta-analytic review. Journal of Occupational Health Psychology, 11(4), 315–327. https://doi.org/10.1037/1076-8998.11.4.315.
Cohen, J. (1992). A power primer. Psychological Bulletin, 112, 155–159.
Downs, C. W., & Hazen, M. D. (1977). A factor analytic study of communication satisfaction. Journal of Business Communication, 14, 63–73. https://doi.org/10.1177/002194367701400306.
Fornell, C., & Larcker, D. F. (1981). Evaluating structural equation models with unobservable variables and measurement error. Journal of Marketing Research, 18, 39–50.
Gelade, G. A., & Young, S. (2005). Test of a service profit chain model in the retail banking sector. Journal of Occupational and Organizational Psychology, 78, 1–22. https://doi.org/10.1348/096317904X22926.
González-Romá, V., Peiró, J. M., & Tordera, N. (2002). An examination of the antecedents and moderator influences of climate strength. Journal of Applied Psychology, 87(3), 465–473.
Hooper, D., Coughlan, J., & Mullen, M. R. (2008). Structural equation modeling: Guidelines for determining model fit. Electronic Journal of Business Research Methods, 6, 53–60.
Kath, L. M., Marks, K. M., & Ranney, J. (2010). Safety climate dimensions, leader–member exchange, and organizational support as predictors of upward safety communication in a sample of rail industry workers. Safety Science, 48, 643–650.
Kenny, D. A. (2015, November 24). Measuring model fit. Retrieved from http://davidakenny.net/cm/fit.htm.
Kline, R. B. (2011). Principles and practice of structural equation modeling (3rd ed.). New York, NY: Guilford.
Kouvonen, A., Kivimäki, M., Vahtera, J., Oksanen, T., Elovainio, M., Cox, T., Virtanen, M., Pentti, J., Cox, S. J., & Wilkinson, R. G. (2006). Psychometric evaluation of a short measure of social capital at work. BMC Public Health, 6(251). https://doi.org/10.1186/1471-2458-6-251.
Kozlowski, S. W. J., & Klein, K. (2000). A multilevel approach to theory and research in organizations: Contextual, temporal, and emergent processes. In K. J. Klein & S. W. J. Kozlowski (Eds.), Multilevel theory, research, and methods in organizations (pp. 3–90). San Francisco: Jossey-Bass.
Kuenzi, M. (2008). An integrated model of work climate. Doctoral dissertation, University of Central Florida, Orlando.
Kuenzi, M., & Schminke, M. (2009). Assembling fragments into a lens: A review, critique, and proposed research agenda for the organizational work climate literature. Journal of Management, 35, 634–717.
Liao, H., & Rupp, D. E. (2005). The impact of justice climate and justice orientation on work outcomes: A cross-level multifoci framework. Journal of Applied Psychology, 90, 242–256. https://doi.org/10.1037/0021-9010.90.2.242.
Matteson, A. V. (2008). Role of work climate in job satisfaction and organizational commitment of women in a nontraditional career field: The case of women in the military. University of Florida. Retrieved from http://search.proquest.com/docview/761142740?pq-origsite=gscholar.
Mayer, D., Nishii, L., Schneider, B., & Goldstein, H. (2007). The precursors and products of justice climates: Group leader antecedents and employee attitudinal consequences. Personnel Psychology, 60, 929–963. https://doi.org/10.1111/j.1744-6570.2007.00096.x.
McKay, P. F., Avery, D. R., Liao, H., & Morris, M. A. (2011). Does diversity climate lead to customer satisfaction? It depends on the service climate and business unit demography. Organization Science, 22, 788–803. https://doi.org/10.1287/orsc.1100.0550.
Meade, A. W. (2004). Psychometric problems and issues involved with creating and using ipsative measures for selection. Journal of Occupational and Organizational Psychology, 77, 531–551. https://doi.org/10.1348/0963179042596504.
Myer, A. T., Thoroughgood, C. N., & Mohammed, S. (2016). Complementary or competing climates? Examining the interactive effect of service and ethical climates on company-level financial performance. Journal of Applied Psychology, 101, 1178–1190. https://doi.org/10.1037/apl0000119.
Neal, A., Griffin, M. A., & Hart, P. M. (2000). The impact of organizational climate on safety climate and individual behavior. Safety Science, 34, 99–109.
Newman, D. A. (2003). Longitudinal modeling with randomly and systematically missing data: A simulation of ad hoc, maximum likelihood, and multiple imputation techniques. Organizational Research Methods, 6, 328–362. https://doi.org/10.1177/1094428103254673.
Ostroff, C., Kinicki, A. J., & Clark, M. A. (2002). Substantive and operational issues of response bias across levels of analysis: An example of climate-satisfaction relationships. Journal of Applied Psychology, 87, 355–368.
Ostroff, C., Kinicki, A. J., & Tamkins, M. M. (2003). Organizational culture and climate. In W. C. Borman & D. R. Ilgen (Eds.), Handbook of psychology: Industrial and organizational psychology (Vol. 12, pp. 565–593). New York: Wiley. https://doi.org/10.1002/0471264385.wei1222.
Paul, J. B. (2012). An integrative study of service and safety climate and performance: Do climates compete? Stillwater, OK: Oklahoma State University.
Podsakoff, P. M., MacKenzie, S. B., Lee, J., & Podsakoff, N. P. (2003). Common method biases in behavioral research: A critical review of the literature and recommended remedies. Journal of Applied Psychology, 88(5), 879–903. https://doi.org/10.1037/0021-9010.88.5.879.
Podsakoff, P. M., MacKenzie, S. B., & Podsakoff, N. P. (2012). Sources of method bias in social science research and recommendations on how to control it. Annual Review of Psychology, 63, 539–569. https://doi.org/10.1146/Annurev-Psych-120710-100452.
Rubino, C., Avery, D. R., McKay, P. F., Moore, B. L., Wilson, D. C., Van Driel, M. S., et al. (2018). And justice for all: How organizational justice climate deters sexual harassment. Personnel Psychology, 71, 519–544. https://doi.org/10.1111/peps.12274.
Schabracq, M. J., & Cooper, C. L. (2000). The changing nature of work and stress. Journal of Managerial Psychology, 15, 227–241. https://doi.org/10.1108/02683940010320589.
Schneider, B. (1980). The service organization: Climate is crucial. Organizational Dynamics, 9(2), 52–65.
Schneider, B. (1987). The people make the place. Personnel Psychology, 40, 437–453.
Schneider, B., Ehrhart, M. G., & Macey, W. H. (2011). Perspectives on organizational climate and culture. In S. Zedeck (Ed.), APA handbook of industrial and organizational psychology: Building and developing the organization (pp. 373–414). Washington, DC: American Psychological Association.
Schneider, B., Ehrhart, M. G., & Macey, W. H. (2013). Organizational climate and culture. Annual Review of Psychology, 64, 361–388. https://doi.org/10.1146/annurev-psych-113011-143809.
Schneider, B., & Reichers, A. E. (1983). On the etiology of climates. Personnel Psychology, 36, 19–39.
Schneider, B., White, S. S., & Paul, M. C. (1998). Linking service climate and customer perceptions of service quality: Tests of a causal model. Journal of Applied Psychology, 83(2), 150–163. https://doi.org/10.1037/0021-9010.83.2.150.
Schulte, M., Ostroff, C., Shmulyian, S., & Kinicki, A. J. (2009). Organizational climate configurations: Relationships to collective attitudes, customer satisfaction, and financial performance. Journal of Applied Psychology, 94, 618–634.
Spector, P. E. (1987). Method variance as an artifact in self-reported affect and perceptions at work: Myth or significant problem? Journal of Applied Psychology, 72, 438–443. https://doi.org/10.1037/0021-9010.72.3.438.
Spell, C. S., & Arnold, T. J. (2007). A multi-level analysis of organizational justice climate, structure, and employee mental health. Journal of Management, 33, 724–751. https://doi.org/10.1177/0149206307305560.
Veld, M., Paauwe, J., & Boselie, P. (2010). HRM and strategic climates in hospitals: Does the message come across at the ward level? Human Resource Management Journal, 20(4), 339–356. https://doi.org/10.1111/j.1748-8583.2010.00139.x.
Wallace, C., & Chen, G. (2006). A multilevel integration of personality, climate, self-regulation, and performance. Personnel Psychology, 59(3), 529–557. https://doi.org/10.1111/j.1744-6570.2006.00046.x.
Watson, D., & Friend, R. (1969). Measurement of social-evaluative anxiety. Journal of Consulting and Clinical Psychology, 33, 448–457. https://doi.org/10.1037/h0027806.
Zohar, D. (1980). Safety climate in industrial organizations: Theoretical and applied implications. Journal of Applied Psychology, 65(1), 96–102.
Zohar, D. (2010). Thirty years of safety climate research: Reflections and future directions. Accident Analysis & Prevention, 42, 1517–1522. https://doi.org/10.1016/j.aap.2009.12.019.
Zohar, D., Davidson, W., & Hofmann, D. A. (2012). Organizational culture and climate. In S. W. J. Kozwloski (Ed.), Oxford handbook of industrial and organizational psychology. Oxford University Press.
Zohar, D., & Luria, G. (2005). A multilevel model of safety climate: Cross-level relationships between organization and group-level climates. Journal of Applied Psychology, 90, 616–628. https://doi.org/10.1037/0021-9010.90.4.616.
Acknowledgments
This research was funded from the generous support of Clemson University Creative Inquiry. We thank Melanie Bennett, Michelle Flynn, Erika Fosu, Joey Glass, Benjamin Hardy, Cameron Lemere, and Briana Smith for assistance with study design, data collection, and analysis.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Appendices
Appendix 1
Revised Climate of Fear Scale (CFS-R)
-
1.
Other employees aren’t totally truthful at work because they worry about what they have to say.
-
2.
Employees can be totally honest with management on all work related issues. (R)
-
3.
Management considers suggestions without criticism. (R)
-
4.
We do not receive all the information we need to do our jobs properly.
-
5.
Admitting mistakes is frowned upon at work.
-
6.
Repercussions at work are unpredictable.
-
7.
Management is easy to discuss sensitive topics with. (R)
-
8.
When speaking up in this organization, you have to be able to prove all your remarks.
-
9.
Punishment is only applied to those who have done something wrong. (R)
-
10.
Co-workers are easy to discuss sensitive issues with. (R)
-
11.
Management comes down hard on mistakes as an example to others.
Appendix 2
General Positive Climate Scale
My manager and coworkers…
-
1.
React quickly when I report problems.
-
2.
Insist on regularly checking my work.*
-
3.
Provide all the equipment and information I need to do my job.*
-
4.
Would consider my behavior when reviewing my performance or promoting me.
-
5.
Invest a lot of time and money in training for me and other employees.
-
6.
Provide me with a lot of information about issues on my job.
-
7.
Make an effort to measure or track the quality of my work.
-
8.
Recognize and/or rewards me for doing a good job.
-
9.
Support me in doing my job to the best of my ability.
-
10.
Communicate with me when I am not doing my job correctly or to the best of my ability.
-
11.
Provide me with the tools, technology, or other resources I need to do my job well.
* denotes items that were dropped from the measure (see Method).
Rights and permissions
About this article
Cite this article
Brawley Newlin, A.M., Pury, C.L.S. All of the Above?: an Examination of Overlapping Organizational Climates. J Bus Psychol 35, 539–555 (2020). https://doi.org/10.1007/s10869-019-09639-6
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10869-019-09639-6