Abstract
Having introduced the expectations of this research in the previous chapter, this chapter deals with how the expectations are tested. First, it is presented how the individual attributes which are used in the hypotheses are operationalized and measured. This is followed by introducing the analysis methods for analyzing the hypotheses.
Measure what you can measure and make measureable what you cannot measure.
Galileo Galilei (1564 Pisa – 1642 Florence)
Cited in Gaarder (1996), p. 169
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
Cf. Wright (2003), p. 133.
- 2.
The term inventory is regularly used in psychology in order to describe a set of questions, which together form a hypothetical construct.
- 3.
It shall be noted that the measures used not inevitably lead to the targeted individual attributes. In literature measurements are often said to lead to hypothetical constructs, which are supposed to approximate the individual attribute, which shall be measured. See e.g. Heckhausen (1980), pp. ff. for a discussion concerning hypothetical constructs.
- 4.
Cf. Mauldin (2003), p. 29; GRE is a standardized test created and administered by the Educational Testing Service. Refer to http://www.ets.org/ for further information.
- 5.
Cf. Dohmen and Falk (2011).
- 6.
Cf. Baiman and Lewis (1989), p. 9.
- 7.
Cf. Waller and Chow (1985), p. 462.
- 8.
- 9.
Cf. Schmalt and Sokolowski (2000), p. 115.
- 10.
- 11.
Cf. Schmalt (1976).
- 12.
Cf. Stein (1990), p. 235.
- 13.
Refer to Brunstein and Heckhausen (2006), pp. 145ff. for a review of measuring the motive to achieve.
- 14.
- 15.
- 16.
Cf. Mikula et al. (1976), pp. 90ff.
- 17.
Cf. Matiakse and Stein (1992), pp. 247 f.
- 18.
- 19.
If Cronbach’s alpha is only calculated with these six items, the value is 0.37. Refer to Sect. 3.2.4.2 for details concerning the items-to-total-score correlation test.
- 20.
Cf. Matiakse and Stein (1992), pp. 246ff.
- 21.
- 22.
Please refer to the appendix for the single items.
- 23.
Cf. Bless et al. (1994), pp. 149f.
- 24.
- 25.
- 26.
- 27.
Cf. Rheinberg et al. (2001), p. 58.
- 28.
Cf. Rheinberg et al. (2001), pp. supplemental material.
- 29.
A different approach to measure interest in a task or task attractiveness is used by Scott Jr. (1967) or Farh et al. (1991). They do not use complete questions but use opposite ratings such as attractive versus unattractive as an instrument. Since Rheinberg et al. (2001), p. 58 provide an integration of the factor interest into the motivation concept, their approach is pursued for the factor interest as well as for the other factors in order to measure a current motivation construct.
- 30.
Cf. Rheinberg et al. (2001), pp. 58f.
- 31.
Cf. Rheinberg et al. (2001), pp. supplemental material.
- 32.
Cf. Rheinberg et al. (2001), pp. supplemental material.
- 33.
In the underlying research probability of success is also captured by (L.1/ SKILL) ∙ L.2, which is denoted L.PROBABILITYOFSUCCESS.
- 34.
Cf. Rheinberg et al. (2001), p. 58.
- 35.
Cf. Rheinberg et al. (2001), p. 59.
- 36.
Since the factor probability of success merely consists of one question, Cronbach’s alpha cannot be calculated.
- 37.
- 38.
Cf. Levenson (1974).
- 39.
- 40.
Cf. Logsdon et al. (1978), p. 538.
- 41.
Cf. Krampen (1979), p. 579.
- 42.
Cf. Krampen (1979), p. 581.
- 43.
Cf. Krampen (1979), p. 581.
- 44.
Cf. Krampen (1979), p. 579.
- 45.
Cf. MacCrimmon and Wehrung (1985b), p. 10.
- 46.
- 47.
- 48.
MacCrimmon and Wehrung (1985b), p. 22.
- 49.
Cf. MacCrimmon and Wehrung (1985b), p. 24.
- 50.
Refer to Harrison et al. (2005), pp. 1394ff. for a review on risk measurements.
- 51.
Cf. Hyatt and Taylor (2008), pp. supplemental material.
- 52.
Cf. Botella et al. (2008), p. 531.
- 53.
- 54.
Cf. Shields and Waller (1988), p. 590.
- 55.
Cf. Shields and Waller (1988), p. 585.
- 56.
Cf. Holt and Laury (2002).
- 57.
- 58.
Cf. Holt and Laury (2002), p. 1645.
- 59.
Cf. Holt and Laury (2002), p. 1646.
- 60.
Cf. Weber et al. (2002).
- 61.
- 62.
- 63.
Cf. Betsch (2004), p. 183.
- 64.
Cf. Schunk and Betsch (2006), p. 399.
- 65.
- 66.
- 67.
- 68.
Cf. Field (2009), pp. 395ff.
- 69.
- 70.
There is a discussion in literature whether data from rating scales can be treated as continuous data. The general understanding is that rating scales with enough steps approximate the metric quality of true continuous scales. In this text Srinivasan and Basu (1989), p. 226’s opinion is followed that five levels provide good metric quality. Thus, the five level scales are supposed to result in continuous measures in the study.
- 71.
- 72.
- 73.
- 74.
- 75.
Cohen (2009), p. 151, comparing regression with correlational analysis, state that regression coefficients often lead to the most informative results and answers. Refer to Baron and Kenny (1986), p. 1175 for details concerning deficiencies, or to Cohen (2009), pp. 151–192 for a detailed methodological comparison of regression and correlational analysis.
- 76.
- 77.
Cf. Henderson (1998); The SPSS package used offers both analysis techniques. It is important to note that regression, if based on the general linear model, and ANOVA, if also based on the general linear model, are conceptually the same. In the SPSS package used, the general linear model is used for both paradigms (Cf. Field (2007), p. 311; Cohen (2009), p. 5).
- 78.
Cf. Rack and Christophersen (2007), p. 19.
- 79.
Cf. Evans and Rooney (2008), pp. 194f.
- 80.
- 81.
Cf. Irwin and McClelland (2003), p. 366.
- 82.
- 83.
Cf. Irwin and McClelland (2003), p. 369.
- 84.
- 85.
Cf. Irwin and McClelland (2003), p. 371.
- 86.
Cf. Jaccard et al. (1997), p. 49.
- 87.
Ordinary least squares is the method used for estimating the linear regression parameters.
- 88.
Cf. Jaccard et al. (1997), pp. 10f.
- 89.
Cf. Jaccard et al. (1997), p. 33; For comparison reason, additionally, standardized coefficients are given in the relevant tables.
- 90.
Cf. Hardy (2007), pp. 19ff.
- 91.
Cf. Jaccard et al. (1997), pp. 25f.
- 92.
Cf. Baron and Kenny (1986), p. 1176.
- 93.
Cf. Baron and Kenny (1986), p. 1174.
- 94.
- 95.
Cf. Baron and Kenny (1986), p. 1174.
- 96.
Cf. Janssen and Laatz (2007), pp. 426f.
- 97.
- 98.
SPSS generally states two-tailed significance values. However, as directed hypotheses are formulated, significance values based on one-tailed tests are also appropriate as suggested for example in Allison (2004), p. 42, Backhaus et al. (2006), pp. 76f. or Janssen and Laatz (2007), p. 426. Still, as it is standard practice in linear regression to report two-tailed tests, significance levels based on two-tailed tests are reported in the underlying experiment. Thus, the significance levels can be regarded as being rather conservative.
- 99.
- 100.
- 101.
- 102.
- 103.
Cf. Baron and Kenny (1986), p. 1177.
- 104.
Cf. Baron and Kenny (1986), p. 1177.
- 105.
Cf. Sitkin and Weingart (1995), pp. 1582f.
- 106.
- 107.
Cf. Jaccard et al. (1997), pp. 24f.
- 108.
Cf. Jaccard et al. (1997), pp. 17f.
- 109.
In linear regression analysis SPSS merely shows differences between unadjusted \( {{\mathrm{ R}}^2} \) s as well.
- 110.
Cf. Field (2007), pp. 171f.
- 111.
As the number of cases and the number of predictor variables are also reported, any adjustments to \( {{\mathrm{ R}}^2} \) can be still performed without needing further information. It shall be also noted that adjustments to \( {{\mathrm{ R}}^2} \) based on Wherry’s equation within the underlying analyses are quantitatively small and do not change the analysis qualitatively.
- 112.
- 113.
Backhaus et al. (2006), p. 94 note that regression analysis is relatively robust against small violations of its assumptions.
- 114.
- 115.
Cf. Jaccard et al. (1997), pp. 30ff.
- 116.
Cf. Field (2007), p. 175.
- 117.
- 118.
- 119.
- 120.
- 121.
- 122.
Cf. Backhaus et al. (2006), pp. 92f.
- 123.
- 124.
Cf. Chatterjee and Hadi (2006), pp. 88, 103f.
- 125.
Cf. Field (2007), p. 165; In the findings section Cook’s distance values higher than 1.25 are further investigated.
- 126.
Cf. Menard (2000), pp. 1–16.
- 127.
Cf. Norušis (2010), p. 69.
- 128.
Cf. Bühl (2006), p. 111.
- 129.
- 130.
When the magnitude of incentive variable is used as predictor, the linear ordinary least squares regression analysis can be used independently from the variable’s classification being ordinal or nominal.
- 131.
Cf. Janssen and Laatz (2007), p. 459.
- 132.
For a discussion about how to treat ordinal dependent variables refer to Menard (2000), pp. 86ff.
- 133.
- 134.
Cf. Backhaus et al. (2006), p. 428.
- 135.
Cf. Backhaus et al. (2006), pp. 471f.
- 136.
Cf. Liao (2006), p. 7.
- 137.
- 138.
- 139.
Differences of Nagelkerke’s pseudo R2 values are evaluated qualitatively, as no test is introduced in the underlying literature.
- 140.
Cf. Field (2007), p. 223.
- 141.
Cf. Backhaus et al. (2006), pp. 449, 456.
- 142.
Cf. Menard (2000), p. 32; In this context, classification relates to a model’s prediction for an element belonging to one or the other category. For instance, by means of classification tables, the number of correctly predicted categories can be compared to the falsely predicted categories. For further methods to gauge the classification accuracy of logistic regression models refer to Menard (2000), pp. 28ff. In general goodness-of-fit and accuracy of classification measures produce consistent results (Menard (2000), p. 32).
- 143.
- 144.
Refer to Dohmen and Falk (2011) for an example for the use of marginal effect sizes in probit models.
- 145.
Refer to Liao (2006), pp. 6ff., 13ff. for an in-depth discussion of parameter estimates’ interpretation possibilities.
- 146.
Cf. Backhaus et al. (2006), p. 480.
- 147.
Refer to Sect. 3.2.3 for a more general discussion on sample size.
- 148.
References
Allison PD (2004) Multiple regression: a primer. Pine Forge Press, Thousand Oaks
Anderson CH (1986) Hierarchical moderated regression analysis: a useful tool for retail management decisions. J Retailing 62(2):186–203
Backhaus K, Erichson B, Plinke W, Weiber R (2006) Multivariate analysemethoden: eine anwendungsorientierte einführung, 11th edn. Heidelberg, Berlin
Baiman S, Lewis BL (1989) An experiment testing the behavioral equivalence of strategically equivalent employment contracts. J Accounting Res 27(1):1–20
Baron RM, Kenny DA (1986) The moderator-mediator variable distinction in social psychological research: conceptual, strategic, and statistical considerations. J Pers Soc Psychol 51(6):1173–1182
Berry WD (2006) Understanding regression assumptions. Sage, Newbury Park
Betsch C (2004) Präferenz für Intuition und Deliberation (PID): Inventar zur Erfassung von affekt- und kognitionsbasiertem Entscheiden [Preference for Intuition and Deliberation (PID): An Inventory for Assessing Affect- and Cognition-Based Decision-Making]. in: Zeitschrift für Differentielle und Diagnostische Psychologie, 25(4), 179–197
Biernat M (1989) Motives and values to achieve: different constructs with different effects. J Pers 57(1):69–95
Blais A-R, Weber EU (2006) A Domain-Specific Risk-Taking (DOSPERT) scale for adult populations. Judgm Decis Making 1(1):33–47
Bless H, Wänke M, Bohner G, Fellhauer R, Schwarz N (1994) Need for Cognition: Eine Skala zur Erfassung von Freude und Engagement bei Denkaufgaben. in: Zeitschrift für Sozialpsychologie, 25, 147–154
Botella J, Narváez M, Martínez-Molina A, Rubio VJ, Santacreu J (2008) A dilemmas task for eliciting risk propensity. Psychol Rec 58(4):528–545
Brunstein J, Heckhausen H (2006) Leistungsmotivation. In: Heckhausen J, Heckhausen H (eds) Motivation und Handeln, 3rd edn. Springer, Heidelberg, pp 144–192
Bühl A (2006) SPSS 14: einführung in die moderne datenanalyse, 10th edn. Pearson Studium, München
Cacioppo JT, Petty RE (1982) The need for cognition. J Pers Soc Psychol 42:116–131
Cacioppo JT, Petty RE, Kao CF (1984) The efficient assessment of need for cognition. J Pers Assess 48(3):306–307
Cadsby CB, Song F, Tapon F (2007) Sorting and incentive effects of pay for performance: an experimental investigation. Acad Manage J 50(2):387–405
Chatterjee S, Hadi AS (2006) Regression analysis by example, 4th edn. Wiley-Interscience, Hoboken
Cohen J (2009) Applied multiple regression/correlation analysis for the behavioral sciences, 3rd edn. Erlbaum, Mahwah
Cook RD (1977) Detection of influential observation in linear regression. Technometrics 19:15–18
Dahme G, Jungnickel D, Rathje H (1993) Güteeigenschaften der Achievement Motivation Scale (AMS) von Gjesme und Nygard (1970) in der deutschen Übersetzung von Göttert und Kuhl: Vergleich der Kennwerte norwegischer und deutscher Stichproben. Diagnostica 39:257–270
Dohmen T, Falk A (2006) Performance pay and multi-dimensional sorting: productivity, preferences and gender. Working paper: IZA discussion paper, Bonn
Dohmen T, Falk A (2011) Performance pay and multi-dimensional sorting: productivity, preferences and gender. Am Econ Rev 101(2):556–590
Durbin J, Watson GS (1951) Testing for serial correlation in least squares regression. Biometrika 38(1/2):159–177
Eckey H.-f, Kosfeld R, Türck M (eds) (2005) Ökonometrische Eingleichungsmodelle mit SPSS: Eine Einführung. Working paper: Universität Kassel
Evans AN, Rooney BJ (2008) Methods in psychological research. Sage, Los Angeles
Fahrmeir L, Kneib T, Lang S (2007) Regression: modelle, methoden und anwendungen. Springer, Berlin\Heidelberg
Farh J-L, Griffeth RW, Balkin DB (1991) Effects of choice of pay plans on satisfaction, goal setting, and performance. J Organ Behav 12:55–62
Field AP (2007) Discovering statistics using SPSS, 2nd edn. Sage, London
Field A (2009) Discovering statistics using SPSS, 3rd edn. Sage, Los Angeles
Goldfeld SM, Quandt RE (1965) Some tests for homoscedasticity. J Am Stat Assoc 60(310):539–547
Gulgoz S (2001) Need for cognition and cognitive performance from a cross-cultural perspective: examples of academic success and solving anagrams. J Psychol 135(1):100–112
Hackl P (2008) Einführung in die Ökonometrie. München
Hardy MA (2007) Regression with dummy variables. Sage, Newbury Park
Harrison JD, Young JM, Butow P, Salkeld G, Solomon MJ (2005) Is it worth the risk? a systematic review of instruments that measure risk propensity for use in the health setting. Soc Sci Med 60(6):1385–1396
Heckhausen H (1980) Motivation und handeln. Springer, Berlin
Henderson C (ed) (1998) The SPSS GLM procedure, or what happened to ANOVA. Working paper, University of north Texas, Research and statistical support services
Holt CA, Laury SK (2002) Risk aversion and incentive effects. Am Econ Rev 92(5):1644–4655
Hosmer DW, Lemeshow S (2000) Applied logistic regression, 2nd edn. Wiley, New York
Hyatt TA, Taylor MH (2008) The effects of incomplete personal capability knowledge and overconfidence on employment contract selection. Behav Res Account 20(2):37–53
Irwin JR, McClelland GH (2003) Negative consequences of dichotomizing continuous predictor variables. J Market Res 40(3):366–371
Jaccard J (2005a) Interaction effects in factorial analysis of variance. Sage, Thousand Oaks
Jaccard J (2005b) Interaction effects in logistic regression. Sage, Thousand Oaks
Jaccard J, Turrisi R, Wan CK (1997) Interaction effects in multiple regression, 9th edn. Sage, Newbury Park
Janssen J, Laatz W (2007) Statistische Datenanalyse mit SPSS für Windows: Eine anwendungsorientierte Einführung in das Basissystem und das Modul Exakte Tests, 6. ed. Berlin, Heidelberg
Johnson JG, Wilke A, Weber EU (2004) A domain-specific scale measuring risk perception, expected benefits and perceived-risk attitude in German-speaking populations. Pol Psychol Bull 35(3):153–163
Krampen G (1979) Differenzierungen des Konstruktes der Kontrollüberzeugungen. in: Zeitschrift für experimentelle und angewandte Psychologie, 26(4), pp. 573–595
Krampen G (1982) Differentialpsychologie der Kontrollüberzeugungen: (‘Locus of control’). Göttingen
Levenson H (1974) Activism and powerful others: distinctions within the concept of internal-external control. J Pers Assess 38:377–383
Liao TF (2006) Interpreting probability models: logit, probit, and other generalized linear models. Sage, Thousand Oaks
Logsdon SA, Bourgeois AE, Levenson H (1978) Locus of control, learned helplessness, and control of heart rate using biofeedback. J Pers Assess 42(5):538–544
MacCrimmon KR, Wehrung DA (1985) A portfolio of risk measures. Theor Decis 19:1–29
Matiakse W, Stein FA (1992) Gütekontrolle zweier Leistungsmotivationstests. Diagnostica 38(3):242–248
Mauldin EG (2003) An experimental examination of information technology and compensation structure complementarities in an expert system context. J Inform Syst 17(1):19–41
McClelland DC, Atkinson JW, Clark RA, Lowell EL (1953) The achievement motive. Appleton-Century-Crofts, New York
Mehrabian A (1968) Male and female scales of the tendency to achieve. Educ Psychol Meas 28(2):493–502
Mehrabian A (1969) Measures of achieving tendency. Educ Psychol Meas 29(2):445–451
Menard S (2000) Applied logistic regression analysis. Sage, Thousand Oaks
Mikula G, Uray H, Schwinger T (1976) Die Entwicklung einer deutschen Fassung der Mehrabian Achievement Risk Preference Scale. Diagnostica 22:87–97
Norušis MJ (2010) PASW Statistics 18 Advanced Statistical procedures. Prentice Hall, Upper Saddle River
Rack O, Christophersen T (2007) Experimente. In: Albers, Sönke; Klapper, Daniel; Konradt, Udo; Walter, Achim; Wolf, Joachim (ed, 2007): Methodik der empirischen Forschung. 2. ed. Wiesbaden, pp. 17–32
Ravichandran C, Fitzmaurice GM (2008) To dichotomize or not to dichotomize? Nutrition 24(6):610–611
Rheinberg F, Vollmeyer R, Burns BD (2001) FAM: Ein Fragebogen zur Erfassung aktueller Motivation in Lern- und Leistungssituationen. Diagnostica 47(2):57–66
Rotter JB (1966) Generalized expectancies for internal versus external control of reinforcment. Psychol Monogr 80:1–609
Schmalt H-D (1976) Die Messung des Leistungsmotivs. Verlag für Psychologie Hogrefe, Göttingen
Schmalt H-D, Sokolowski K (2000) Zum gegenwärtigen Stand der Motivdiagnostik. Diagnostica 46(3):115–123
Schroeder LD, Sjoquist DL, Stephan PE (2005) Understanding regression analysis: an introductory guide. Sage, Newbury Park, Calif
Schunk D, Betsch C (2006) Explaining heterogeneity in utility functions by individual differences in decision modes. J Econ Psychol 27(3):386–401
Scott WE Jr (1967) The development of semantic differential scales as measures of “morale”. Pers Psychol 20(2):179–198
Shields MD, Waller WS (1988) A behavioral study of accounting variables in performance – incentive contracts. Account Organ Soc 13(6):581–594
Sitkin SB, Weingart LR (1995) Determinants of risky decision-making behavior: a test of the mediating role of risk perceptions and propensity. Acad Manage J 38(6):1573–1592
Skeel RL, Neudecker J, Pilarski C, Pytlak K (2007) The utility of personality variables and behaviorally-based measures in the prediction of risk-taking behavior. Pers Indiv Differ 43(1):203–214
Srinivasan V, Basu AK (1989) The metric quality of ordered categorical data. Market Sci 8(8):205–230
Stein FA (1990) Betriebliche Entscheidungs-Situationen im Laborexperiment: Die Abbildung von Aufgaben- und Strukturmerkmalen als Validitätsbedingungen. Frankfurt am Main
Tent L (1963) Untersuchung zur Erfassung des Verhältnisses von Anspannung und Leistung bei vorwiegend psychisch beanspruchenden Tätigkeiten. Arch Gesamte Psychol 115:105–172
Waller WS, Chow CW (1985) The self-selection and effort effects of standard-based employment contracts: a framework and some empirical evidence. Account Rev 60(3):458–476
Weber EU, Blais A-RE, Betz NE (2002) A domain-specific risk-attitude scale: measuring risk perceptions and risk behaviors. J Behav Decis Making 15:263–290
Wendorf CA (2004) Primer on multiple regression coding: common forms and the additional case of repeated contrasts. Underst Stat 3(1):47–57
Williams S, Zainuba M, Jackson R (2008) Determinants of managerial risk perceptions and intentions. J Manage Res 8(2):59–75
Wright DB (2003) Making friends with your data: improving how statistics are conducted and reported. Br J Educ Psychol 73(1):123–136
Author information
Authors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Fehrenbacher, D.D. (2013). Operationalization and Data Analysis Methods. In: Design of Incentive Systems. Contributions to Management Science. Physica, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-33599-0_5
Download citation
DOI: https://doi.org/10.1007/978-3-642-33599-0_5
Published:
Publisher Name: Physica, Berlin, Heidelberg
Print ISBN: 978-3-642-33598-3
Online ISBN: 978-3-642-33599-0
eBook Packages: Business and EconomicsBusiness and Management (R0)