Skip to main content

Advertisement

SpringerLink
Log in

Development of a Short-Form Measure of Science and Technology Self-efficacy Using Rasch Analysis

  • Published:
Journal of Science Education and Technology Aims and scope Submit manuscript

Abstract

Despite an increased focus on science, technology, engineering, and mathematics (STEM) in U.S. schools, today’s students often struggle to maintain adequate performance in these fields compared with students in other countries (Cheek in Thinking constructively about science, technology, and society education. State University of New York, Albany, 1992; Enyedy and Goldberg 2004; Mandinach and Lewis 2006). In addition, despite considerable pressure to promote the placement of students into STEM career fields, U.S. placement is relatively low (Sadler et al. in Sci Educ 96(3):411–427, 2012; Subotnik et al. in Identifying and developing talent in science, technology, engineering, and mathematics (STEM): an agenda for research, policy and practice. International handbook, part XII, pp 1313–1326, 2009). One explanation for the decline of STEM career placement in the U.S. rests with low student affect concerning STEM concepts and related content, especially in terms of self-efficacy. Researchers define self-efficacy as the internal belief that a student can succeed in learning, and that understanding student success lies in students’ externalized actions or behaviors (Bandura in Psychol Rev 84(2):191–215, 1977). Evidence suggests that high self-efficacy in STEM can result in student selection of STEM in later educational endeavors, culminating in STEM career selection (Zeldin et al. in J Res Sci Teach 45(9):1036–1058, 2007). However, other factors such as proficiency play a role as well. The lack of appropriate measures of self-efficacy can greatly affect STEM career selection due to inadequate targeting of this affective trait and loss of opportunity for early intervention by educators. Lack of early intervention decreases selection of STEM courses and careers (Valla and Williams in J Women Minor Sci Eng 18(1), 2012; Lent et al. in J Couns Psychol 38(4), 1991). Therefore, this study developed a short-form measure of self-efficacy to help identify students in need of intervention.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2

Similar content being viewed by others

References

  • Allen M, Yen W (1979) Introduction to measurement theory. Brooks/Cole, Monterey

    Google Scholar 

  • Annetta LA, Minogue J, Holmes SY, Cheng MT (2009) Investigating the impact of video games on high school students’ engagement and learning about genetics. Comput Educ 53(1):74–85

    Article  Google Scholar 

  • Badura A (1986) The explanatory and predictive scope of self-efficacy theory. J Soc Clin Psychol 4(3):359–373

    Article  Google Scholar 

  • Bandura A (1977) Self-efficacy: toward a unifying theory of behavioral change. Psychol Rev 84(2):191–215

    Article  Google Scholar 

  • Bandura A (1982) Self-efficacy mechanism in human agency. Am Psychol 37(2):122–147

    Article  Google Scholar 

  • Bandura A (2006) Chapter 14. Guide for constructing self-efficacy scales. In: Pajares F, Urdan T (eds) Self-efficacy beliefs of adolescents. Information Age, New York

    Google Scholar 

  • Bandura A et al (1994) Multifaceted impact of self-efficacy beliefs on academic functioning. Child Dev 67(3):1206–1222

    Article  Google Scholar 

  • Beckers J, Schmidt H (2001) The structure of computer anxiety: a six-factor model. Comput Hum Behav 17(1):35–49

    Article  Google Scholar 

  • Bond TG, Fox CM (2007) Applying the Rasch model: fundamental measurement in the human sciences, 2nd edn. Erlbaum, Mahwah

    Google Scholar 

  • Bong M, Skaalvik E (2003) Academic self-concept and self-efficacy: how difference are they really. Educ Psychol Rev 15(1):1–40

    Article  Google Scholar 

  • Boone WJ, Townsend JS, Staver J (2011) Using Rasch theory to guide the practice of survey development and survey data analysis in science education and to inform science reform efforts: an exemplar utilizing STEBI self-efficacy data. Sci Educ 95:258–280

    Article  Google Scholar 

  • Britner SL (2008) Motivation in high school science students: a comparison of gender differences in life, physical, and earth science classes. J Res Sci Teach 45:955–970

    Article  Google Scholar 

  • Britner SL, Pajares F (2006) Sources of science self-efficacy beliefs of middle school students. J Res Sci Teach 43:485–499

    Article  Google Scholar 

  • Caprara GV, Vecchione M, Alessandri G, Gerbino M, Barbaranelli C (2011) The contribution of personality traits and self-efficacy beliefs to academic achievement: a longitudinal study. Br J Educ Psychol 81(1):78–96

    Article  Google Scholar 

  • Cassidy A, Eachus P (2002) Developing the computer user self-efficacy (CUSE) scale: investigating the relationship between computer self-efficacy, gender and experience with computers. J Educ Comput Res 26(2):133–153

    Article  Google Scholar 

  • Cheek DW (1992) Thinking constructively about science, technology, and society education. State University of New York, Albany

    Google Scholar 

  • Colley A, Gale M, Harris T (1994) Effects of gender role identity and experience on computer attitude components. J Educ Comput Res 10(2):129–137

    Article  Google Scholar 

  • Cox R, Smitsman A (2008) Special section: towards an embodiment of goals. Theory Psychol 18(3):317–339

    Article  Google Scholar 

  • Dimitrov D (2012) Statistical methods for validation of assessment scale data in counseling and related fields. American Counseling Association, Alexandria

    Google Scholar 

  • Embretson S, Gorin J (2001) Improving construct validity with cognitive psychology principles. J Educ Meas 38(4):343–368

    Article  Google Scholar 

  • Enyedy N, Goldberg J (2004) Inquiry in interaction: how local adaptations of curricula shape classroom communities. J Res Sci Teach 41(9):905–935

    Article  Google Scholar 

  • Geary D (2010) Evolution and education. Psicothema 22(1):35–40

    Google Scholar 

  • Gentner D (2010) Bootstrapping the mind: analogical processes and symbol systems. Cognit Sci 34(5):752–775

    Article  Google Scholar 

  • Hall N, Hladkyj S, Perry R, Ruthig J (2004) The role of attributional retraining and elaborative learning in college students’ academic development. J Soc Psychol 144(6):591–612

    Article  Google Scholar 

  • Harkness W (1965) Properties of extended hypergeonomic distribution. Ann Math Stat 36(3):938–945

    Article  Google Scholar 

  • Haynes T, Clifton R, Daniels L, Perry R, Chipperfield J, Ruthig J (2011) Attributional retraining: reducing the likelihood of failure. Soc Psychol Educ 14(1):75–92

    Article  Google Scholar 

  • Hays R, Brown J, Brown L, Spritzer K, Crall J (2008) Classical test theory and item response theory analyses of multi-item scales assessing parents’ perceptions’ of their children’s dental care. Med Care 44(11):S60–S68

    Google Scholar 

  • Henderson P, Peterson R (2004) Mental accounting and categorization. Organ Behav Hum Decis Process 51(1):92–117

    Article  Google Scholar 

  • Judge T (2009) Core self-evaluations and work success. Curr Dir Psychol Sci 18(1):58–62

    Article  Google Scholar 

  • Ketelhut DJ (2010) Assessing gaming, computer and scientific inquiry self-efficacy in a virtual environment. In: Annetta L, Bronsak S (eds) Serious educational games assessment: practical methods and models for educational games, simulations and virtual worlds. Sense, New York

    Google Scholar 

  • Kyngdon A (2009) The Rasch model from the perspective of the representation theory of measurement. Theory Psychol 18(1):89–109

    Article  Google Scholar 

  • Lamb RL, Annetta L (2012a) The use of online modules and the effect on student outcomes in a high school chemistry class. J Sci Educ Technol 22(5):603–613

    Google Scholar 

  • Lamb R, Annetta L (2012b) Influences of gender on computer simulation outcomes. Meridian 13(1):1–4

    Google Scholar 

  • Lamb RL, Annetta L, Meldrum J, Vallett D (2012) Measuring science interest: Rasch validation of the science interest survey. Int J Sci Math Educ 10(3):643–668

    Article  Google Scholar 

  • Lamb R, Annetta L, Vallett D, Sadler T (2014) Cognitive diagnostic like approaches using neural network analysis of serious educational video games. Comput Educ 70:92–104

    Article  Google Scholar 

  • Lawson A (2004) The nature and development of scientific reasoning: a scientific view. Int J Sci Math Educ 2(3):307–338

    Article  Google Scholar 

  • Lent R, Lopez F, Bieschke K (1991) Mathematics self-efficacy: sources and relation to science-based career choice. J Couns Psychol 38(4):424–430

    Google Scholar 

  • Linacre JM (1994) Sample size and item calibration stability. Rasch Meas Trans 7(4):324

    Google Scholar 

  • Linacre JM (1999) Investigating rating scale category utility. J Outcome Meas 3(2):103–122

    Google Scholar 

  • Linacre JM (2009a) Practical Rasch measurement—core topics (Online course)

  • Linacre JM (2009b) WINSTEPS (Software and user’s guide). Winsteps, Chicago

    Google Scholar 

  • Liu X (2010) Using and developing measurement instruments in science education: a Rasch modeling approach. Information Age, Charlotte

    Google Scholar 

  • Mandinach EB, Lewis A (2006) The current context of research: seeking a balance between rigor and relevance. Paper presented at the annual meeting of the American Educaitonal Research Association (AERA), San Francisco, CA

  • McGrath M, Braunstein A (1997) The prediction of freshmen attrition: an examination of the importance of certain background, academic, financial, and social factors. Univ Stud J 31:396–408

    Google Scholar 

  • Messick S (1989) Validity. In: Linn RL (ed) Educational measurement, 3rd edn. Macmillan, New York, pp 13–103

    Google Scholar 

  • Messick S (1996a) Standards-based score interpretation: establishing valid grounds for valid inferences. Proceedings of the joint conference on standard setting for large scale assessments, Sponsored by National Assessment Governing Board and The National Center for Education Statistics. Government Printing Office, Washington, DC

  • Messick S (1996b) Validity of performance assessment. In: Philips, G Technical issues in large-scale performance assessment. National Center for Educational Statistics, Washington

  • Messick S (1998) Test validity: a matter of consequence. Soc Indic Res 45(1–3):35–44

    Google Scholar 

  • Oikawa M, Aarts H, Oikawa H (2011) There is a fire burning in my heart: the role of causal attribution in affect transfer. Cogn Emot 25(1):156–163

    Article  Google Scholar 

  • Pajares F, Miller DM (1995) Mathematics self-efficacy and mathematics performance: the need for specificity of assessment. J Couns Psychol 42:190–198

    Article  Google Scholar 

  • Pajarres F (1996) Self-efficacy beliefs in academic settings. Rev Educ Res 66(4):543–578

    Article  Google Scholar 

  • Panuonen S, Hong R (2010) Self-efficacy and the prediction of domain specific cognitive abilities. J Pers 78(1):339–360

    Article  Google Scholar 

  • Perry R, Stupnisky R, Hall N, Chipperfield J, Weiner B (2010) Bad started and better finishes: attributional retaining and initial performance in competitive achievement settings. J Soc Clin Psychol 29(6):668–700

    Article  Google Scholar 

  • Porter S, Whitcomb M, Weitzer W (2004) Multiple surveys of students and survey fatigue. New Dir Inst Res 121:63–73

    Google Scholar 

  • Rasch G (1960) Probabilistic models for some intelligence and attainment tests. Danmarks Paedagogiske Institute, Copenhagen

    Google Scholar 

  • Raykov T (2009) Evaluation of scale reliability for unidimensional measures using latent variable modeling. Meas Eval Couns Dev 42(3):223–232

    Article  Google Scholar 

  • Raykov T, Dimitrov D, Asparouhov T (2010) Evaluation of scale reliability with binary measures using latent variable modeling. Struc Equ Model Multidiscip J 17(2):265–279

    Article  Google Scholar 

  • Sadler PM, Sonnert G, Hazari Z, Tai R (2012) Stability and volatility of STEM career interest in high school: a gender study. Sci Educ 96(3):411–427

    Article  Google Scholar 

  • Saks A (1997) Transfer of training and self-efficacy: what is the Dilemma? Appl Psychol 46(4):365–370

    Article  Google Scholar 

  • Savage S, Waldman D (2008) Learning and fatigue during choice experiments: a comparison of online and mail survey modes. J Appl Econom 23(3):351–371

    Article  Google Scholar 

  • Scherbaum C, Cohen-Charash Y, Kern M (2006) Measuring general self-efficacy: a comparison of three measures using item response theory. Educ Psychol Meas 66(6):1047–1063

    Article  Google Scholar 

  • Schunk D (1985) Self-efficacy and classroom learning. Psychol Sch 22(2):208–223

    Article  Google Scholar 

  • Schunk D (1989) Self-efficacy and achievement behaviors. Educ Psychol Rev 1(3):173–208

    Article  Google Scholar 

  • Skaalvik E, Skaalvik S (2007) Dimension of teacher self-efficacy and relations with strain factors, perceived collective teacher efficacy and teacher burnout. J Educ Psychol 99(3):611–625

    Article  Google Scholar 

  • Stewart B, Tennant A, Tennant R, Platt S, Parkinson J, Weich S (2009) Internal construct validity of the Warwick-Edinburgh mental well-being Scale: a Rasch analysis using data from the Scottish Health Education Population Survey. Health Qual Life Outcomes 7(15):1–8

    Google Scholar 

  • Stone C (2005) Monte Carlo based null distribution for an alternative goodness-of-fit test statistic in IRT models. J Educ Meas 37(1):58–75

    Article  Google Scholar 

  • Strecher V, DeVellis B, Marshall B, Rosenstock I (1986) The role of self-efficacy in achieving health behavior change. Health Educ Behav 13(1):73–92

    Article  Google Scholar 

  • Subotnik R, Orland M, Rayhack K, Schuck J (2009) Identifying and developing talent in science, technology, engineering, and mathematics (STEM): an agenda for research, policy and practice. In: Shavinina LV (ed) International handbook, Part XII, pp 1313–1326

  • Tierney P, Farmer S (2011) Creative self-efficacy development and creative performance over time. J Appl Psychol 96(2):277–293

    Article  Google Scholar 

  • United States Census Bureau (2012). QuickFacts Data.gov. Retrieved 27 June 2013, from http://quickfacts.census.gov

  • Usher E (2009) Sources of middle school students’ self-efficacy in mathematics: a qualitative investigation. Am Educ Res J 46(1):275–314

    Article  Google Scholar 

  • Valla JM, Williams WM (2012) Increasing achievement and higher-education representation of under-represented groups in science, technology, engineering, and mathematics fields: a review of current K-12 intervention programs. J Women Minor Sci Eng 18(1):21–53

    Google Scholar 

  • Vancouver J, More K, Yoder R (2008) Self-efficacy and resource allocation: support for nonmonotonic discontinues model. J Appl Psychol 93(1):35–47

    Article  Google Scholar 

  • Vidler DC, Rawan HR (1974) Construct validation of a scale of academic curiosity. Psychol Rep 35(1):263–266

    Article  Google Scholar 

  • Vorderer P, Klimmt C, Ritterfeld U (2006) Enjoyment: at the heart of media entertainment. Commun Theory 14(4):388–408

    Article  Google Scholar 

  • Walter M (1973) Toward a cognitive learning reconceptualization of personality. Psychol Rev 80(4):252–283

    Article  Google Scholar 

  • Wright BD (1968) Sample-free test calibration and person measurement. Paper presented at the National Seminar on Adult Education Research, Chicago, IL

  • Wright BD (1984) Despair and hope for educational measurement. Contemp Educ Rev 3(1):281–288

    Google Scholar 

  • Wright BD (1996) Reliability and separation. Rasch Meas Trans 9(4):472

    Google Scholar 

  • Wright BD, Stone MH (1979) Best test design. Mesa Press, Chicago

    Google Scholar 

  • Write BD, Stone MH (2004) Making measures. Phaneron Press, Chicago, IL

    Google Scholar 

  • Zeldin A, Britner S, Pajares F (2007) A comparative study of the self-efficacy beliefs of successful men and women in mathematics, science and technology careers. J Res Sci Teach 45(9):1036–1058

    Article  Google Scholar 

  • Zimmerman B (1997) Social origins of self-regulatory competence. Educ Psychol 32(4):195–208

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Teaching and Learning, Washington State University, 321 Cleveland Hall, Pullman, WA, 99164, USA

    Richard L. Lamb

  2. Department of Teaching and Learning, University of Nevada Las Vegas, Las Vegas, NV, 89109, USA

    David Vallett

  3. College of Education and Human Development, George Mason University, 4400 University Dr., Fairfax, VA, 22036, USA

    Leonard Annetta

Authors
  1. Richard L. Lamb
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. David Vallett
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Leonard Annetta
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Richard L. Lamb.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Lamb, R.L., Vallett, D. & Annetta, L. Development of a Short-Form Measure of Science and Technology Self-efficacy Using Rasch Analysis. J Sci Educ Technol 23, 641–657 (2014). https://doi.org/10.1007/s10956-014-9491-y

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10956-014-9491-y

Keywords

Search

Navigation