Refinement and Psychometric Evaluation of the Executive Skills Questionnaire-Revised
Executive functioning (EF) skills are vital for academic success. Along with the recent explosion of interventions targeting these skills comes the need for affordable, efficient, and ecologically valid measures for planning and tailoring interventions and monitoring outcomes. The current study describes the refinement and initial psychometric evaluation of the Executive Skills Questionnaire-Revised (ESQ-R), a self-report EF rating scale that integrates current scientific understanding of core EF processes with an ecologically valid understanding of EF skills (ESs) that is directly applicable to academic contexts and tasks and tied to available interventions. We describe reduction of an initial 61-item pool to a final 25-item version using a series of exploratory and confirmatory factor analyses with 347 participants. Psychometric evidence for the 25-item version is promising, with excellent internal consistency (alpha = .91), adequate test-retest reliability for a small subsample (.70 with no effects of time delay on score variability), moderate correlations with other EF rating scales (.56–.74) and psychological symptom scales (.38–.55), and a significant correlation with academic engagement (− .40).
KeywordsExecutive functioning Assessment Psychometrics Intervention
The authors received no external funding for this study.
Compliance with Ethical Standards
Conflict of Interest
Julia Englund Strait, Ph.D., declares that she has no conflict of interest.
Peg Dawson, Ed.D., is a co-author of the original ESQ rating scales and the books where they appear.
Christine AP Walther, Ph.D., declares that she has no conflict of interest.
Gerald Gill Strait, Ph.D., declares that he has no conflict of interest.
Amy K. Barton declares that she has no conflict of interest.
Maryellen Brunson McClain, Ph.D., declares that she has no conflict of interest.
All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards.
Informed consent and, when appropriate for age, parental consent and child assent were obtained for all individual participants included in the study in procedures approved by the university IRB (Committee for the Protection of Human Subjects or CPHS).
- Baars, M. A. E., Nije Bijvank, M., Tonnaer, G. H., & Jolles, J. (2015). Self-report measures of executive functioning are a determinant of academic performance in first-year students at a university of applied sciences. Frontiers in Psychology, 6, 1131. https://doi.org/10.3389/fpsyg.2015.01131.CrossRefGoogle Scholar
- Barkley, R. A. (2011). Barkley deficits in executive functioning scale (BDEFS). New York, NY: Guilford Press.Google Scholar
- Barkley, R. A. (2012). Executive functions: what they are, how they work, and why they evolved. In Choice (Vol. 50, p. 762). https://doi.org/10.5860/CHOICE.50-2366.
- Biederman, J., Petty, C. R., Fried, R., Doyle, A. E., Mick, E., Aleardi, M., Monuteaux, M. C., Seidman, L. J., Spencer, T., Faneuil, A. R., Holmes, L., & Faraone, S. V. (2008). Utility of an abbreviated questionnaire to identify individuals with ADHD at risk for functional impairments. Journal of Psychiatric Research, 42(4), 304–310. https://doi.org/10.1016/j.jpsychires.2006.12.004.CrossRefGoogle Scholar
- Dawson, P., & Guare, R. (2010). Executive skills in children and adolescents: A practical guide to assessment and intervention. Guilford Press.Google Scholar
- Dawson, P., & Guare, R. (2012). Coaching students with executive skills deficits. New York, NY: Guilford Press.Google Scholar
- Dawson, P., & Guare, R. (2018). Executive skills in children and adolescents: A practical guide to assessment and intervention (3rd ed.). New York: Guilford Press.Google Scholar
- Dehn, M. (2008). Working memory and academic learning. Hoboken, NJ: John Wiley & Sons, Ltd..Google Scholar
- DeVellis, R. F. (2017). Scale development. SAGE publications. https://doi.org/10.1017/CBO9781107415324.004
- Diamond, A. (2014). Executive functions. Annual Review of Clinical Psychology, 64, 135–168. https://doi.org/10.1146/annurev-psych-113011-143750.Executive.CrossRefGoogle Scholar
- Holst, Y., & Thorell, L. B. (2018). Adult executive functioning inventory (ADEXI): Validity, reliability, and relations to ADHD. International Journal of Methods in Psychiatric Research, 27(1). https://doi.org/10.1002/mpr.1567.
- Lezak, M. D. (1995). Neuropsychological assessment (3rd ed.). New York: Oxford University Press.Google Scholar
- Lovibond, S. H., & Lovibond, P. F. (1995). Manual for the depression anxiety stress scales (2nd ed.). Sydney: Psychology Foundation.Google Scholar
- Miyake, A., Friedman, N. P., Emerson, M. J., Witzki, A. H., Howerter, A., & Wager, T. D. (2000). The Unity and Diversity of executive functions and their contributions to complex “frontal lobe” tasks: A latent variable analysis. Cognitive Psychology, 41(1), 49–100. https://doi.org/10.1006/cogp.1999.0734.CrossRefGoogle Scholar
- Muthén, L. K., & Muthén, B. O. (2013). Mplus 7.11. Los Angeles, CA: Muthén & Muthén.Google Scholar
- Reynolds, C. R., & Kamphaus, R. W. (2015). Behavior Assessment Systems for Children: Third Edition (BASC-3) (3rd ed.). Bloomington, MN: Pearson.Google Scholar
- Roth, R. M. (2005). Behavior rating inventory of executive function—adult version. Lutz, Florida: Psychological Assessment Resources, Inc.Google Scholar
- Sinclair, S. J., Siefert, C. J., Slavin-Mulford, J. M., Stein, M. B., Renna, M., & Blais, M. A. (2012). Psychometric evaluation and normative data for the depression, anxiety, and stress Scales-21 (DASS-21) in a nonclinical sample of U.S. adults. Evaluation & the Health Professions, 35(3), 259–279. https://doi.org/10.1177/0163278711424282.CrossRefGoogle Scholar
- Toplak, M. E., West, R. F., & Stanovich, K. E. (2013). Practitioner review: Do performance-based measures and ratings of executive function assess the same construct? Journal of Child Psychology and Psychiatry and Allied Disciplines, 54(2), 131–143. https://doi.org/10.1111/jcpp.12001.CrossRefGoogle Scholar
- Visser, P. S., Krosnick, J. O. N. A., Lavraws, P. J., Visser, P. S., Krosnick, J. O. N. A., & Lavraws, P. J. (2000). Survey research. In H. T. Reis & C. M. Judd (Eds.), Handbook of research methods in social psychology (pp. 223–252). New York: Cambridge University Press.Google Scholar
- Weinstein, C. E., Palmer, D. R., & Schulte, A. C. (1987). Learning and study strategies inventory (LASSI). Clearwater, FL: H & H.Google Scholar