Treatment Integrity in Interventions That Target the Executive Function

  • Andrew Livanis
  • Ayla Mertturk
  • Samantha Benvenuto
  • Christy Ann Mulligan


Executive function (EF) refers to a broad cognitive process used to direct behavior specifically in situations where some responses must be inhibited and others need to be initiated (Banich, 2009). Definitions of EF tend to involve reference to the frontal lobe (Hayes, Gifford, & Ruckstuhl, 1996), so much so that it is difficult to feature a definition that does not reference this area of the brain. While there are some differences in the definition of the construct, recent research suggests that EF is a unidimensional construct (Goldstein, 2012) and includes components of such cognitive processes such as planning, goal persistency, cognitive flexibility, abstract thinking, and rule acquisition (Baltruschat et al., 2011).


Executive Function Frontal Lobe Treatment Agent Operational Definition Treatment Integrity 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. Allen, K. D., & Warzak, W. J. (2000). The problem of parental non-adherence in clinical behavior analysis: Effective treatment is not enough. Journal of Applied Behavior Analysis, 33(3), 373–391. doi: 10.1901/jaba.2000.33-373.PubMedCrossRefGoogle Scholar
  2. Alloway, T., Gathercole, S. E., Holmes, J., Place, M., Elliott, J. G., & Hilton, K. (2009). The diagnostic utility of behavioral checklists in identifying children with ADHD and children with working memory deficits. Child Psychiatry and Human Development, 40(3), 353–366.PubMedCrossRefGoogle Scholar
  3. American Psychiatric Association. (2000). Diagnostic and statistical manual of mental disorders (4th ed., text rev.). Washington, DC: Author.Google Scholar
  4. American Psychological Association. (2005, August). Policy statement on evidence-based practice in psychology. Retrieved from Scholar
  5. American Speech-Language-Hearing Association. (2010). Code of ethics [Ethics]. doi: 10.1044/policy.ET2010-00309
  6. Baltruschat, L., Hasselhorn, M., Tarbox, J., Dixon, D. R., Najdowski, A. C., Mullins, R. D., et al. (2011). Addressing working memory in children with autism through behavioral intervention. Research in Autism Spectrum Disorders, 5, 267–276. doi: 10.1016/j.rasd.2010.04.008.CrossRefGoogle Scholar
  7. Banich, M. T. (2009). Executive function: The search for an integrated account. Current Directions in Psychological Science, 18(2), 89–94.CrossRefGoogle Scholar
  8. Barber, J. P., Gallop, R., Crits-Chirstoph, P., Frank, A., Thase, M. E., Weiss, R. D., et al. (2006). The role of therapist adherence, therapist competence, and alliance in predicting outcome of individual drug counseling: Results from the National Institute Drug Abuse Collaborative Cocaine Treatment Study. Psychotherapy Research, 16, 229–240. doi: 10.1080/10503300500288951.CrossRefGoogle Scholar
  9. Barkley, R. A. (1997). Behavioral inhibition, sustained attention, and executive functions: Constructing a unifying theory of ADHD. Psychological Bulletin, 121(1), 65–94.PubMedCrossRefGoogle Scholar
  10. Buckner, R. L. (2004). Memory and executive function in aging and AD: Multiple factors that cause decline and reserve factors that compensate. Neuron, 44(1), 195–208. doi: 10.1016/j.neuron.2004.09.006.PubMedCrossRefGoogle Scholar
  11. Burgio, L. D., Engel, B. T., Hawkins, A. M., McCormick, K., Schieve, A., & Jones, L. T. (1990). A staff management system for maintaining improvements in continence with elderly nursing home residents. Journal of Applied Behavior Analysis, 23, 111–118. doi: 10.1901/jaba.1990.23-111.PubMedCrossRefGoogle Scholar
  12. Cochrane, W. S., & Laux, J. M. (2008). A survey investigating school psychologists’ measurement of treatment integrity in school-based interventions and their beliefs in their importance. Psychology in the Schools, 45, 499–507. doi: 10.1002/pits.20319.CrossRefGoogle Scholar
  13. Codding, R. S., Feinberg, A. B., Dunn, E. K., & Pace, G. M. (2005). Effects of immediate performance feedback on implementation of behavior support plans. Journal of Applied Behavior Analysis, 38, 205–219. doi: 10.1901/jaba.2005.98-04.PubMedCrossRefGoogle Scholar
  14. Codding, R. S., Livanis, A., Pace, G., & Vaca, L. (2008). Using performance feedback to improve treatment integrity of classwide behavior plans: An investigation of observer reactivity. Journal of Applied Behavior Analysis, 41, 417–422. doi: 10.1901/jaba.2008.41-417.PubMedCrossRefGoogle Scholar
  15. Cook, C. R., Mayer, G. M., Wright, D. B., Kraemer, B., Wallace, M. D., Dart, E., et al. (2010). Exploring the link among behavior intervention plans, treatment integrity, and student outcomes under natural educational outcomes. Journal of Special Education, 20, 1–14. doi: 10.1177/0022466910369941.Google Scholar
  16. Cooper, J. O., Heron, T. E., & Heward, W. L. (2007). Applied behavior analysis (2nd ed.). Upper Saddle River, NJ: Merrill Prentice-Hall.Google Scholar
  17. Cowan, R. J., & Sheridan, S. M. (2003). Investigating the acceptability of behavioral interventions in applied conjoint behavioral consultation: Moving from analog conditions to naturalistic settings. School Psychology Quarterly, 18(1), 1–21.CrossRefGoogle Scholar
  18. Coyle, C., & Cole, P. (2004). A video-taped self-modeling and self-monitoring treatment program to decrease off-task behaviour in children with autism. Journal of Intellectual and Developmental Disability, 29, 3–15. doi: 10.1080/08927020410001662642.CrossRefGoogle Scholar
  19. Denckla, M. B. (2007). Executive function: Building together the definitions of attention deficit/hyperactivity disorder and learning disabilities. In L. Metzler (Ed.), Executive function in education (pp. 5–18). New York: Guilford Press.Google Scholar
  20. Detrich, R. (2008). Evidence-based, empirically supported, or best practice? A guide for the scientist-practitioner. In J. K. Luiselli, D. C. Russo, W. P. Christian, & S. M. Wilczynski (Eds.), Effective practices for children with autism (pp. 3–25). New York: Oxford Press.Google Scholar
  21. DiGennaro, F. D., Martens, B. K., & Kleinman, A. E. (2007). A comparison of performance feedback procedures on teachers’ treatment implementation integrity and students’ inappropriate behavior in special education classrooms. Journal of Applied Behavior Analysis, 40, 447–461. doi: 10.1901/jaba.2007.40-447.PubMedCrossRefGoogle Scholar
  22. DiGennaro, F. D., Martens, B. K., & McIntyre, L. L. (2005). Increasing treatment integrity through negative reinforcement: Effects on teacher and student behavior. School Psychology Review, 34(2), 220–231.Google Scholar
  23. DiGennaro-Reed, F. D., Codding, R., Catania, C. N., & MaGuire, H. (2010). Effects of video modeling on treatment integrity of behavioral interventions. Journal of Applied Behavior Analysis, 43, 291–295. doi: 10.1901/jaba.2010.43-291.PubMedCrossRefGoogle Scholar
  24. Duarte, A., Hayasaka, S., Du, A., Schuff, N., Jahng, G., Kramer, J., et al. (2006). Volumetric correlates of memory and executive function in normal elderly, mild cognitive impairment and Alzheimer’s disease. Neuroscience Letters, 406(1–2), 60–65. doi: 10.1016/j.neulet.2006.07.029.PubMedCrossRefGoogle Scholar
  25. Dusenbury, L., Brannigan, R., Falco, M., & Hansen, W. B. (2003). A review of research on fidelity of implementation: Implications for drug abuse prevention in school settings. Health Education Research: Theory and Practice, 18(2), 237–256. doi: 10.1093/her/18.2.237.CrossRefGoogle Scholar
  26. Eisenberg, D., & Berman, K. (2010). Executive function, neural circuitry, and genetic mechanisms in schizophrenia. Neuropsychopharmacology, 35(1), 258–277. doi: 10.1038/npp.2009.111.PubMedCrossRefGoogle Scholar
  27. Eliot, L. (1999). What’s going on in there?: How the brain and mind develop in the first five years of life. New York: Bantam.Google Scholar
  28. Elliot, S. N. (1988). Acceptability of behavioral treatments in educational settings. In J. C. Witt, S. N. Elliott, & F. M. Gresham (Eds.), Handbook of behavior therapy (pp. 121–150). New York: Plenum Press.CrossRefGoogle Scholar
  29. Erhardt, K. E., Barnett, D. W., Lentz, F. E., Stollar, S. A., & Raifin, L. H. (1996). Innovative methodology in ecological consultation: Use of scripts to promote treatment acceptability and integrity. School Psychology Quarterly, 11, 149–168. doi: 10.1037/h0088926.CrossRefGoogle Scholar
  30. Etchdeit, S. K. (2006). Behavioral intervention plans: Pedagogical and legal analysis of themes. Behavior Disorders, 31(2), 223–243.Google Scholar
  31. Foster, S., & Cone, J. (1986). Design and use of direct observation. In A. Ciminero, K. Calhoun, & H. Adams (Eds.), Handbook of behavioral assessment (2nd ed., pp. 253–324). New York: Wiley Interscience.Google Scholar
  32. Gathercole, S. E., Alloway, T. P., Kirkwood, H. J., Elliott, J. G., Holmes, J., & Hilton, K. A. (2008). Attentional and executive function behaviours in children with poor working memory. Learning and Individual Differences, 18, 214–223.CrossRefGoogle Scholar
  33. Goldstein, S. (2012). Understanding executive functioning in children: New ideas, new data, effective education and the Comprehensive Executive Functioning Inventory [PowerPoint slides] (S. Goldstein, personal communication, August 5, 2012).Google Scholar
  34. Greene, R. W. (2001). The explosive child: A new approach for understanding and parenting easily frustrated, chronically inflexible children. New York: Perennial.Google Scholar
  35. Greene, R. W., & Albon, J. S. (2006). Treating explosive kids: The collaborative problem solving approach. New York: Guilford Press.Google Scholar
  36. Gresham, F. M. (1996). Treatment integrity in single-subject research. In R. D. Franklin, D. B. Allison, & B. S. Gorman (Eds.), Design and analysis of single-case research (pp. 93–117). Mahwah, NJ: Lawrence Erlbaum.Google Scholar
  37. Gresham, F. M. (2005). Treatment integrity and therapeutic change: Commentary on Perepletchikova and Kazdin. Clinical Psychology: Science and Practice, 12(4), 391–394. doi: 10.1093/clipsy/bpi048.CrossRefGoogle Scholar
  38. Guercio, J. M., Dixon, M. R., Soldner, J., Shoemaker, Z., Zlomke, K., Root, S., et al. (2005). Enhancing staff performance measures in an acquired brain injury setting: Combating the habituation to organizational behavioral interventions. Behavioral Interventions, 20, 91–99. doi: 10.1002/bin.174.CrossRefGoogle Scholar
  39. Hale, J. B., Reddy, L. A., Wilcox, G., McLaughlin, A., Hain, L., Stern, A., et al. (2009). Assessment and intervention for children with ADHD and other frontal-striatal circuit disorders. In D. C. Miller (Ed.), Best practices in school neuropsychology: Guidelines for effective practice, assessment and evidence-based interventions (pp. 225–280). New York, NY: Wiley.Google Scholar
  40. Happe, D. (1982). Behavior intervention: It doesn’t do any good in your briefcase. In J. Grimes (Ed.), Psychological approaches to problems of children and adolescents (pp. 15–41). Des Moines, IA: Iowa Department of Public Instruction.Google Scholar
  41. Hausdorff, J. M., Doniger, G. M., Springer, S., Yogev, G., Simon, E. S., & Giladi, N. (2006). A common cognitive profile in elderly fallers and in patients with Parkinson’s disease: The prominence of impaired executive function and attention. Experimental Aging Research, 32(4), 411–429. doi: 10.1080/03610730600875817.PubMedCrossRefGoogle Scholar
  42. Hayes, S. C., Gifford, E. V., & Ruckstuhl, L. E. (1996). Relational frame theory and executive function: A behavioral approach. In G. R. Lyon & N. A. Krasnegor (Eds.), Attention, memory, and executive function. Baltimore, MD: Brookes.Google Scholar
  43. Hayes, S. C., & Wilson, K. G. (1993). Some applied implications of a contemporary behavior analytic account of verbal events. Behavior Analyst, 16(2), 283–301.PubMedGoogle Scholar
  44. Hogue, A., Henderson, C. E., Dauber, S., Barajas, P. C., Fried, A., & Liddle, H. A. (2008). Treatment adherence, competence, and outcome in individual and family therapy for adolescent behavior problems. Journal of Consulting and Clinical Psychology, 76(4), 544–555. doi: 10.1037/0022-006X.76.4.544.PubMedCrossRefGoogle Scholar
  45. IDEA of 2004, P.L. 108–446, § 665 [b][1][B], 118 Stat. 2787 (2005).Google Scholar
  46. Kazdin, A. E. (1986). Comparative outcome studies of psychotherapy: Methodological issues and strategies. Journal of Consulting and Clinical Psychology, 54, 95–105. doi: 10.1037/0022-006X.54.1.95.PubMedCrossRefGoogle Scholar
  47. Kazdin, A. E. (2011). Single-case research designs. New York: Oxford University Press.Google Scholar
  48. LeBlanc, M., Ricciardi, J. N., & Luiselli, J. K. (2005). Improving discrete trial instruction by paraprofessional staff through an abbreviated performance feedback intervention. Education and Treatment of Children, 28(1), 76–82.Google Scholar
  49. Leeds, L., Meara, R. J., Woods, R., & Hobson, J. P. (2001). A comparison of the new executive functioning domains of the CAMCOG-R with existing tests of executive function in elderly stroke survivors. Age and Ageing, 30(3), 251–254. doi: 10.1093/ageing/30.3.251.PubMedCrossRefGoogle Scholar
  50. Livanis, A., Benvenuto, S., Mertturk, A., & Hanthorn, C. (in press). Treatment integrity in autism spectrum disorder interventions. In S. Goldstein (Ed.), Interventions for autism spectrum disorders.Google Scholar
  51. McClelland, M. M., Cameron, C. E., Connor, C., Farris, C. L., Jewkes, A. M., & Morrison, F. J. (2007). Links between behavioral regulation and preschoolers’ literacy, vocabulary, and math skills. Developmental Psychology, 43(4), 947–959.PubMedCrossRefGoogle Scholar
  52. McCloskey, G., Perkins, L. A., & Van Divner, B. (2009). Assessment and intervention for executive function difficulties. New York: Routledge.Google Scholar
  53. McLeod, B. D., Southam-Gerow, M. A., & Weisz, J. R. (2009). Conceptual and methodological issues in treatment integrity measurement. School Psychology Review, 38(4), 541–546.Google Scholar
  54. Meichenbaum, D., & Turk, D. C. (1987). Facilitating treatment adherence: A practitioner’s guidebook. New York: Plenum Press.CrossRefGoogle Scholar
  55. Miyake, A., & Friedman, N. P. (2012). The nature and organization of individual differences in executive functions: Four general conclusions. Current Directions in Psychological Science, 21(1), 8–14. doi: 10.1177/0963721411429458.PubMedCrossRefGoogle Scholar
  56. Mortensen, B. P., & Witt, J. C. (1998). The use of weekly performance feedback to increase teacher implementation of a prereferral intervention. School Psychology Review, 27, 613–627.Google Scholar
  57. Mouzakitis, A. (2010). The effects of self-monitoring training and performance feedback on the treatment integrity of behavior support plans for children with autism. Unpublished doctoral dissertation, The Graduate Center of the City University of New York, New York.Google Scholar
  58. National Association of School Psychologists. (2010). Principles for professional ethics. Retrieved from
  59. Nezu, A. M., & Nezu, C. M. (2008). Treatment integrity. In D. McKay (Ed.), Handbook of research methods in abnormal and clinical psychology (pp. 351–363). New York: Sage.Google Scholar
  60. Noell, G. H., Witt, J. C., Gilbertson, D. N., Ranier, D. D., & Freeland, J. T. (1997). Increasing teacher interventions implementation in general education settings through consultation and performance feedback. School Psychology Quarterly, 12, 77–88. doi: 10.1037/h0088949.CrossRefGoogle Scholar
  61. Noell, G. H., Witt, J. C., LaFleur, L. H., Mortenson, B. P., Ranier, D. D., & LeVelle, J. (2000). Increasing intervention implementation in general education following consultation: A comparison of two follow-up strategies. Journal of Applied Behavior Analysis, 33, 271–284. doi: 10.1901/jaba.2000.33-271.PubMedCrossRefGoogle Scholar
  62. Perepletchikova, F., & Kazdin, A. E. (2005). Treatment integrity and therapeutic change: Issues and research recommendations. Clinical Psychology: Science and Practice, 12(4), 365–383. doi: 10.1093/clipsy/bpi045.CrossRefGoogle Scholar
  63. Petscher, E. S., & Bailey, J. S. (2006). Effects of training, prompting and self-monitoring on staff behavior in a classroom for students with disabilities. Journal of Applied Behavior Analysis, 39, 215–226. doi: 10.1901/jaba.2006.02-05.PubMedCrossRefGoogle Scholar
  64. Posner, M. I., & Rothbart, M. K. (2007). Educating the human brain. Washington, DC: American Psychological Association.CrossRefGoogle Scholar
  65. Reed, F. D., & Codding, R. S. (2011). Intervention integrity assessment. In J. K. Luiselli (Ed.), Teaching and behavior support for children and adults with autism spectrum disorder (pp. 38–47). New York: Oxford University Press.Google Scholar
  66. Richman, G. S., Riordan, M. R., Reiss, M. L., Piles, D. A. M., & Bailey, J. S. (1988). The effects of self-monitoring and supervisor feedback on staff performance in a residential setting. Journal of Applied Behavior Analysis, 21, 401–409. doi: 10.1901/jaba.1988.21-401.PubMedCrossRefGoogle Scholar
  67. Schulte, A. C., Easton, J. E., & Parker, J. (2009). Advances in treatment integrity research: Multidisciplinary perspectives on the conceptualization, measurement, and enhancement of treatment integrity. School Psychology Review, 38(4), 460–475.Google Scholar
  68. Scope, A., Empson, J., & McHale, S. (2010). Executive function in children with high and low attentional skills: Correspondences between behavioural and cognitive profiles. British Journal of Developmental Psychology, 28(2), 293–305.PubMedCrossRefGoogle Scholar
  69. Simonsen, C., Sundet, K., Vaskinn, A., Birkenaes, A. B., Engh, J. A., Hansen, C., et al. (2008). Neurocognitive profiles in bipolar I and bipolar II disorder: Differences in pattern and magnitude of dysfunction. Bipolar Disorders, 10(2), 245–255. doi: 10.1111/j.1399-5618.2007.00492.x.PubMedCrossRefGoogle Scholar
  70. Steinberg, L. (2007). Risk taking in adolescence: New perspectives from brain and behavioral science. Current Directions in Psychological Science, 16, 55–59.CrossRefGoogle Scholar
  71. Teuber, H. L. (1972). Unity and diversity of frontal lobe functions. Acta Neurobiologiae Experimentalis, 32, 615–656.PubMedGoogle Scholar
  72. Wheeler, J. J., Baggett, B. A., Fox, J., & Blevins, L. (2006). Treatment integrity: A review of intervention studies conducted with children with autism. Focus on Autism and Other Developmental Disabilities, 21(1), 45–54. doi: 10.1177/10883576060210010601.CrossRefGoogle Scholar
  73. Witt, J. C., Moe, G., Gutkin, T. B., & Andrews, L. (1984). The effect of saying the same thing in different ways: The problem of language and jargon in school-based consultation. Journal of School Psychology, 22, 361–367. doi: 10.1016/0022-4405(84)90023-2.CrossRefGoogle Scholar
  74. Witt, J. C., Noell, G. H., LaFleur, L. H., & Mortenson, B. P. (1997). Teacher use of interventions in general education: Measurement and analysis of the independent variable. Journal of Applied Behavior Analysis, 30, 693–696. doi: 10.1901/jaba.1997.30-693.CrossRefGoogle Scholar
  75. Yeaton, W. H., & Sechrest, L. (1981). Critical dimensions in the choice and maintenance of successful treatments: Strength, integrity, and effectiveness. Journal of Consulting and Clinical Psychology, 49(2), 156–167. doi: 10.1037/0022-006X.49.2.156.PubMedCrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media New York 2014

Authors and Affiliations

  • Andrew Livanis
    • 1
  • Ayla Mertturk
    • 1
  • Samantha Benvenuto
    • 1
  • Christy Ann Mulligan
    • 1
  1. 1.Long Island University—BrooklynBrooklynUSA

Personalised recommendations