Abstract
Working memory training research has produced mixed results in terms of finding benefits beyond the trained tasks (i.e., transfer). One potential limitation is that the research thus far has failed to isolate the specific combination of factors that makes working memory training work best. Individual differences in cognitive ability at pretest may be an important factor, suggesting possible aptitude-by-treatment interactions. Baseline cognitive ability could be (a) positively related, (b) negatively related, or (c) unrelated to training task improvements. The relationship between ability and training gains is important given the idea that larger training improvements should lead to greater transfer. However, the majority of training studies tend to be under-powered to examine individual differences. We pooled studies conducted in related labs to increase power while minimizing differences between studies. In the studies that were identified for this project, young adults completed complex span training and working memory and/or fluid intelligence as pretest measures. The combined samples from seven studies resulted in a sample of 192 participants. Analyses focused on the relationship between pretest cognitive ability and training performance across training days. There was no evidence that individuals lower in cognitive ability improved more than high-ability subjects on the training tasks. Instead, we found a positive relationship for both working memory and fluid intelligence measured at pretest with the amount of training improvement. In addition, the association between pretest working memory and working memory training performance appears to be domain-general—verbal and visuospatial content do not produce differential relationships.
Similar content being viewed by others
Notes
No studies presented here used multiple Gf tasks; therefore, calculation of composites was not necessary.
One of the four models, the WM pretest with verbal training model, was initially inconclusive with the default lmer settings. A control option was added with the Optimx package (Nash and Varadhan 2011) which allowed the model to function properly, with minimal adjustments. Fixed effect estimates were identical to the 7th decimal place. The mathematical model is identical.
References
*Indicates Data Source
Au, J., Sheehan, E., Tsai, N., Duncan, G. J., Buschkuehl, M., & Jaeggi, S. M. (2015). Improving fluid intelligence with training on working memory: a meta-analysis. Psychonomic Bulletin & Review, 22, 366–377. https://doi.org/10.3758/s13423-014-0699-x.
*Blacker, K. J., Negoita, S., Ewen, J. B., & Courtney, S. M. (2017). N-back versus complex span working memory training. Journal of Cognitive Enhancement, 1(4), 434–454. https://doi.org/10.1007/s41465-017-004-1.
Baddeley, A. (2012). Working memory: theories, models, and controversies. Annual Review of Psychology, 63, 1–29. https://doi.org/10.1146/annurev-psych-120710-100422.
Bates, D., Maechler, M., Bolker, B., & Walker, S. (2015). Fitting linear mixed-effects models using lme4. Journal of Statistical Software, 67(1), 1–48. https://doi.org/10.18637/jss.v067.i01.
Broadway, J. M., & Engle, R. W. (2010). Validating running memory span: Measurement of working memory capacity and links with fluid intelligence. Behavior Research Methods, 42(2), 563–570. https://doi.org/10.3758/BRM.42.2.563.
Bürki, C. N., Ludwig, C., Chicherio, C., & de Ribaupierre, A. (2014). Individual differences in cognitive plasticity: an investigation of training curves in younger and older adults. Psychological Research, 78, 821–835. https://doi.org/10.1007/s00426-014-0559-3.
*Chein, J., & Morrison, A. M. (2010). Expanding the mind’s workspace: training and transfer effects with a complex working memory span task. Psychonomic Bulletin & Review, 17(2), 193–199. https://doi.org/10.3758/PBR.17.2.193.
Cowan, N. (2017). The many faces of working memory and short-term storage. Psychonomic Bulletin and Review, 24, 1158–1170. https://doi.org/10.3758/s13423-016-1191-6.
Daneman, M., & Green, I. (1986). Individual differences in comprehending and producing words in context. Journal of Memory and Language, 25(1), 1–18. https://doi.org/10.1016/0749-596X(86)90018-5.
Dunning, D. L., & Holmes, J. (2014). Does working memory training promote the use of strategies on untrained working memory tasks? Memory & Cognition, 42(6), 854–862. https://doi.org/10.3758/s13421-014-0410-5.
Foster, J. L., Harrison, T. L., Hicks, K. L., Draheim, C., Redick, T. S., & Engle, R. W. (2017). Do the effects of working memory training depend on baseline ability level? Journal of Experimental Psychology: Learning, Memory, and Cognition, 43(11), 1677–1689. https://doi.org/10.1037/xlm0000426.
Fuchs, L. S., Schumacher, R. F., Sterba, S. K., Long, J., Namkung, J., Malone, A., et al. (2014). Does working memory moderate the effects of fraction intervention? An aptitude-treatment interaction. Journal of Educational Psychology, 106(2), 499–514. https://doi.org/10.1037/a0034341.
*Gunn, R. L., Gerst, K. R., Wiemers, E. A., Redick, T. S., & Finn, P. R. (2018). Predictors of effective working memory training in those with alcohol use disorders. Alcoholism: Clinical and Experimental Research. https://doi.org/10.1111/acer.13892.
Guye, S., De Simoni, C., & von Bastian, C. C. (2017). Do individual differences predict change in cognitive training performance? A latent growth curve modeling approach. Journal of Cognitive Enhancement, 1, 374–393. https://doi.org/10.1007/s41465-017-0049-9.
*Harrison, T. L., Shipstead, Z., Hicks, K. L., Hambrick, D. Z., Redick, T. S., & Engle, R. W. (2013). Working memory training may increase working memory capacity but not fluid intelligence. Psychological Science, 24(12), 2409–2419. https://doi.org/10.1177/0956797613492984.
Heitz, R. P., Redick, T. S., Hambrick, D. Z., Kane, M. J., Conway, A. R. A., & Engle, R. W. (2006). Working memory, executive function, and general fluid intelligence are not the same. Behavioral and Brain Sciences, 29, 134–135. https://doi.org/10.1017/S0140525X06319036.
Houben, K., Wiers, R. W., & Jansen, A. (2011). Getting a grip on drinking behavior: training working memory to reduce alcohol abuse. Psychological Science, 22(7), 968–975. https://doi.org/10.1177/0956797611412392.
Jaeggi, S. M., Buschkuehl, M., Jonides, J., & Perrig, W. J. (2008). Improving fluid intelligence with training on working memory. Proceedings of the National Academy of Sciences of the United States of America, 105, 6829–6833. https://doi.org/10.1073/pnas.0801268105.
Jaeggi, S. M., Buschkuehl, M., Jonides, J., & Shah, P. (2011). Short- and long-term benefits of cognitive training. Proceedings of the National Academy of Sciences of the United States of America, 108, 10081–10086. https://doi.org/10.1073/pnas.1103228108.
Karbach, J., Könen, T., & Spengler, M. (2017). Who benefits the most? Individual differences in the transfer of executive control training across the lifespan. Journal of Cognitive Enhancement, 1, 394–405. https://doi.org/10.1007/s1465-017-0054-z.
Katz, B., Jones, M. R., Shah, P., Buschkuehl, M., & Jaeggi, S. M. (2016). Individual difference and motivational effects. In T. Strobach & J. Karbach (Eds.), Cognitive training: an overview of features and applications (pp. 157–166). Switzerland: Springer.
Klingberg, T., Fernell, R., Olesen, P. J., Johnson, M., Gustafsson, P., Dahlstrӧm, K., et al. (2005). Computerized training of working memory in children with ADHD – a randomized, controlled trial. Journal of the American Academy of Child and Adolescent Psychiatry, 44(2), 177–186. https://doi.org/10.1097/00004583-200502000-00010.
Kyllonen, P. C., & Stephens, D. L. (1990). Cognitive abilities as determinants of success in acquiring logic skill. Learning and Individual Differences, 2(2), 129–160. https://doi.org/10.1016/1041-6080(90)90020-H.
Lövdén, M., Brehmer, Y., Li, S.-C., & Lindenberger, U. (2012). Training-induced compensation versus magnification of individual differences in memory performance. Frontiers in Human Neuroscience, 6. https://doi.org/10.3389/fnhum.2012.00141.
*Minear, M., Brasher, F., Guerrero, C. B., Brasher, M., Moore, A., & Sukeena, J. (2016). A simultaneous examination of two forms of working memory training: evidence for near transfer only. Memory & Cognition, 44, 1014–1037. https://doi.org/10.3758/s13421-016-06016-9.
Melby-Lervåg, M., Redick, T. S., & Hulme, C. (2016). Working memory training does not improve performance on measures of intelligence or other measures of “far transfer”: evidence from a meta-analytic review. Perspectives on Psychological Science, 11(4), 512–534. https://doi.org/10.1177/1745691616635612.
Morrison, A. B., & Chein, J. M. (2011). Does working memory training work? The promise and challenges of enhancing cognition by training working memory. Psychonomic Bulletin & Review, 18(1), 46–60. https://doi.org/10.3758/s13423-010-0034-0.
Morrison, A. B., Rosenbaum, G. M., Fair, D., & Chein, J. M. (2016). Variation in strategy use across measures of verbal working memory. Memory & Cognition, 44(6), 922–936. https://doi.org/10.3758/s13421-016-0608-9.
Nash, J. C., & Varadhan, R. (2011). Unifying optimization algorithms to aid software system users: Optimx for R. Journal of Statistical Software, 43(9), 1–14. https://doi.org/10.18637/jss.v043.i09.
Redick, T. S., & Lindsey, D. R. B. (2013). Complex span and n-back measures of working memory: a meta-analysis. Psychonomic Bulletin & Review, 20(6), 1102–1113. https://doi.org/10.3758/s13423-013-0453-9.
Redick, T. S., Shipstead, Z., Harrison, T. L., Hicks, K. L., Fried, D. E., Hambrick, D. Z., et al. (2013). No evidence of intelligence improvement after working memory training: a randomized, placebo-controlled study. Journal of Experimental Psychology: General, 142(2), 359–379. https://doi.org/10.1037/a0029082.
Redick, T. S., Shipstead, Z., Wiemers, E. A., Melby-Lervåg, M., & Hulme, C. (2015). What’s working in working memory training? An educational perspective. Educational Psychology Review, 27, 617–633. https://doi.org/10.1007/s10648-015-9314-6.
Redick, T. S., Shipstead, Z., Meier, M. E., Montroy, J. J., Hicks, K. L., Unsworth, N., et al. (2016). Cognitive predictors of a common multitasking ability: contributions from working memory, attention control, and fluid intelligence. Journal of Experimental Psychology: General, 145(11), 1473–1492. https://doi.org/10.1037/xge0000219.
*Redick, T. S., Wiemers, E. A., & Engle, R. W. (under review). The role of proactive interference, variability, and strategy use in working memory training and transfer.
*Richey, J. E., Phillips, J. S., Schunn, C. D., & Schneider, W. S. (2014). Is the link from working memory to analogy causal? No analogy improvements following working memory training gains. PLoS One, 9(9). https://doi.org/10.1371/jounal.pone.0106616.
Rode, C., Robson, R., Purviance, A., Geary, D. C., & Mayr, U. (2014). Is working memory training effective? A study in a school setting. PLoS One, 9(8), e104796. https://doi.org/10.1371/journal.pone.0104796.
Sala, G., & Gobet, F. (2017). Working memory training in typically developing children: a meta-analysis of the available evidence. Developmental Psychology, 53(4), 671–685. https://doi.org/10.1037/dev0000265.
Schmidt, R. A., & Bjork, R. A. (1992). New conceptualizations of practice: common principles in three paradigms suggest new concept for training. Psychological Science, 3(4), 207–217. https://doi.org/10.1111/j.1467-9280.1992.tb00029.x.
Shaywitz, B. A., Holford, T. R., Holahan, J. M., Fletcher, J. M., Stuebing, K. K., Francis, D. J., & Shaywitz, S. E. (1995). A Matthew effect for IQ but not for reading: results from a longitudinal study. Reading Research Quarterly, 30(4), 894–906. https://doi.org/10.2307/748203.
Shipstead, Z., Redick, T. S., & Engle, R. W. (2012). Is working memory training effective? Psychological Bulletin, 138(4), 628–654. https://doi.org/10.1037/a0027473.
Shipstead, Z., Harrison, T., & Engle, R. (2016). Working memory capacity and fluid intelligence. Perspectives on Psychological Science, 11(6), 771–799. https://doi.org/10.1037/a002747.
Shute, V. J. (1991). Who is likely to acquire programming skills? Journal of Educational Computing Research, 7(1), 1–24. https://doi.org/10.2190/VQJD-T1YD-5WVB-RYPJ.
Smoleń, T., Jastrzębski, J., Estrada, E., & Chuderski, A. (2018). Most evidence for the compensation account of cognitive training is unreliable. Memory & Cognition. Advance online publication. https://doi.org/10.3758/s13421-018-0839-z.
Soveri, A., Antfolk, J., Karlsson, L., Salo, B., & Laine, M. (2017). Working memory training revisited: a multi-level meta-analysis of n-back training studies. Psychonomic Bulletin & Review, 24, 1077–1096. https://doi.org/10.3758/s13423-016-1217-0.
Stepankova, H., Lukavsky, J., Buschkuehl, M., Kopecek, M., Ripova, D., & Jaeggi, S. M. (2014). The malleability of working memory and visuospatial skills: A randomized controlled study in older adults. Developmental Psychology, 50(4), 1049–1059. https://doi.org/10.1037/a0034913.
Stephenson, C. L., & Halpern, D. F. (2013). Improved matrix reasoning is limited to training on tasks with a visuospatial component. Intelligence, 41(5), 341–357. https://doi.org/10.1016/j.intell.2013.05.006.
Studer-Luethi, B., Jaeggi, S. M., Buschkuehl, M., & Perrig, W. J. (2012). Influence of neuroticism and conscientiousness on working memory training outcome. Personality and Individual Differences, 53(1), 44–49. https://doi.org/10.1016/j.paid.2012.02.012.
Studer-Luethi, B., Bauer, C., & Perrig, W. J. (2016). Working memory training in children: effectiveness depends on temperament. Memory & Cognition, 44(2), 171–186. https://doi.org/10.3758/s13421-015-0548-9.
Tidwell, J. W., Dougherty, M. R., Chrabaszez, J. R., Thomas, R. P., & Mendoza, J. L. (2014). What counts as evidence for working memory training? Problems with correlated gains and dichotomization. Psychonomic Bulletin & Review, 21, 620–628. https://doi.org/10.3758/s13423-013-0560-7.
Titz, C., & Karbach, J. (2014). Working memory and executive functions: Effects of training on academic achievement. Psychological Research, 78, 852–868. https://doi.org/10.1007/s00426-013-0537-1.
Unsworth, N., & Redick, T.S. (2017). Working memory and intelligence. In J. Wixted (Ed.), Cognitive psychology of memory. Vol. 2 of learning and memory: a comprehensive reference, 4 vols., 2nd edition (J. Byrne, editor). Oxford: Elsevier.
Unsworth, N., Heitz, R. P., Schrock, J. C., & Engle, R. W. (2005). An automated version of the operation span task. Behavior Research Methods, 37, 498–505. https://doi.org/10.3758/BF03192720.
von Bastian, C. C., & Oberauer, K. (2014). Effects and mechanisms of working memory training: a review. Psychological Research, 78, 803–820. https://doi.org/10.1007/s00426-013-0524-6.
Acknowledgements
The research described here was presented at the 2018 annual meeting of the Midwestern Psychological Association and the International Society for Intelligence Research. The data and script used for the models are available from the authors at https://osf.io/peswn/. The authors thank Dr. Kara Blacker, Dr. Jason Chein, Dr. Tyler Harrison, Dr. Meredith Minear, Dr. Elizabeth Richey, and their coauthors, for providing additional data and clarifications from their published studies included in these analyses. The authors also thank Dr. Sean Lane for his assistance with the multi-level modeling analyses.
Funding
While writing this manuscript, EAW and TSR were supported by the National Science Foundation (Award # 1632403) and the National Institutes of Health (Award # 2R01AA013650-11A1).
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of Interest
On behalf of all authors, the corresponding author states that there is no conflict of interest.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Wiemers, E.A., Redick, T.S. & Morrison, A.B. The Influence of Individual Differences in Cognitive Ability on Working Memory Training Gains. J Cogn Enhanc 3, 174–185 (2019). https://doi.org/10.1007/s41465-018-0111-2
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s41465-018-0111-2