Predicting GPAs with Executive Functioning Assessed by Teachers and by Adolescents Themselves
The European Educational Researcher, Volume 2, Issue 3, 2019, pp. 173-194
OPEN ACCESS VIEWS: 330 DOWNLOADS: 226 Publication date: 15 Oct 2019
OPEN ACCESS VIEWS: 330 DOWNLOADS: 226 Publication date: 15 Oct 2019
Executive functions (EFs) show promise as important mediators of adolescent academic performance. However, the expense of measuring EFs accurately has restricted most field-based research on them to smaller, non-longitudinal studies of homogeneous populations with specific diagnoses. We therefore monitored the development of 259 diverse, at-risk students’ EFs as they progressed from 6th through 12th grade. Teachers completed the Behavior Rating Inventory of Executive Function (BRIEF) for a random subset of their students. At that same time, those same students completed the Behavior Rating Inventory of Executive Function-Self Report (BRIEF-SR) about themselves; teachers generally reported stronger EFs in students than students reported in themselves. Results further indicated that both BRIEF and BRIEF-SR Global Executive Composite (GEC) scores—measures of overall executive functioning—significantly predicted overall GPAs more than was already predicted by students’ gender, IEP status, and eligibility for free/reduced school lunch. BRIEF (teacher) scores were better predictors and contributed more to predictive accuracy than the BRIEF-SR (student) scores; BRIEF scores even added additional predictiveness to a model already containing BRIEF-SR scores, while the reverse did not hold. This study provides evidence for valid use of BRIEF and BRIEF-SR GEC scores to predict middle and high school GPAs, thereby supporting practitioners use for this purpose within similar, diverse, at-risk populations. The study also illuminates some of the EF development for this population during adolescence.
Academic performance, adolescence, Behavior Rating Inventory of Executive Function, executive function, GPA, longitudinal, validity
Samuels, W. E., Tournaki, N., Sacks, S., Sacks, J., Blackman, S., Byalin, K., & Zilinski, C. (2019). Predicting GPAs with Executive Functioning Assessed by Teachers and by Adolescents Themselves. The European Educational Researcher, 2(3), 173-194. https://doi.org/10.31757/euer.232
- Achenbach, T. M., McConaughy, S. H., & Howell, C. T. (1987). Child/adolescent behavioral and emotional problems: Implications of cross-informant correlations for situational specificity. Psychological Bulletin, 101(2), 213 – 232. doi: 10.1037/0033-2909.101.2.213
- Ahmed, S. F., Tang, S., Waters, N. E., & Davis-Kean, P. (2018). Executive function and academic achievement: Longitudinal relations from early childhood to adolescence Journal of Educational Psychology, 13 pp. doi: 10.1037/edu0000296
- Alloway, T. P., Gathercole, S. E., Adams, A.-M., & Willis, C. (2005). Working memory abilities in children with special educational needs. Educational and Child Psychology, 22(4), 56 – 67.
- Andersson, U. (2008). Working memory as a predictor of written arithmetical skills in children: The importance of central executive functions. British Journal of Educational Psychology, 78, 181 – 204.
- Baron, I. S. (2000). Test review: Behavior rating inventory of executive function. Child Neuropsychology, 6(3), 235 – 238. doi:10.1076/chin.184.108.40.20652
- Bierman, K. L., Torres, M. M., Domitrovich, C. E., Welsh, J. A., & Gest, S. D. (2009). Behavioral and cognitive readiness for school: Cross-domain associations for children attending Head Start. Social Development, 18, 305 – 323.
- Berlin, L. & Bohlin, G. (2002). Response inhibition, hyperactivity, and conduct problems among preschool children. Journal of Clinical Child & Adolescent Psychology, 31, 242 – 251.
- Best, J. R. & Miller, P. H. (2010). A developmental perspective on executive function. Child Development, 81(6), 1641 – 1660. doi: 10.1111/j.1467-8624.2010.01499.x
- Best, J. R., Miller, P. H., & Naglieri, J. A. (2011). Relations between executive function and academic achievement from ages 5 to 17 in a large, representative national sample. Learning and Individual Differences, 21(4), 327 – 336. doi: 10.1016/j.lindif.2011.01.007
- Blair, C. & Raver, C. C. (2012). Individual development and evolution: Experiential canalization of self-regulation. Developmental Psychology, 48(3), 647 – 657. doi: 10.1037/a0026472
- Boschloo, A., Krabbendam, L., Aben, A., de Groot, R., & Jolles, J. (2014). Sorting Test, Tower Test, and BRIEF-SR do not predict school performance of healthy adolescents in preuniversity education. Frontiers in Psychology, 5, 1 – 8 doi: 10.3389/fpsyg.2014.00287
- Brock, K. C. & Bohlin, G. (2004). Executive functions in children aged 6 to 13: A dimensional and developmental study. Developmental Neuropsychology, 26(2), 571 – 593.
- Buckner, J. C., Mezzacappa, E., & Beardslee, W. R. (2003). Characteristics of resilient youths living in poverty: The role of self-regulatory processes. Development and Psychopathology, 15, 139 – 162.
- Carlson, S. M. (2005). Developmentally sensitive measures of executive function in preschool children. Developmental Neuropsychology, 28, 595 – 616.
- Carlson, S. M. & Moses, L. J. (2001). Individual differences in inhibitory control and children’s theory of mind. Child Development, 72, 1032 – 1053.
- Chevignard, M. P., Soo, C., Galvin, J., Catroppa, C., & Eren, S. (2012). Ecological assessment of cognitive functions in children with acquired brain injury: A systematic review. Brain Injury, 26(9), 1033 – 1057. doi: 10.3109/02699052.2012.666366
- Clark, C. A. C., Pritchard, V. E., & Woodward, L. J. (2010). Preschool executive functioning abilities predict early mathematics achievement. Developmental Psychology, 46(5), 1176 – 1191. doi: 10.1037/a0019672
- Conklin, H. M., Luciana, M., Hooper, C. J., & Yarger, R. S. (2007). Working memory performance in typically developing children and adolescents: Behavioral evidence of protracted frontal lobe development. Developmental Neuropsychology, 31(1), 103 – 128.
- Prince, A. P., Weinberg, K. M., & Combs, M. D. (2009). Executive function performance and trauma exposure in a community sample of children. Child Abuse & Neglect, 33, 353 – 361.
- Diamantopoulou, S., Rydell, A.-M., Thorell, L. B., & Bohlin, G. (2007). Impact of executive functioning and symptoms of attention deficit hyperactivity disorder on children's peer relations and school performance. Developmental Neuropsychology, 32(1), 521 – 542. doi: 10.1080/87565640701360981
- Diamond, A. & Lee, K. (2011). Interventions shown to aid executive function development in children 4 to 12 years old. Science, 333, 959 – 964. doi: 10.1126/science.1204529
- Dilworth-Bart, J. E. (2012). Does executive function mediate SES and home quality associations with academic readiness? Early Childhood Research Quarterly, 27, 416 – 425.
- Donders, J., Denbraber, D., & Nos, L. (2010). Construct and criterion validity of the Behaviour Rating Inventory of Executive Function (BRIEF) in children referred for neuropsychological assessment after paediatric traumatic brain injury. Journal of Neuropsychology, 4(2), 197 – 209. doi: 10.1348/174866409X478970
- Dunn, J. R. (2010). Health behavior vs the stress of low socioeconomic status and health outcomes. Journal of the American Medical Association, 303, 1199 – 1200.
- Dunning, D., Johnson, K., Ehrlinger, J., & Kruger, J. (2003). Why people fail to recognize their own incompetence. Current Directions in Psychological Science, 12(3), 83 – 87. doi: 10.1111/1467-8721.01235
- Garon, N., Bryson, S. E., & Smith, I. M. (2008). Executive function in preschoolers: A review and integrative framework. Psychological Bulletin, 134, 31 – 60.
- Geiser, S. & Santelices, M. V. (2007). Validity of high-school grades in predicting student success beyond the freshman year: High-school record vs. standardized tests as indicators of four-year college outcomes. Research & Occasional Paper Series: CSHE.6.07.
- Gelman, A., Hill, J., & Yajima, M. (2012). Why we (usually) don’t have to worry about multiple comparisons. Journal of Research on Educational Effectiveness, 5, 189 – 211.
- Gioia, G. A., Isquith, P. K., Guy, S. C., & Kenworthy, L., (2000). Behavior Rating Inventory of Executive Function: Professional manual. Lutz, Florida: Psychological Assessment Resources.
- Gioia, G. A., Isquith, P. K., Kenworthy, L., & Baron, R. M. (2002). Profiles of everyday executive function in acquired and developmental disorders. Child Neuropsychology, 8, 121 – 137.
- Gioia, G. A., Isquith, P. K., Retzlaff, P. D., & Espy, K. A. (2002). Confirmatory factor analysis of the Behavior Rating Inventory of Executive Function (BRIEF) in a clinical sample. Child Neuropsychology (Neuropsychology, Development and Cognition: Section C), 8(4), 249 – 257. doi: 10.1076/chin.220.127.116.1113
- Goldstein, S. (2001). Test review: Behavior rating inventory of executive function. Applied Neuropsychology, 8(4), 255 – 261. doi: 10.1207/S15324826AN0804_10
- Guy, S. C., Isquith, P. K., & Gioia, G. A., (2004). Behavior Rating Inventory of Executive Function—Self-Report version: Professional manual. Lutz, Florida: Psychological Assessment Resources.
- Hostinar, C. E., Stellern, S. A., Schaefer, C., Carlson, S. M., & Gunnar, M. R. (2012). Associations between early life adversity and executive function in children adopted internationally from orphanages. PNAS Proceedings of the National Academy of Sciences of the United States of America, 109, 17208 – 17212.
- Hughes, C. (2011). Changes and challenges in 20 years of research into the development of executive functions. Infant and Child Development, 20, 251 – 271
- Hughes, D. M., Turkstra, L. S., & Wulfeck, B. B. (2009). Parent and self-ratings of executive function in adolescents with specific language impairment. International Journal of Language & Communication Disorders, 44(6), 901 – 916.
- Isquith, P. K., Gioia, G. A., & Espy, K. A. (2004). Executive function in preschool children: Examination through everyday behavior. Developmental Neuropsychology, 26, 403 – 422.
- Isquith, P. K., Roth, R. M., & Gioia, G. (2013). Contribution of rating scales to the assessment of executive functions. Applied Neuropsychology: Child, 2(2), 125 – 132. doi: 10.1080/21622965.2013.748389
- Isquith, P. K., Roth, R. M., Kenworthy, L., & Gioia, G. (2014). Contribution of rating scales to
- intervention for executive dysfunction. Applied Neuropsychology: Child, 3(3) 197 – 204. doi:10.1080/21622965.2013.870014
- Jacob, R. & Parkinson, J. (2015). The potential for school-based interventions that target executive function to improve academic achievement: A review. Review of Educational Research, 85(4), 512 – 552. doi: 10.3102/0034654314561338
- Jansen, B. R. J., De Lange, E., & Van der Molen, M. J. (2013). Math practice and its influence on math skills and executive functions in adolescents with mild to borderline intellectual disability. Research in Developmental Disabilities: A Multidisciplinary Journal, 34(5), 1815 – 1824. doi: 10.1016/j.ridd.2013.02.022
- Kotsopoulos, D. & Lee, J. (2012).A naturalistic study of executive function and mathematical problem-solving. The Journal of Mathematical Behavior, 31, 196 – 208.
- Langberg, J. M., Dvorsky, M. R., & Evans, S. W. (2013). What specific facets of executive function are associated with academic functioning in youth with Attention-Deficit/Hyperactivity Disorder? Journal of Abnormal Child Psychology, 41(7), 1145 – 1159. doi: 10.1007/s10802-013-9750-z
- Lee, K., Ng, E. L., & Ng, S. F. (2009). The contributions of working memory and executive functioning to problem representation and solution generation in algebraic word problems. Journal of Educational Psychology, 101, 373 – 387. doi: 10.1037/a0013843.
- Lemberger, M. E. & Clemens, E. V. (2012). Disconnectedness and self-regulation as constructs of the student success skills program in inner-city African American elementary school students. Journal of Counseling & Development, 90, 450 – 458.
- Locascio, G., Mahone, E. M., Eason, S. H., & Cutting, L. E. (2010). Executive dysfunction among children with reading comprehension deficits. Journal of Learning Disabilities, 43(5), 441 – 454. doi: 10.1177/0022219409355476
- Lohmeier, J. H. & Raad, J. (2012). The predictive value of selection criteria in an urban magnet school. Urban Education, 47(3), 612 – 624. doi: 10.1177/0042085911434569
- Mahone, E., Cirino, P. T., Cutting, L. E., Cerrone, P. M., Hagelthorn, K. M., Hiemenz, J. R., Singer, H. S., & Denckla, M. B. (2002). Validity of the behavior rating inventory of executive function in children with ADHD and/or Tourette syndrome. Archives of Clinical Neuropsychology, 17(7), 643 – 662. doi: 10.1016/S0887-6177(01)00168-8
- McDermott, J. M., Westerly, A., Zephaniah, C. H., Nelson, C. A., & Fox, N. A. (2012). Early adversity and neural correlates of executive function: Implications for academic adjustment. Developmental Cognitive Pseudoscience, 2, S59 – S66.
- Monette, S., Bigras, M., & Guay, M.-C. (2011). The role of the executive functions in school achievement at the end of Grade 1. Journal of Experimental Child Psychology, 109, 158 – 173. doi: 10.1016/j.jecp.2011.01.008.
- Naglieri, J. A., & Das, J. P. (1997). Cognitive assessment system. Austin, TX: ProEd.
- Nunnally, J. C. & Bernstein, I. H., (1994). Psychometric theory. New York: McGraw-Hill.
- Perkins, S. & Graham-Bermann, S. (2012). Violence exposure and the development of school-related functioning: Mental health, neurocognition, and learning. Aggression & Violent Behavior, 17, 89 – 98.
- Pinheiro, J., Bates, D., Deb Roy, S. Sarkar, D., & R Development Core Team (2013). nlme:
- Linear and Nonlinear Mixed Effects Models. R package version 3.1 – 113.
- R Core Team (2013).R: A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria. ISBN 3-900051-07-0, Retrieved from http://www.R-project.org/ on August 1, 2019.
- Raftery, A. E. (1995). Bayesian model selection in social research. Sociological Methodology, 25(1), 111 – 163.
- Reddy, L. A., Hale, J. B., & Brodzinsky, L. K. (2011). Discriminant validity of the Behavior Rating Inventory of Executive Function Parent Form for children with attention-deficit/hyperactivity disorder. School Psychology Quarterly, 26(1), 45 – 55. doi: 10.1037/a0022585
- Revelle, W. (2014) psych: Procedures for Personality and Psychological Research. Evanston, Illinois Northwestern University. Retrieved from http://cran.r-project.org/web/packages/psych/ on August 1, 2019.
- Rosenthal, M., Wallace, G. L., Lawson, R., Wills, M. C., Dixon, E., Yerys, B. E., & Kenworthy, L. (2013). Impairments in real-world executive function increase from childhood to adolescence in autism spectrum disorders. Neuropsychology, 27(1), 13 – 18. doi: 10.1037/a0031299
- Roth, R. M., Erdodi, L. A., Mcculloch, L. J., & Isquith, P. K. (2015). Much ado about norming: The behavior rating inventory of executive function. Child Neuropsychology, 21(2), 225 – 233.
- Roth, R. M., Isquith, P. K., & Gioia, G. A. (2014). Assessment of executive functioning using the behavior rating inventory of executive function (BRIEF). In S. Goldstein & J. A. Naglieri (Eds.), Handbook of Executive Functioning (2nd ed., pp. 301 – 331). New York, NY: Springer
- Samuels, W. E., Tournaki, N., Blackman, S., & Zilinski, C. (2016). Executive functioning predicts academic achievement in middle school: A 4-year longitudinal study. The Journal of Educational Research, 109(5), 478 – 490. doi: 10.1080/00220671.2014.979913
- Schuchardt, K., Bockmann, A.-K., Bornemann, G., & Maehler, C. (2013). Working memory functioning in children with learning disorders and specific language impairment. Topics in Language Disorders, 33(4), 298 – 312. doi: 10.1097/0 l.TLD.0000437943-41140.36
- Semrud-Clikeman, M., Fine, J. G., & Bledsoe, J. (2014). Comparison among children with children with autism spectrum disorder, nonverbal learning disorder and typically developing children on measures of executive functioning. Journal of Autism and Developmental Disorders, 44(2), 331 – 342. doi: 10.1007/s10803-013-1871-2
- Singer, J. D. & Willet, J. B., (2003). Applied longitudinal data analysis: Modeling change and event occurrence. New York: Oxford University Press.
- St. Clair-Thompson, H. & Gathercole, S. E. (2006). Executive functions and achievements in school: Shifting, updating, inhibition, and working memory. Quarterly Journal of Experimental Psychology, 59, 745 – 759.
- Strauss, E., Sherman, E. M. S., & Spreen, O. (2006). A compendium of neuropsychological tests (3rd ed.). New York, NY: Oxford University Press.
- Toplak, M. E., Bucciarelli, S. M., Jain, U., & Tannock, R. (2008). Executive functions: Performance-based measures and the Behavior Rating Inventory of Executive Function (BRIEF) in adolescents with attention-deficit/hyperactivity disorder. Child Neuropsychology, 15(1), 53 – 72. doi: 10.1080/09297040802070929
- Vriezen, E. R. & Pigott, S. E. (2002). The relationship between parental report on the BRIEF and performance-based measures of executive function in children with moderate to severe traumatic brain injury. Child Neuropsychology, 8(4), 296 – 303.
- Vuontela, V., Carlson, S., Troberg, A.-M., Fontell, T., Simola, P., Saarinen, S., & Aronen, E. T. (2013). Working memory, attention, inhibition, and their relation to adaptive functioning and behavioral/emotional symptoms in school-aged children. Child Psychiatry and Human Development, 44(1), 105 – 122. doi: 10.1007/s10578-012-0313-2
- Waber, D. P., Gerber, E. B., Turcios, V. Y., Wagner, E. R., & Forbes, P. W. (2006). Executive functions and performance on high-stakes testing in children from urban schools. Developmental Neuropsychology, 29(3), 459 – 477. doi: 10.1037/t15174-000
- Welsh, M., Pennington, B., & Groisser, D. (1991). A normative-developmental study of executive function: A window on prefrontal function in children. Developmental Neuropsychology, 7, 131 – 149.
- Wentzel, K. R. (1993). Does being good make the grade? Social behavior and academic competence in middle school. Journal of Educational Psychology, 85(2), 357 – 64.
- Wichstrøm, L. (1995). Harter's Self-Perception Profile for Adolescents: Reliability, Validity, and Evaluation of the Question Format. Journal of Personality Assessment, 65(1), 100.
- Wilson, K. R., Donders, J., & Nguyen, L. (2011). Self and parent ratings of executive functioning after adolescent traumatic brain injury. Rehabilitation Psychology, 56(2), 100-106. doi: 10.1037/a0023446
- Zelazo, P. D., Muller, U., Frye, D., & Marcovitch, S. (2003). The development of executive function in early childhood. Monographs of the Society for Research in Child Development, 68, (Serial No. 274).
This work is licensed under a Creative Commons Attribution 4.0 International License.