Clinical study| Volume 62, P138-141, April 2019

Evaluating the suitability of the Immediate Post-Concussion Assessment and Cognitive Testing (ImPACT) computerized neurocognitive battery for short-term, serial assessment of neurocognitive functioning

Published:November 21, 2018DOI:


      • ImPACT can be used serially over a one-hour period.
      • Neurocognitive scores did not differ across administrations.
      • A small percentage of scores were outside RCI cutoffs, suggesting sufficient one-hour reliability.



      Computerized Neurocognitive Testing (CNT) is frequently used for serial assessment of athletes following concussion. The Immediate Post-Concussion Assessment for Cognitive Testing (ImPACT) is a commonly used CNT with well-documented test–retest reliability in healthy samples for intervals ranging from one month to two years. However, previous research has not explored use of ImPACT for other serial testing methodologies such as immediately before and after an experimental trial/intervention where administration on the same day may be necessary.


      To examine the suitability of ImPACT for short-term, serial assessment of neurocognitive functioning.

      Study design

      Prospective, repeated measures research design.


      Forty-two healthy, college-aged individuals completed ImPACT twice, with a one-hour break between assessments. Reliability was assessed using Pearson correlation coefficients, intraclass correlation coefficients (ICCs), reliable change indices (RCIs) and regression-based methods (RBM).


      No significant increases in mean ImPACT composite or symptom scores were observed between assessments. ICCs ranged from 0.34 to 0.74 (single)/0.51 to 0.85 (average). Across two test administrations, 92–100% and 93–98% of participants' change scores fell within cutoffs when utilizing the RCI and RBM, respectively.


      The ICCs for ImPACT composite and factor scores across the one-hour administration were consistent with previous studies. Only a small percentage of scores fell outside of RCI and RBM cutoffs. These statistical metrics suggest that ImPACT has sufficient reliability when repeating administration within one-hour.


      To read this article in full you will need to make a payment

      Purchase one-time access:

      Academic & Personal: 24 hour online accessCorporate R&D Professionals: 24 hour online access
      One-time access price info
      • For academic or personal research use, select 'Academic and Personal'
      • For corporate R&D use, select 'Corporate R&D Professionals'


      Subscribe to Journal of Clinical Neuroscience
      Already a print subscriber? Claim online access
      Already an online subscriber? Sign in
      Institutional Access: Sign in to ScienceDirect


        • McCrory P.
        • Meeuwisse W.
        • Dvorak J.
        • Aubry M.
        • Bailes J.
        • Broglio S.
        • et al.
        Consensus statement on concussion in sport-the 5th international conference on concussion in sport held in Berlin, October 2016.
        Br J Sports Med. 2017;
        • Ganio M.S.
        • Armstrong L.E.
        • Casa D.J.
        • McDermott B.P.
        • Lee E.C.
        • Yamamoto L.M.
        • et al.
        Mild dehydration impairs cognitive performance and mood of men.
        Br J Nutr. 2011; 106: 1535-1543
        • Stachenfeld N.S.
        • Leone C.A.
        • Mitchell E.S.
        • Freese E.
        • Harkness L.
        Water intake reverses dehydration associated impaired executive function in healthy young women.
        Physiol Behav. 2018; 185: 103-111
        • Irwin C.
        • Campagnolo N.
        • Iudakhina E.
        • Cox G.R.
        • Desbrow B.
        Effects of acute exercise, dehydration and rehydration on cognitive function in well-trained athletes.
        J Sports Sci. 2018; 36: 247-255
        • Olson K.
        • Hewit J.
        • Slater L.G.
        • Chambers T.
        • Hicks D.
        • Farmer A.
        • et al.
        Assessing cognitive function in adults during or following chemotherapy: a scoping review.
        Support Care Cancer. 2016; 24: 3223-3234
        • Vardy J.
        • Rourke S.
        • Tannock I.F.
        Evaluation of cognitive function associated with chemotherapy: a review of published studies and recommendations for future research.
        J Clin Oncol. 2007; 25: 2455-2463
        • Vardy J.
        • Wong K.
        • Yi Q.L.
        • Park A.
        • Maruff P.
        • Wagner L.
        • et al.
        Assessing cognitive function in cancer patients.
        Support Care Cancer. 2006; 14: 1111-1118
        • Killgore W.D.
        Effects of sleep deprivation on cognition.
        Prog Brain Res. 2010; 185: 105-129
        • Whitney P.
        • Hinson J.M.
        Measurement of cognition in studies of sleep deprivation.
        Prog Brain Res. 2010; 185: 37-48
        • Schatz P.
        • Ferris C.S.
        One-month test-retest reliability of the ImPACT test battery.
        Arch Clin Neuropsychol. 2013; 28: 499-504
        • Elbin R.J.
        • Schatz P.
        • Covassin T.
        One-year test-retest reliability of the online version of ImPACT in high school athletes.
        Am J Sports Med. 2011; 39: 2319-2324
        • Schatz P.
        Long-term test-retest reliability of baseline cognitive assessments using ImPACT.
        Am J Sports Med. 2010; 38: 47-53
        • Iverson G.L.
        • Lovell M.R.
        • Collins M.W.
        Interpreting change on ImPACT following sport concussion.
        Clin Neuropsychol. 2003; 17: 460-467
        • Nakayama Y.
        • Covassin T.
        • Schatz P.
        • Nogle S.
        • Kovan J.
        Examination of the test-retest reliability of a computerized neurocognitive test battery.
        Am J Sports Med. 2014; 42: 2000-2005
        • Schatz P.
        • Maerlender A.
        A two-factor theory for concussion assessment using ImPACT: memory and speed.
        Arch Clin Neuropsychol. 2013; 28: 791-797
        • Lovell M.R.
        ImPACT technical manual: online ImPACT 2007–2012.
        ImPACT Applications, Inc., Pittsburgh, PA2013
        • Wilk C.M.
        • et al.
        Test-retest stability of the repeatable battery for the assessment of neurpsychological status in schizophrenia.
        Am J Psychiatry. 2002; 159: 838-844
        • Cicchetti D.V.
        Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology.
        Psychol Assess. 1994; 6: 284-290
        • Wier J.P.
        Quantifying test-retest reliability using the intraclass correlation coefficient and the SEM.
        J Strength Cond Res. 2005; 19: 231-240
        • Fleishman J.
        • Benson J.
        Using LISREL to evaluate measurement models and scale reliability.
        Educ Psychol Meas. 1987; 47: 925-939
        • Jacobsen N.S.
        • Traux P.
        Clinical significance: a statistical approach to defining meaningful change in psychotherapy research.
        J Consult Clin Psychol. 1991; 59: 12-19
        • Iverson G.L.
        • Sawyer D.C.
        • McCracken L.M.
        • Kozora E.
        Assessing depression in systematic lupus erythematosus: determining reliable change.
        Lupus. 2001; 10: 266-271
        • Chelune G.J.
        • Naugle R.I.
        • Luders H.
        • Sedlak J.
        • Awad I.A.
        Individual change after epilepsy surgery: practice effects and base-rate information.
        Neuropsychology. 1993; 7: 41-52
        • Barr W.B.
        Neuropsychological testing for assessment of treatment effects: methodologic issues.
        CNS Spectrums. 2002; 7: 4-6
        • McCrea M.
        • Barr W.B.
        • Guskiewicz K.
        • Randolph C.
        • Marshall S.W.
        • Cantu R.
        • et al.
        Standard regression-based methods for measuring recovery after sport-related concussion.
        J Int Neuropsychol Soc. 2005; 11: 58-69
        • Crawford J.R.
        • Garthwaite P.H.
        Comparing patients' predicted test scores from a regression equation with their obtained scores: a significance test and point estimate of abnormality with accompanying confidence limits.
        Neuropsychology. 2006; 20: 259-271