Sensitivity and specificity of computer-based neurocognitive tests in sport-related concussion: Findings from the NCAA-DoD CARE Consortium
(Sensitivität und Spezifität von computerbasierten neurokognitiven Tests bei sportbedingter Gehirnerschütterung: Ergebnisse des NCAA-DoD CARE Konsortiums)
Background: To optimally care for concussed individuals, a multi-dimensional approach is critical and a key component of this assessment in the athletic environment is computer-based neurocognitive testing. However, there continues to be concerns about the reliability and validity of these testing tools. The purpose of this study was to determine the sensitivity and specificity of three common computer-based neurocognitive tests (Immediate Post-Concussion Assessment and Cognitive Testing [ImPACT], CNS Vital Signs, and CogState Computerized Assessment Tool [CCAT]), to provide guidance on their clinical utility.
Methods: This study analyzed assessments from a cohort of collegiate athletes and non-varsity cadets from the NCAA-DoD CARE Consortium. The data were collected from 2014-2018. Study participants were divided into two testing groups [concussed, n = 1414 (baseline/24-48 h) and healthy, n = 8305 (baseline/baseline)]. For each test type, change scores were calculated for the components of interest. Then, the Normative Change method, which used normative data published in a similar cohort, and the Reliable Change Index (RCI) method were used to determine if the change scores were significant.
Results: Using the Normative Change method, ImPACT performed best with an 87.5%-confidence interval and 1 number of components failed (NCF; sensitivity = 0.583, specificity = 0.625, F1 = 0.308). CNS Vital Signs performed best with a 90%-confidence interval and 1 NCF (sensitivity = 0.587, specificity = 0.532, F1 = 0.314). CCAT performed best when using a 75%-confidence interval and 2 NCF (sensitivity = 0.513, specificity = 0.715, F1 = 0.290). When using the RCI method, ImPACT performed best with an 87.5%-confidence interval and 1 NCF (sensitivity = 0.626, specificity = 0.559, F1 = 0.297).
Conclusion: When considering all three computer-based neurocognitive tests, the overall low sensitivity and specificity results provide additional evidence for the use of a multi-dimensional assessment for concussion diagnosis, including symptom evaluation, postural control assessment, neuropsychological status, and other functional assessments.
Key points
No computer-based neurocognitive test outperforms the others
No computer-based neurocognitive test has a sensitivity and specificity necessary for clinical utility as a standalone measure
Caring for patients using a multi-dimensional concussion assessment is recommended
© Copyright 2021 Sports Medicine. Springer. Alle Rechte vorbehalten.
| Schlagworte: | |
|---|---|
| Notationen: | Biowissenschaften und Sportmedizin |
| Veröffentlicht in: | Sports Medicine |
| Sprache: | Englisch |
| Veröffentlicht: |
2021
|
| Online-Zugang: | https://doi.org/10.1007/s40279-020-01393-7 |
| Jahrgang: | 51 |
| Heft: | 2 |
| Seiten: | 351-365 |
| Dokumentenarten: | Artikel |
| Level: | hoch |