|
|
||||||||
J Thorac Cardiovasc Surg 1999;117:481-485
© 1999 Mosby, Inc.
SURGERY FOR ADULT CARDIOVASCULAR DISEASE |
From The Oxford Heart Centre, John Radcliffe Hospital, Headington,a the Department of Experimental Psychology,b Rivermead Rehabilitation Centre, and Rivermead Rehabilitation Centre,c Oxford, United Kingdom.
Supported by British Biotech Pharmaceuticals Limited.
Received for publication June 5, 1998. Revisions requested Sept 17, 1998. Revisions received Oct 15, 1998. Accepted for publication Oct 19, 1998. Address for reprints: Peter Halligan, PhD, Department of Experimental Psychology, Rivermead Rehabilitation Centre, Abingdon Road, Oxford OX1 4XD, United Kingdom.
| Abstract |
|---|
|
|
|---|
| Introduction |
|---|
|
|
|---|
One of the simplest methods of defining cognitive impairment uses a predetermined deterioration threshold to establish whether an individual's postoperative performance has significantly declined. This single-case analysis technique uses each patient as his/her own control and was recently endorsed at an international consensus meeting as the preferred method of defining cognitive impairment.
7 Several methods of determining the deterioration threshold are now commonly used, including the use of the group standard deviation (SD) or one-half SD and the percentage change.
8
The problem with these and similar techniques, however, is that they are susceptible to the potential bias of regression toward the mean (RTM). RTM is the statistical phenomenon whereby extreme baseline scores tend to become less extreme after repeated examinations, even though "true" change has not occurred.
9 A simple example of RTM would be in repeated measurements of blood pressure whereby on some occasions, by chance alone, the blood pressure may be higher or lower than normal. RTM states that unusually high or low blood pressures are by definition uncommon events and that the chance of a repetition of high or low blood pressure twice in a row is unlikely. In fact, by chance alone or random fluctuations, the next measurement is likely to be nearer the average value.
The effect of RTM is present wherever there is an intrasubject variation on a repeated test
10 and will therefore be an inevitable feature of cognitive assessment. Examples of misinterpretation that result from a failure to recognize RTM are common in the literature,
11,12 but the issue has not been addressed in relation to cognitive change after cardiac operations.
This study demonstrates the influence of RTM and the implications for the different definitions of impairment currently used, with data from a large group of patients who underwent coronary artery bypass graft operation. The results of the study provide a simple, but nevertheless salutary, illustration of the need to consider the effects of RTM. Possible solutions for countering the effects of RTM are proposed.
| Methods |
|---|
|
|
|---|
National Adult Reading Test
13
Short Orientation-Memory-Concentration Test
14
Rey Auditory Verbal Learning Test
15
Trail Making Test (part A)
15
Trail Making Test (part B)
15
Adult Memory Information Processing Battery (test A)
16
Nine Hole Peg Board Test
14
CFL Word Generation Test
15
Digit Span Test
15
Bell Cancellation Test
17
Although data from any of the tests are sufficient to demonstrate RTM, for simplicity we have chosen to analyze the data from 2 tests: the Delayed Recall component of the Rey Auditory Verbal Learning Test (RAVLT) and the Trail Making Test (part A; TMTA). These are 2 of the 4 core tests recommended for inclusion in psychometric testing at the consensus conference in 1994.
18 Briefly, the RAVLT is a test of verbal memory that allows assessment of immediate and delayed recall.
15 The Delayed Recall component is the total of 2 attempts (after 2-minute and 25-minute delays) at recalling as many words as possible from a list of 15 words, previously read to the subject 5 times. The maximum possible score is 30 and the minimum is 0. To minimize practice effects, a different list of words is used at each time point. The second test, the TMTA, is a test of visuospatial and psychomotor performance.
15 The subject is required to connect 25 numbered circles spread across a page in correct ascending order. The measured variable is the time taken to complete the task. Lower scores represent superior performance. The standard form was used at all 3 time-points.
The following 3 definitions of impairment were used to calculate frequency of decline within each of the 2 tests and, subsequently, to analyze for evidence of RTM. All these definitions of impairment have been used previously in the cardiac literature to measure significant change.
| Results |
|---|
|
|
|---|
|
|
|
Table IV shows the rate of cognitive decline calculated for each of the 2 tests according to each of the previously described definitions. Additionally, frequency of cognitive decline for each performance category has been provided. In both tests, a disproportionately large number of subjects from the high-performance categories are classified as declined, in comparison with the generally small percentage of subjects classified as declined in the low-performance categories. For example, on the RAVLT, the SD method classified 23% of the entire group as impaired, whereas 38% of the high performers were similarly classified. Although floor effects can influence these frequencies,
21 the major reason for these discrepancies is RTM. This is emphasized by equally diverse rates of decline within performance categories on the TMTA, a test that is not affected by floor effects.
|
| Discussion |
|---|
|
|
|---|
In contrast to other fields of research,
9 RTM has received minimal attention in the cardiac surgical literature.
21 This is surprising, because failure to control for RTM can lead to devastatingly erroneous conclusions.
9 It is evident in our article that single-case definitions are particularly vulnerable to its effects, with greater proportions of high-baseline performers being classified as impaired. There is no a priori reason why cardiac operations should disproportionately affect cognitive function in those subjects with high baseline scores. Such a situation is unavoidable by categorizing changes in performance as either "declined/not declined" because high-baseline performers will tend to regress downward even in the absence of real change. A smaller true decline is all that is required for these subjects to pass an impaired threshold. The converse situation for low-baseline performers results in fewer subjects being classified as impaired, because their scores would tend to improve because of RTM, thereby requiring a much larger true decline to pass the cut-off. Therefore definitions of impairment that only focus attention on declining scores will always bias results by including disproportionate numbers of high-baseline performers. To rely on these results clearly risks misinterpretation.
To overcome the influence of RTM on cognitive performance scores, multiple data points are required.
11 Within a single-case design, this would involve the performance of multiple preoperative cognitive assessments that could be averaged to obtain a subject's "true" baseline level. Similar multiple assessments might be required in the postoperative period when performance was deemed to be stable, again to establish a reliable level of function. It has been suggested that 2 or 3 assessments at baseline can minimize much of the effect of RTM.
11 The difficulties of performing such a large number of assessments, however, in addition to the greater likelihood of practice effects, makes this option impractical.
A more convenient alternative that overcomes the problem of RTM involves the use of group means.
11 Group mean analysis allows the application of parametric statistical methods that are free from the influence of RTM. Proponents of single-case designs, however, argue that this approach fails to account for the effects of practice, because overall group mean improvement can mask individuals who have deteriorated.
21 This criticism is valid only in the absence of a suitable age-matched control group. Such a group would allow for the control of both RTM and practice effects because both of these would be expected to occur equally in both groups.
In conclusion, the phenomenon of RTM should be recognized as a significant cause of variation within postoperative cognition scores. Results from studies that fail to appreciate its influence should be viewed with caution. The use of group mean data with appropriate control mean data should be the method of choice.
| Acknowledgments |
|---|
| References |
|---|
|
|
|---|
This article has been cited by other articles:
![]() |
C. Gorman Koch, F. Khandwala, and E. H. Blackstone Health-Related Quality of Life After Cardiac Surgery Seminars in Cardiothoracic and Vascular Anesthesia, September 1, 2008; 12(3): 203 - 217. [Abstract] [PDF] |
||||
![]() |
S. F. Marasco, L. N. Sharwood, and M. J. Abramson No improvement in neurocognitive outcomes after off-pump versus on-pump coronary revascularisation: a meta-analysis Eur. J. Cardiothorac. Surg., June 1, 2008; 33(6): 961 - 970. [Abstract] [Full Text] [PDF] |
||||
![]() |
S. Al-Ruzzeh and D. O'Regan Assessment of Neurocognitive Outcome After Cardiac Surgery Ann. Thorac. Surg., July 1, 2007; 84(1): 358 - 358. [Full Text] [PDF] |
||||
![]() |
F. D. Rubens, M. Boodhwani, and H. Nathan Interpreting studies of cognitive function following cardiac surgery: a guide for surgical teams Perfusion, May 1, 2007; 22(3): 185 - 192. [Abstract] [PDF] |
||||
![]() |
B. S. Silbert, D. A. Scott, L. A. Evered, M. S. Lewis, and P. T. Maruff Preexisting Cognitive Impairment in Patients Scheduled for Elective Coronary Artery Bypass Graft Surgery Anesth. Analg., May 1, 2007; 104(5): 1023 - 1028. [Abstract] [Full Text] [PDF] |
||||
![]() |
B. O. Jensen, P. Hughes, L. S. Rasmussen, P. U. Pedersen, and D. A. Steinbruchel Cognitive Outcomes in Elderly High-Risk Patients After Off-Pump Versus Conventional Coronary Artery Bypass Grafting: A Randomized Trial Circulation, June 20, 2006; 113(24): 2790 - 2795. [Abstract] [Full Text] [PDF] |
||||
![]() |
S. Al-Ruzzeh, S. George, M. Bustami, J. Wray, C. Ilsley, T. Athanasiou, and M. Amrani Effect of off-pump coronary artery bypass surgery on clinical, angiographic, neurocognitive, and quality of life outcomes: randomised controlled trial BMJ, June 10, 2006; 332(7554): 1365. [Abstract] [Full Text] [PDF] |
||||
![]() |
G. M. McKhann, M. A. Grega, L. M. Borowicz Jr, M. M. Bailey, S.J.E. Barry, S. L. Zeger, W. A. Baumgartner, and O. A. Selnes Is there cognitive decline 1 year after CABG?: Comparison with surgical and nonsurgical controls Neurology, October 11, 2005; 65(7): 991 - 999. [Abstract] [Full Text] [PDF] |
||||
![]() |
Y. Abu-Omar, A. Cifelli, P. M. Matthews, and D. P. Taggart The role of microembolisation in cerebral injury as defined by functional magnetic resonance imaging Eur. J. Cardiothorac. Surg., September 1, 2004; 26(3): 586 - 591. [Abstract] [Full Text] [PDF] |
||||
![]() |
Y. Abu-Omar, L. Balacumaraswami, D. W. Pigott, P. M. Matthews, and D. P. Taggart Solid and gaseous cerebral microembolization during off-pump, on-pump, and open cardiac surgery procedures J. Thorac. Cardiovasc. Surg., June 1, 2004; 127(6): 1759 - 1765. [Abstract] [Full Text] [PDF] |
||||
![]() |
D van Dijk, K G M Moons, A M A Keizer, E W L Jansen, R Hijman, J C Diephuis, C Borst, P P T de Jaegere, D E Grobbee, and C J Kalkman Association between early and three month cognitive outcome after off-pump and on-pump coronary bypass surgery Heart, April 1, 2004; 90(4): 431 - 434. [Abstract] [Full Text] [PDF] |
||||
![]() |
D. Taggart Off-pump surgery and cerebral injury J. Thorac. Cardiovasc. Surg., January 1, 2004; 127(1): 7 - 9. [Full Text] [PDF] |
||||
![]() |
D P Taggart, S M Browne, D T Wade, and P W Halligan Neuroprotection during cardiac surgery: a randomised trial of a platelet activating factor antagonist Heart, August 1, 2003; 89(8): 897 - 900. [Abstract] [Full Text] [PDF] |
||||
![]() |
D. Whitaker The use of Z scores in assessing neuropsychological change after cardiac operations Ann. Thorac. Surg., March 1, 2003; 75(3): 1066 - 1066. [Full Text] [PDF] |
||||
![]() |
R. P. Alston, I. J. Deary, M. J. Robson, P. J. Andrews, and M. J. Souter Another Example of Regression to the Mean (Not) Anesth. Analg., December 1, 2002; 95(6): 1823 - 1823. [Full Text] [PDF] |
||||
![]() |
D. Taggart About impaired minds and closed hearts BMJ, November 30, 2002; 325(7375): 1255 - 1256. [Full Text] [PDF] |
||||
![]() |
A. Collie, D. G. Darby, M. G. Falleti, B. S. Silbert, and P. Maruff Determining the extent of cognitive change after coronary surgery: a review of statistical procedures Ann. Thorac. Surg., June 1, 2002; 73(6): 2005 - 2011. [Abstract] [Full Text] [PDF] |
||||
![]() |
L. Landow Another Example of Regression to the Mean Anesth. Analg., June 1, 2002; 94(6): 1673 - 1673. [Full Text] [PDF] |
||||
![]() |
H. J. Nathan, G. A. Wells, J. L. Munson, and D. Wozny Neuroprotective Effect of Mild Hypothermia in Patients Undergoing Coronary Artery Surgery With Cardiopulmonary Bypass: A Randomized Trial Circulation, September 18, 2001; 104(90001): I-85 - 91. [Abstract] [Full Text] [PDF] |
||||
![]() |
M. J. Mack, M. J. Magee, T. M. Dewey, L. Aklog, A. P. Wilner, J. E. Malphurs, L. A. Roscoe, D.P. Taggart, S.M. Browne, P.W. Halligan, et al. Neurocognitive Function after Coronary-Artery Bypass Surgery N. Engl. J. Med., August 16, 2001; 345(7): 543 - 545. [Full Text] [PDF] |
||||
![]() |
M. J. A. Robson, R. P. Alston, I. J. Deary, P. J. D. Andrews, M. J. Souter, and S. Yates Cognition After Coronary Artery Surgery Is Not Related to Postoperative Jugular Bulb Oxyhemoglobin Desaturation Anesth. Analg., December 1, 2000; 91(6): 1317 - 1326. [Abstract] [Full Text] [PDF] |
||||
![]() |
D. A. Stump, R. L. James, and J. M. Murkin Is that outcome different or not? The effect of experimental design and statistics on neurobehavioral outcome studies Ann. Thorac. Surg., November 1, 2000; 70(5): 1782 - 1785. [Full Text] [PDF] |
||||
![]() |
D. van Dijk, A. M. A. Keizer, J. C. Diephuis, C. Durand, L. J. Vos, and R. Hijman Neurocognitive dysfunction after coronary artery bypass surgery: A systematic review J. Thorac. Cardiovasc. Surg., October 1, 2000; 120(4): 632 - 639. [Abstract] [Full Text] [PDF] |
||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |
| ANN THORAC SURG | ASIAN CARDIOVASC THORAC ANN | EUR J CARDIOTHORAC SURG |
| J THORAC CARDIOVASC SURG | ICVTS | ALL CTSNet JOURNALS |