Accuracy of post-operative recall by degenerative cervical myelopathy patients using the modified Japanese Orthopaedic Association scale
Background and aim: The modified Japanese Orthopaedic Association (mJOA) scale is one of the primary measures of neurological function used on patients with degenerative cervical myelopathy (DCM). Contrary to some reports, the mJOA is not based on patient-reported outcomes (PROs) as it is an assessment conducted by physicians, allied health professionals, or trained staff. To date, the accuracy of postoperative recall by DCM patients of their pre-operative neurological function, as assessed by the mJOA scale, has not been examined. This study therefore aimed to evaluate recall accuracy in DCM patients using the mJOA scale.
Methods: This study analyzed recall capacity of DCM patients who had undergone anterior cervical discectomy and fusion by a single surgeon at a large academic spine center between February 2012 and August 2017. Patient recall of neurological function pre-surgery was assessed at 3, 12, and 24 months post-surgery using the mJOA scale. Actual mJOA scores were also determined at each follow-up. Recall error was defined as the difference between recalled mJOA score at each postoperative visit and the actual baseline score. Age, gender, surgical segments, hospital length of stay, actual mJOA scores at follow-up, and actual rate of improvement in mJOA score were analyzed as predictors of recall accuracy. Descriptive statistics were collected to profile the characteristics of patients enrolled in the study cohort. All statistical computing and graphing were performed with R software and GEE model fitting was done using geepack package.
Results: A total of 105 patients (56.2% male; 43.8% female) were enrolled in the study. The median ± SD (range) age at the pre-surgical baseline measurement was 50 ± 8 (25-78) years. The recalled mJOA scores at the three follow-up time points were lower than the actual mJOA scores. The recall accuracy gradually decreased over time. Estimated coefficients showed that all variables in the GEE model except for surgical fusion segments were significant (P < 0.05). The preoperative actual baseline mJOA score was inversely associated with recall error. An increasing actual mJOA score over time had a significant positive influence on recall error. Greater recall error was found in males compared to females. Unexpectedly, age was inversely associated with recall error.
Conclusions: The recall error increases with the time interval between presurgical measurement and post-surgical follow-up and is more prominent in male DCMs patients following upper spine surgery.
Relevance for patients: It is necessary to select postoperative patients who need to pay attention according to the three factors of postoperative time, gender and age, that is, patients with large recall error should be given early or timely psychological counseling and treatment concerns, so as to reduce the occurrence of potential medical disputes and improve the level of medical safety.
[1] McCormick JD, Werner BC, Shimer AL. Patient-Reported Outcome Measures in Spine Surgery. J Am Acad Orthop Surg 2013;21:99-107.
[2] Stepan JG, London DA, Boyer MI, Calfee RP. Accuracy of Patient Recall of Hand and Elbow Disability on the QuickDASH Questionnaire Over a Two-Year Period. J Bone Joint Surg Am 2013;95:e176.
[3] Coughlin SS. Recall Bias in Epidemiologic Studies. J Clin Epidemiol 1990;43:87-91.
[4] Howell J, Xu M, Duncan CP, Masri BA, Garbuz DS. A Comparison between Patient Recall and Concurrent Measurement of Preoperative Quality of Life Outcome in Toal Hip Arthroplasty. J Arthroplasty 2008;23:843-9.
[5] Lingard EA, Wright EA, Sledge CB, Kinemax Outcomes Group. Pitfalls of using Patient Recall to Derive Preoperative Status in Outcome Studies of Total Knee Arthroplasty. J Bone Joint Surg Am 2001;83:1149-56.
[6] Mancuso CA, Charlson ME. Does Recollection Error Threaten the Validity of Cross-Sectional Studies of Effectiveness? Med Care 1995;33:AS77-88.
[7] Wilson J, Baker P, Rangan A. Is Retrospective Application of the Oxford Shoulder Score Valid? J Shoulder Elbow Surg 2009;18:577-80.
[8] Dawson EG, Kanim LE, Sra P, Dorey FJ, Goldstein TB, Delamarter RB, et al. Low Back Pain Recollection Versus Concurrent Accounts: Outcomes Analysis. Spine (Phila Pa 1976) 2002;27:984-93; discussion 994.
[9] Pellise F, Vidal X, Hernandez A, Cedraschi C, Bago J, Villanueva C. Reliability of Retrospective Clinical Data to Evaluate the Effectiveness of Lumbar Fusion in Chronic Low Back Pain. Spine (Phila Pa 1976) 2005;30:365-8.
[10] Liang KY, Zeger SL. Longitudinal Data Analysis Using Generalized Linear Models. Biometrika 1986;73:13-22.
[11] Zeger SL, Liang KY. Longitudinal Data Analysis for Discrete and Continuous Outcomes. Biometrics 1986;42:121-30.
[12] Vens M, Ziegler A. Generalized Estimating Equations and Regression Diagnostics for Longitudinal Controlled Clinical Trials: A Case Study. Comput Stat Data Anal 2012;56:1232-42.
[13] R Core Team. R: ALanguage and Environment for Statistical Computing. RFoundation for Statistical Computing. Vienna, Austria: 2018. Available from: https://www.R-project.org
[14] Vanegas LH, Rondón LM, Paula GA. Glmtoolbox: Set of Tools to Data Analysis using Generalized Linear. 2022. Available from: https://wwwCRAN.R-project.org/ package=glmtoolbox
[15] Marsh J, Bryant D, MacDonald SJ. Older Patients can Accurately Recall their Preoperative Health Status Six Weeks Following Total Hip Arthroplasty. J Bone Joint Surg Am 2009;91:2827-37.
[16] Lindsay GM, Niven KA, Brodie EE, Gaw A, Belcher PR. Accuracy of Patient Recall of Preoperative Symptom Severity (Angina and Breathlessness) at One Year Following Aorta-Coronary Artery Bypass Grafting. J Clin Nurs 2009;18:418-25.
[17] Litwin MS, McGuigan KA. Accuracy of Recall in HealthRelated Quality-of-Life Assessment Among Men Treated for Prostate Cancer. J Clin Oncol 1999;17:2882-8.
[18] Lowe JT, Li X, Fasulo SM, Testa EJ, Jawa A. Patients Recall Worse Preoperative Pain after Shoulder Arthroplasty than Originally Reported: A Study of Recall Accuracy using the American Shoulder and Elbow Surgeons score. J Shoulder Elbow Surg 2017;26:506-11.
[19] Pincus T, Pearce S, McClelland A, Turner-Stokes L. SelfReferential Selective Memory in Pain Patients. Br J Clin Psychol 1993;32:365-74.
[20] Randsborg PH, Adamec D, Cepeda NA, Ling DI. TwoYear Recall Bias after ACL Reconstruction is Affected by Clinical Result. JB JS Open Access 2021;6:e20.00164.
[21] Shetty T, Nguyen JT, Cogsil T, Tsiouris AJ, Niogi SN, Kim EU, et al. Clinical Findings in a Multicenter MRI Study of Mild TBI. Front Neurol 2018;9:836.
[22] Holden MP, Duff-Canning SJ, Hampson E. Sex Differences in the Weighting of Metric and Categorical Information in Spatial Location Memory. Psychol Res 2015;79:1-18.
[23] Schwartz CE, Sajobi TT, Lix LM, Quaranto BR, Finkelstein JA. Changing Values, Changing Outcomes: The Influence of Reprioritization Response Shift on Outcome Assessment after Spine Surgery. Qual Life Res 2013;22:2255-64.
[24] Herrmann D. Reporting Current, Past, and Changed Health Status. What we know about Distortion. Med Care 1995;33:AS89-94.
[25] McPhail S, Beller E, Haines T. Reference Bias: Presentation of Extreme Health States Prior to EQ-VAS Improves Health-Related Quality of Life Scores. A Randomised Cross-Over Trial. Health Qual Life Outcomes 2010;8:146.
[26] McPhail S, Haines T. Response Shift, Recall Bias and their Effect on Measuring Change in Health-Related Quality of Life amongst Older Hospital Patients. Health Qual Life Outcomes 2010;8:65.
[27] Tibbles AC, Waalen JK, Hains FC. Response Set Bias, Internal Consistency and Construct Validity of the Oswestry Low Back Pain Disability Questionnaire. J Can Chiropr Assoc 1998;42:141-9.
[28] Babul N, Darke AC, Johnson DH, Charron-Vincent K. Using Memory for Pain in Analgesic Research. Ann Pharmacother 1993;27:9-12.
[29] Singer AJ, Kowalska A, Thode HC Jr. Ability of Patients to Accurately Recall the Severity of Acute Painful Events. Acad Emerg Med 2001;8:292-5.