Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2019

Open Access 01-12-2019 | Phlebothrombosis | Research article

Reliability of patient-reported complications following hip or knee arthroplasty procedures

Authors: Sung Mu Heo, Justine M. Naylor, Ian A. Harris, Timothy R. Churches

Published in: BMC Medical Research Methodology | Issue 1/2019

Login to get access

Abstract

Background

Patient reported outcomes are increasingly used to assess the success of surgical procedures. Patient reported complications are often included as an outcome. However, these data must be validated to be accurate and useful in clinical practice.

Methods

This was a retrospective descriptive study of 364 patients who had completed their six-month follow-up review questionnaire in the Arthroplasty Clinical Outcomes Registry, National (ACORN), an Australian orthopaedic registry. Patient-reported complications following total hip arthroplasty (THA) and total knee arthroplasty (TKA) were compared to surgeon-reported complications recorded in their electronic medical records at their various follow-up appointments. Sensitivity, specificity, positive predictive value and negative predictive value were calculated. Agreement was assessed using percentage agreement and Cohen’s kappa.

Results

Patient-reported data from the ACORN registry returned overall low sensitivity (0.14), negative predictive value (0.13) and kappa values (0.11), but very high specificity (0.98), positive predictive value (0.98) and agreement values (96.3%) for reporting of complications when compared to surgeon-reported data. Values varied depending on the type and category of complication.

Conclusion

Patients are accurate in reporting the absence of complications, but not the presence. Sensitivity of patient-reported complications needs to be improved. Greater attention to the clarity of the questions asked may help in this respect.
Appendix
Available only for authorised users
Literature
1.
go back to reference Siljander M, McQuivey K, Fahs A, Galasso L, Serdahely K, Karadsheh M. Current trends in patient-reported outcomes measures in total joint arthroplasy: A study of 4 major orthopaedic journals. J Arthroplasty. 2018; 33(11):3416–21.CrossRef Siljander M, McQuivey K, Fahs A, Galasso L, Serdahely K, Karadsheh M. Current trends in patient-reported outcomes measures in total joint arthroplasy: A study of 4 major orthopaedic journals. J Arthroplasty. 2018; 33(11):3416–21.CrossRef
2.
go back to reference Capozzi J, Rhodes R. Examining the ethical implications of an orthopaedic joint registry. J Bone Joint Surg Am. 2010; 92(5):1330–3.CrossRef Capozzi J, Rhodes R. Examining the ethical implications of an orthopaedic joint registry. J Bone Joint Surg Am. 2010; 92(5):1330–3.CrossRef
3.
go back to reference Lacny S, Bohm E, Hawker G, Powell J, Marshall D. Assessing the comparability of hip arthroplasty registries in order to improve the recording and monitoring of outcome. Bone Joint J. 2016; 98-B(4):442–51.CrossRef Lacny S, Bohm E, Hawker G, Powell J, Marshall D. Assessing the comparability of hip arthroplasty registries in order to improve the recording and monitoring of outcome. Bone Joint J. 2016; 98-B(4):442–51.CrossRef
4.
go back to reference Bilimoria K, Liu Y, Paruch J, Zhou L, Kmiecik T, Ko C, et al. Development and evaluation of the universal ACS NSQIP surgical risk calculator: A decision aid and informed consent tool for patients and surgeons. J Am Coll Surg. 2013; 217(5):833–42.e1–3.CrossRef Bilimoria K, Liu Y, Paruch J, Zhou L, Kmiecik T, Ko C, et al. Development and evaluation of the universal ACS NSQIP surgical risk calculator: A decision aid and informed consent tool for patients and surgeons. J Am Coll Surg. 2013; 217(5):833–42.e1–3.CrossRef
5.
go back to reference Saarinen I, Malmivaara A, Miikki R, Kaipia A. Systematic review of hospital-wide complication registries. BJS Open. 2018; 2(5):293–300.CrossRef Saarinen I, Malmivaara A, Miikki R, Kaipia A. Systematic review of hospital-wide complication registries. BJS Open. 2018; 2(5):293–300.CrossRef
6.
go back to reference Churches T, Naylor J, Harris I. Arthroplasty Clinical Outcomes Registry National (ACORN) Annual Report 2016. Ingham Institute for Applied Medical Research, 1 Campbell St, Liverpool NSW 2170. Australia: Whitlam Orthopaedic Research Centre; 2017. Churches T, Naylor J, Harris I. Arthroplasty Clinical Outcomes Registry National (ACORN) Annual Report 2016. Ingham Institute for Applied Medical Research, 1 Campbell St, Liverpool NSW 2170. Australia: Whitlam Orthopaedic Research Centre; 2017.
7.
go back to reference Black N, Petticrew M, Ginzler M, Flood A, Smith J, Williams G, et al. Do doctors and patients agree? Views of the outcome of transurethral resection of the prostate. Int J Technol Assess Helath Care. 1991; 7(4):533–44.CrossRef Black N, Petticrew M, Ginzler M, Flood A, Smith J, Williams G, et al. Do doctors and patients agree? Views of the outcome of transurethral resection of the prostate. Int J Technol Assess Helath Care. 1991; 7(4):533–44.CrossRef
8.
go back to reference Fränneby U, Gunnarsson U, Wollert S, G S. Discordance between the patient’s and surgeon’s perception of complications following hernia surgery. Hernia. 2005; 9(2):145–9.CrossRef Fränneby U, Gunnarsson U, Wollert S, G S. Discordance between the patient’s and surgeon’s perception of complications following hernia surgery. Hernia. 2005; 9(2):145–9.CrossRef
9.
go back to reference Haapaniemi S, Nilsson E. Recurrence and pain three years after groin hernia repair. Validation of postal questionnaire and selective physical examination as a method of follow up. Eur J Surg. 2002; 168(1):22–8.CrossRef Haapaniemi S, Nilsson E. Recurrence and pain three years after groin hernia repair. Validation of postal questionnaire and selective physical examination as a method of follow up. Eur J Surg. 2002; 168(1):22–8.CrossRef
10.
go back to reference Iyer R, Gentry-Maharaj A, Nordin A, Liston R, Burnell M, Das N, et al. Patient-reporting improves estimates of postoperative complication rates: a prospective cohort study in gynaecological oncology. Br J Cancer. 2013; 109(3):623–32.CrossRef Iyer R, Gentry-Maharaj A, Nordin A, Liston R, Burnell M, Das N, et al. Patient-reporting improves estimates of postoperative complication rates: a prospective cohort study in gynaecological oncology. Br J Cancer. 2013; 109(3):623–32.CrossRef
11.
go back to reference Mannion A, Fekete T, O’Riordan D, Porchet F, Mutter U, Jeszenszky D, et al. The assessment of complications after spine surgery: time for a paradigm shift?Spine J. 2013; 13(6):615–24.CrossRef Mannion A, Fekete T, O’Riordan D, Porchet F, Mutter U, Jeszenszky D, et al. The assessment of complications after spine surgery: time for a paradigm shift?Spine J. 2013; 13(6):615–24.CrossRef
12.
go back to reference Grosse Frie K, van der Meulen J, Black N. Relationship between patients’ reports of complications and symptoms, disability and quality of life after surgery. Br J Surg. 2012; 99(8):1156–63.CrossRef Grosse Frie K, van der Meulen J, Black N. Relationship between patients’ reports of complications and symptoms, disability and quality of life after surgery. Br J Surg. 2012; 99(8):1156–63.CrossRef
13.
go back to reference Loui A, Robinson L, Bogue M, Hyde S, Forman S, Bhatia S. Validation of self-reported complications by bone marrow transplantation survivors. Bone Marrow Transplant. 2000; 25(11):1191–6.CrossRef Loui A, Robinson L, Bogue M, Hyde S, Forman S, Bhatia S. Validation of self-reported complications by bone marrow transplantation survivors. Bone Marrow Transplant. 2000; 25(11):1191–6.CrossRef
14.
go back to reference Visser A, Ubbink D, Gouma D, Goslings J. Surgeons are overlooking post-discharge complications: a prospective cohort study. World J Surg. 2004; 38(5):1019–25.CrossRef Visser A, Ubbink D, Gouma D, Goslings J. Surgeons are overlooking post-discharge complications: a prospective cohort study. World J Surg. 2004; 38(5):1019–25.CrossRef
15.
go back to reference Whitby M, McLaws M, Doidge S, Collopy B. Post-discharge surgical site surveillance: does patient education improve reliability of diagnosis?J Hosp Infect. 2007; 66(3):237–42.CrossRef Whitby M, McLaws M, Doidge S, Collopy B. Post-discharge surgical site surveillance: does patient education improve reliability of diagnosis?J Hosp Infect. 2007; 66(3):237–42.CrossRef
16.
go back to reference Whitby M, McLaws ML, Collopy B, Looke D, Doidge S, Henderson B, et al. Post-discharge surveillance: can patients reliably diagnose surgical wound infections?J Hosp Infect. 2002; 52(3):155–60.CrossRef Whitby M, McLaws ML, Collopy B, Looke D, Doidge S, Henderson B, et al. Post-discharge surveillance: can patients reliably diagnose surgical wound infections?J Hosp Infect. 2002; 52(3):155–60.CrossRef
17.
go back to reference Dushey C, Bornstein L, Alexiades M, Westrich G. Short-term coagulation complications following total knee arthroplasty: a comparison of patient-reported and surgeon-verified complication rates. J Arthroplasty. 2011; 26(8):1338–42.CrossRef Dushey C, Bornstein L, Alexiades M, Westrich G. Short-term coagulation complications following total knee arthroplasty: a comparison of patient-reported and surgeon-verified complication rates. J Arthroplasty. 2011; 26(8):1338–42.CrossRef
18.
go back to reference Alazzawi S, Bardakos N, Hadfield S, Butt U, Beer Z, Field R. Patient-reported complications after elective joint replacement surgery: are they correct?J Bone Joint Surg Br. 2012; 94(8):1120–5.CrossRef Alazzawi S, Bardakos N, Hadfield S, Butt U, Beer Z, Field R. Patient-reported complications after elective joint replacement surgery: are they correct?J Bone Joint Surg Br. 2012; 94(8):1120–5.CrossRef
19.
go back to reference Greenbaum J, Bornstein L, Lyman S, Alexiades M, Westrich G. The validity of self-report as a technique for measuring short-term complications after total hip arthroplasty in a joint replacement registry. J Arthroplasty. 2012; 27(7):1310–5.CrossRef Greenbaum J, Bornstein L, Lyman S, Alexiades M, Westrich G. The validity of self-report as a technique for measuring short-term complications after total hip arthroplasty in a joint replacement registry. J Arthroplasty. 2012; 27(7):1310–5.CrossRef
21.
go back to reference R Core Team. R: A language and environment for statistical computing. Vienna, Austria: R Foundation for Statistical Computing; 2017. R Core Team. R: A language and environment for statistical computing. Vienna, Austria: R Foundation for Statistical Computing; 2017.
22.
go back to reference Heo SM. Reliability of patient reported complications: Can patients accurately report complications following hip or knee arthroplasty procedures? (monograph). 2016. Heo SM. Reliability of patient reported complications: Can patients accurately report complications following hip or knee arthroplasty procedures? (monograph). 2016.
23.
go back to reference Desai A, Dramis A, Board T. Leg length discrepancy after total hip arthroplasty: a review of literature. Curr Rev Musculoskelet Med. 2013; 6(4):336–341.CrossRef Desai A, Dramis A, Board T. Leg length discrepancy after total hip arthroplasty: a review of literature. Curr Rev Musculoskelet Med. 2013; 6(4):336–341.CrossRef
24.
go back to reference Zellmer C, Zimdars P, Parker S, Safdar N. Leg length discrepancy after total hip arthroplasty: a review of literature. Am J Infect Control. 2015; 43(2):167–8.CrossRef Zellmer C, Zimdars P, Parker S, Safdar N. Leg length discrepancy after total hip arthroplasty: a review of literature. Am J Infect Control. 2015; 43(2):167–8.CrossRef
25.
go back to reference Parimi N, Lane N, Bauer D, Hochberg M, Nevitt M. Accuracy of self-reported diagnosis of hip replacement. Arthritis Care Res (Hoboken). 2010; 62(5):719–24.CrossRef Parimi N, Lane N, Bauer D, Hochberg M, Nevitt M. Accuracy of self-reported diagnosis of hip replacement. Arthritis Care Res (Hoboken). 2010; 62(5):719–24.CrossRef
26.
go back to reference AJ V, Garrett J. Understanding interobserver agreement: the kappa statistic. Fam Med. 2005; 37(5):360–3. AJ V, Garrett J. Understanding interobserver agreement: the kappa statistic. Fam Med. 2005; 37(5):360–3.
27.
go back to reference McHugh M. Interrater reliability: the kappa statistic. Biochem Med (Zagreb). 2012; 22(3):276–82.CrossRef McHugh M. Interrater reliability: the kappa statistic. Biochem Med (Zagreb). 2012; 22(3):276–82.CrossRef
28.
go back to reference Veen E, Steenbruggen J, Roukema J. Classifying surgical complications: a critical appraisal. Arch Surg. 2005; 140(11):1078–83.CrossRef Veen E, Steenbruggen J, Roukema J. Classifying surgical complications: a critical appraisal. Arch Surg. 2005; 140(11):1078–83.CrossRef
Metadata
Title
Reliability of patient-reported complications following hip or knee arthroplasty procedures
Authors
Sung Mu Heo
Justine M. Naylor
Ian A. Harris
Timothy R. Churches
Publication date
01-12-2019
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2019
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/s12874-018-0645-0

Other articles of this Issue 1/2019

BMC Medical Research Methodology 1/2019 Go to the issue