Skip to main content
Top
Published in: HSS Journal ® 2/2018

01-07-2018 | Original Article

Online Patient Ratings Are Not Correlated with Total Knee Replacement Surgeon–Specific Outcomes

Authors: Samir K. Trehan, MD, Joseph T. Nguyen, MPH, Robert Marx, MD, Michael B. Cross, MD, Ting J. Pan, MPH, Aaron Daluiski, MD, Stephen Lyman, PhD

Published in: HSS Journal ® | Issue 2/2018

Login to get access

Abstract

Background

Despite potential concerns regarding their validity, physician-rating websites continue to grow in number and utilization and feature prominently on major search engines, potentially affecting patient decision-making regarding physician selection.

Questions/Purposes

We sought to determine whether patient ratings on public physician-rating websites correlate with surgeon-specific outcomes for high-volume total knee replacement (TKR) surgeons in New York State (NYS) from 2010 to 2012.

Methods

Online patient ratings were compared to surgeon-specific outcomes from the Statewide Planning and Research Cooperative System (SPARCS) database from the NYS Department of Health. For each surgeon, we determined the infection rate, re-admission rate, and revision surgery rate within the study period, as well as the mean inpatient length of stay, for TKR from the SPARCS database. Online ratings were collected from two physician-rating websites (Vitals.​com and HealthGrades.​com).

Results

One hundred seventy-four high-volume TKR surgeons were identified in NYS from 2010 to 2012. The mean rates of in-hospital infection, 90-day infection, 30-day re-admission, 90-day re-admission, and revision surgery were 0.25, 1.00, 4.89, 8.43, and 1.31%, respectively. The mean number of ratings for individual surgeons on HealthGrades.​com and Vitals.​com were 24.0 (range: 0 to 109) and 19.3 (range: 0 to 114), respectively, and mean overall ratings were 4.2 and 4.1 (out of 5) stars, respectively. As with online patient ratings of individual surgeons, variability was observed in the total adverse event rate distribution for individual surgeons. Despite sufficient variability in both online patient rating and surgeon-specific outcomes for high-volume TKR surgeons in NYS, no correlation was observed.

Conclusion

There was no correlation between surgeon-specific TKR outcome measures and online patient ratings. We therefore advise that patients exert caution when interpreting ratings on these websites.
Appendix
Available only for authorised users
Literature
1.
go back to reference Cram P, Cai X, Lu X, Vaughan-Sarrazin MS, Miller BJ. Total knee arthroplasty outcomes in top-ranked and non-top-ranked orthopedic hospitals: an analysis of Medicare administrative data. Mayo Clin Proc. 2012;87(4): 341–348.CrossRefPubMedPubMedCentral Cram P, Cai X, Lu X, Vaughan-Sarrazin MS, Miller BJ. Total knee arthroplasty outcomes in top-ranked and non-top-ranked orthopedic hospitals: an analysis of Medicare administrative data. Mayo Clin Proc. 2012;87(4): 341–348.CrossRefPubMedPubMedCentral
2.
go back to reference Cram P, Lu X, Kates SL, Singh JA, Li Y, Wolf BR. Total knee arthroplasty volume, utilization, and outcomes among Medicare beneficiaries, 1991-2010. JAMA. 2012;308(12):1227–1236.CrossRefPubMedPubMedCentral Cram P, Lu X, Kates SL, Singh JA, Li Y, Wolf BR. Total knee arthroplasty volume, utilization, and outcomes among Medicare beneficiaries, 1991-2010. JAMA. 2012;308(12):1227–1236.CrossRefPubMedPubMedCentral
3.
go back to reference Emmert M, Meier F, Pisch F, Sander U. Physician choice making and characteristics associated with using physician-rating websites: cross-sectional study. J Med Internet Res. 2013; 15(8): e187.CrossRefPubMedPubMedCentral Emmert M, Meier F, Pisch F, Sander U. Physician choice making and characteristics associated with using physician-rating websites: cross-sectional study. J Med Internet Res. 2013; 15(8): e187.CrossRefPubMedPubMedCentral
4.
go back to reference Gao GG, McCullough JS, Agarwal R, Jha AK. A changing landscape of physician quality reporting: analysis of patients’ online ratings of their physicians over a 5-year period. J Med Internet Res. 2012;14(1):e38.CrossRefPubMedPubMedCentral Gao GG, McCullough JS, Agarwal R, Jha AK. A changing landscape of physician quality reporting: analysis of patients’ online ratings of their physicians over a 5-year period. J Med Internet Res. 2012;14(1):e38.CrossRefPubMedPubMedCentral
5.
go back to reference Greaves F, Pape UJ, Lee H, Smith DM, Darzi A, Majeed A, Millett C. Patients’ ratings of family physician practices on the internet: usage and associations with conventional measures of quality in the English National Health Service. J Med Internet Res. 2012;14(5):e146.CrossRefPubMedPubMedCentral Greaves F, Pape UJ, Lee H, Smith DM, Darzi A, Majeed A, Millett C. Patients’ ratings of family physician practices on the internet: usage and associations with conventional measures of quality in the English National Health Service. J Med Internet Res. 2012;14(5):e146.CrossRefPubMedPubMedCentral
6.
go back to reference Hanauer DA, Zheng K, Singer DC, Gebremariam A, Davis MM. Parental awareness and use of online physician rating sites. Pediatrics. 2014;134(4):e966–75.CrossRefPubMed Hanauer DA, Zheng K, Singer DC, Gebremariam A, Davis MM. Parental awareness and use of online physician rating sites. Pediatrics. 2014;134(4):e966–75.CrossRefPubMed
7.
go back to reference Hanauer DA, Zheng K, Singer DC, Gebremariam A, Davis MM. Public awareness, perception, and use of online physician rating sites. JAMA. 2014;311(7):734–735.CrossRefPubMed Hanauer DA, Zheng K, Singer DC, Gebremariam A, Davis MM. Public awareness, perception, and use of online physician rating sites. JAMA. 2014;311(7):734–735.CrossRefPubMed
8.
go back to reference Kadry B, Chu LF, Kadry B, Gammas D, Macario A. Analysis of 4999 online physician ratings indicates that most patients give physicians a favorable rating. J Med Internet Res. 2011;13(4):e95.CrossRefPubMedPubMedCentral Kadry B, Chu LF, Kadry B, Gammas D, Macario A. Analysis of 4999 online physician ratings indicates that most patients give physicians a favorable rating. J Med Internet Res. 2011;13(4):e95.CrossRefPubMedPubMedCentral
9.
go back to reference Osborne NH, Nicholas LH, Ghaferi AA, Upchurch GR, Jr, Dimick JB. Do popular media and internet-based hospital quality ratings identify hospitals with better cardiovascular surgery outcomes? J Am Coll Surg. 2010;210(1):87–92.CrossRefPubMed Osborne NH, Nicholas LH, Ghaferi AA, Upchurch GR, Jr, Dimick JB. Do popular media and internet-based hospital quality ratings identify hospitals with better cardiovascular surgery outcomes? J Am Coll Surg. 2010;210(1):87–92.CrossRefPubMed
10.
go back to reference Osborne NH, Ghaferi AA, Nicholas LH, Dimick JB, Mph M. Evaluating popular media and internet-based hospital quality ratings for cancer surgery. Arch Surg. 2011;146(5):600–604.CrossRefPubMed Osborne NH, Ghaferi AA, Nicholas LH, Dimick JB, Mph M. Evaluating popular media and internet-based hospital quality ratings for cancer surgery. Arch Surg. 2011;146(5):600–604.CrossRefPubMed
11.
go back to reference Trehan SK, DeFrancesco CJ, Nguyen JT, Charalel RA, Daluiski A. Online patient ratings of hand surgeons. J Hand Surg Am. 2016;41(1):98–103.CrossRefPubMed Trehan SK, DeFrancesco CJ, Nguyen JT, Charalel RA, Daluiski A. Online patient ratings of hand surgeons. J Hand Surg Am. 2016;41(1):98–103.CrossRefPubMed
Metadata
Title
Online Patient Ratings Are Not Correlated with Total Knee Replacement Surgeon–Specific Outcomes
Authors
Samir K. Trehan, MD
Joseph T. Nguyen, MPH
Robert Marx, MD
Michael B. Cross, MD
Ting J. Pan, MPH
Aaron Daluiski, MD
Stephen Lyman, PhD
Publication date
01-07-2018
Publisher
Springer US
Published in
HSS Journal ® / Issue 2/2018
Print ISSN: 1556-3316
Electronic ISSN: 1556-3324
DOI
https://doi.org/10.1007/s11420-017-9600-6

Other articles of this Issue 2/2018

HSS Journal ® 2/2018 Go to the issue