Skip to main content
Top
Published in: BMC Ophthalmology 1/2017

Open Access 01-12-2017 | Research article

Mapping standard ophthalmic outcome sets to metrics currently reported in eight eye hospitals

Authors: Monica Michelotti, Dirk F. de Korne, Jennifer S. Weizer, Paul P. Lee, Declan Flanagan, Simon P. Kelly, Anne Odergren, Sukhpal S. Sandhu, Charity Wai, Niek Klazinga, Aravind Haripriya, Joshua D. Stein, Melanie Hingorani

Published in: BMC Ophthalmology | Issue 1/2017

Login to get access

Abstract

Background

To determine alignment of proposed international standard outcomes sets for ophthalmic conditions to metrics currently reported by eye hospitals.

Methods

Mixed methods comparative benchmark study, including eight eye hospitals in Australia, India, Singapore, Sweden, U.K., and U.S. All are major international tertiary care and training centers in ophthalmology. Main outcome measure is consistency of ophthalmic outcomes measures reported.

Results

International agreed standard outcomes (ICHOM) sets are available for cataract surgery (10 metrics) and macular degeneration (7 metrics). The eight hospitals reported 22 different metrics for cataract surgery and 2 for macular degeneration, which showed only limited overlap with the proposed ICHOM metrics. None of the hospitals reported patient reported visual functioning or vision-related quality of life outcomes measures (PROMs). Three hospitals (38%) reported rates for uncomplicated cataract surgeries only. There was marked variation in how and at what point postoperatively visual outcomes following cataract, cornea, glaucoma, strabismus and oculoplastics procedures were reported. Seven (87.5%) measured post-operative infections and four (50%) measured 30 day unplanned reoperation rates.

Conclusions

Outcomes reporting for ophthalmic conditions currently widely varies across hospitals internationally and does not include patient-reported outcomes. Reaching consensus on measures and consistency in data collection will allow meaningful comparisons and provide an evidence base enabling improved sharing of “best practices” to improve eye care globally. Implementation of international standards is still a major challenge and practice-based knowledge on measures should be one of the inputs of the international standardization process.
Appendix
Available only for authorised users
Literature
6.
go back to reference Finn AP, Borboli-Gerogiannis S, Brauner S, Peggy Chang HY, Chen S, Gardiner M, Greenstein SH, Kloek C, Miller JW, Chen TC. Assessing resident cataract surgery outcomes using Medicare Physician Quality Reporting System Measures. J Surg Edu. 2016;73(5):774–9. Finn AP, Borboli-Gerogiannis S, Brauner S, Peggy Chang HY, Chen S, Gardiner M, Greenstein SH, Kloek C, Miller JW, Chen TC. Assessing resident cataract surgery outcomes using Medicare Physician Quality Reporting System Measures. J Surg Edu. 2016;73(5):774–9.
8.
go back to reference de Korne DF, Sol JC, van Wijngaarden JD, van Vliet EJ, Custers T, Cubbon M, Spileers W, Ygge J, Ang C-L, Klazinga NS. Evaluation of an international benchmarking initiative in nine eye hospitals. Health Care Manag Rev. 2010;35(1):23–35.CrossRef de Korne DF, Sol JC, van Wijngaarden JD, van Vliet EJ, Custers T, Cubbon M, Spileers W, Ygge J, Ang C-L, Klazinga NS. Evaluation of an international benchmarking initiative in nine eye hospitals. Health Care Manag Rev. 2010;35(1):23–35.CrossRef
9.
go back to reference Schachat AP, Lee PP, Wu WC. A quality assurance program for an inpatient department of ophthalmology. Indicators and criteria. Arch Ophthalmol. 1989;107:1293–6.CrossRefPubMed Schachat AP, Lee PP, Wu WC. A quality assurance program for an inpatient department of ophthalmology. Indicators and criteria. Arch Ophthalmol. 1989;107:1293–6.CrossRefPubMed
10.
go back to reference Mant J. Process versus outcomes indicators in the assessment of quality in health care. Int J Qual Health Care. 2001;13(6):475–80.CrossRefPubMed Mant J. Process versus outcomes indicators in the assessment of quality in health care. Int J Qual Health Care. 2001;13(6):475–80.CrossRefPubMed
13.
go back to reference Mahmud I, Kelly T, Stowell C, Haripriya A, Boman A, Kossler I, Morlet N, Pershing S, Pesudovs K, Goh PP, Sparrow JM, Lundstrom M. A proposed minimum standard set of outcomes measures for cataract surgery. JAMA Ophthalmol. 2015;133(11):1247–52.CrossRefPubMed Mahmud I, Kelly T, Stowell C, Haripriya A, Boman A, Kossler I, Morlet N, Pershing S, Pesudovs K, Goh PP, Sparrow JM, Lundstrom M. A proposed minimum standard set of outcomes measures for cataract surgery. JAMA Ophthalmol. 2015;133(11):1247–52.CrossRefPubMed
14.
go back to reference Schein OD, Banta JT, Chen T, et al. Lesson learned: wrong intra ocular lens. Ophthalmology. 2012;119(10):2059–64.CrossRefPubMed Schein OD, Banta JT, Chen T, et al. Lesson learned: wrong intra ocular lens. Ophthalmology. 2012;119(10):2059–64.CrossRefPubMed
15.
go back to reference Rodrigues IA, Sprinkhuizen SM, Barthelmes D, Blumenkranz M, Cheung G, Haller J, Johnston R, Kim R, Klaver C, McKibbin M, Ngaf NF, Pershing S, Shandar D, Tamura H, Tufail A, Weng CY, Westborg I, Yelf C, Yoshimura N, Gillies MC. Defining a minimum set of standardized patient-centred outcomes measures for macular degeneration. Am J Ophthalmol. 2016;168:1–12.CrossRefPubMed Rodrigues IA, Sprinkhuizen SM, Barthelmes D, Blumenkranz M, Cheung G, Haller J, Johnston R, Kim R, Klaver C, McKibbin M, Ngaf NF, Pershing S, Shandar D, Tamura H, Tufail A, Weng CY, Westborg I, Yelf C, Yoshimura N, Gillies MC. Defining a minimum set of standardized patient-centred outcomes measures for macular degeneration. Am J Ophthalmol. 2016;168:1–12.CrossRefPubMed
16.
go back to reference Minassian DC, Reidy A, Lightstone A, Desai P. Modelling the prevalence of age-related macular degeneration (2010-2020) in the UK: expected impact of antivascular endothelial growth factor (VEGF) therapy. Br J Ophthalmol. 2011;95(10):1433–6.CrossRefPubMed Minassian DC, Reidy A, Lightstone A, Desai P. Modelling the prevalence of age-related macular degeneration (2010-2020) in the UK: expected impact of antivascular endothelial growth factor (VEGF) therapy. Br J Ophthalmol. 2011;95(10):1433–6.CrossRefPubMed
17.
go back to reference Kelly SP, Mathews D, Mathews J, Vail A. Reflective consideration of postoperative endophthalmitis as a quality marker. Eye (Lond). 2007;21(11):1419–26.CrossRef Kelly SP, Mathews D, Mathews J, Vail A. Reflective consideration of postoperative endophthalmitis as a quality marker. Eye (Lond). 2007;21(11):1419–26.CrossRef
18.
go back to reference Coleman AL, Morgenstern H. Use of insurance claims databases to evaluate the outcomes of ophthalmic surgery. Surv Ophthalmol. 1997;42(3):271–8.CrossRefPubMed Coleman AL, Morgenstern H. Use of insurance claims databases to evaluate the outcomes of ophthalmic surgery. Surv Ophthalmol. 1997;42(3):271–8.CrossRefPubMed
19.
go back to reference Bridgewater B, Grayson AD, Brooks N, Grotte G, Fabri BM, Au J, Hooper T, Jones M, Keogh B. Has the publication of cardiac surgery outcome data been associated with changes in practice in northwest England: an analysis of 25,730 patients undergoing CABG surgery under 30 surgeons over eight years. Heart. 2007;93(6):744–8.CrossRefPubMedPubMedCentral Bridgewater B, Grayson AD, Brooks N, Grotte G, Fabri BM, Au J, Hooper T, Jones M, Keogh B. Has the publication of cardiac surgery outcome data been associated with changes in practice in northwest England: an analysis of 25,730 patients undergoing CABG surgery under 30 surgeons over eight years. Heart. 2007;93(6):744–8.CrossRefPubMedPubMedCentral
20.
go back to reference Chassin MR, Hannan EL, DeBuono BA. Benefits and hazards of reporting medical outcomes publicly. N Engl J Med. 1996;334:394–8.CrossRefPubMed Chassin MR, Hannan EL, DeBuono BA. Benefits and hazards of reporting medical outcomes publicly. N Engl J Med. 1996;334:394–8.CrossRefPubMed
21.
go back to reference Werner RM, Asch DA. The unintended consequences of publicly reporting quality information. JAMA. 2005;293:1239–44.CrossRefPubMed Werner RM, Asch DA. The unintended consequences of publicly reporting quality information. JAMA. 2005;293:1239–44.CrossRefPubMed
22.
go back to reference Forde I, Morgan D, Klazinga NS. Resolving the challenges in the international comparison of health systems: the must do’s and trade-offs. Health Policy. 2013;112(1–2):4–8.CrossRefPubMed Forde I, Morgan D, Klazinga NS. Resolving the challenges in the international comparison of health systems: the must do’s and trade-offs. Health Policy. 2013;112(1–2):4–8.CrossRefPubMed
24.
go back to reference Van Vliet EJ, Bredenhoff E, Sermeus W, Kop LM, Sol JC, van Harten WH. Exploring the relation between process design and efficiency in high-volume cataract pathways from a lean thinking perspective. Int J Qual Health Care. 2011;23(1):83–93.CrossRefPubMed Van Vliet EJ, Bredenhoff E, Sermeus W, Kop LM, Sol JC, van Harten WH. Exploring the relation between process design and efficiency in high-volume cataract pathways from a lean thinking perspective. Int J Qual Health Care. 2011;23(1):83–93.CrossRefPubMed
25.
go back to reference Ovretveit J. Evaluating improvement and implementation for health. New York: Open University Press; 2014. Ovretveit J. Evaluating improvement and implementation for health. New York: Open University Press; 2014.
26.
go back to reference de Korne DF, van Wijngaarden JD, Sol JC, Betz R, Thomas RC, Schein OD, Klazinga NS. Hospital benchmarking: are U.S. eye hospitals ready? Health Care Manag Rev. 2012;37(2):187–98.CrossRef de Korne DF, van Wijngaarden JD, Sol JC, Betz R, Thomas RC, Schein OD, Klazinga NS. Hospital benchmarking: are U.S. eye hospitals ready? Health Care Manag Rev. 2012;37(2):187–98.CrossRef
27.
go back to reference Grover FL, Shroyer AL, Hammermeister K, Edwards FH, Ferguson TB Jr, Dziuban SW Jr, Cleveland JC Jr, Clark RE, McDonald G. A decade’s experience with quality improvement in cardiac surgery using the veterans affairs and society of thoracic surgeons national databases. Ann Surg. 2001;234(4):464–72.CrossRefPubMedPubMedCentral Grover FL, Shroyer AL, Hammermeister K, Edwards FH, Ferguson TB Jr, Dziuban SW Jr, Cleveland JC Jr, Clark RE, McDonald G. A decade’s experience with quality improvement in cardiac surgery using the veterans affairs and society of thoracic surgeons national databases. Ann Surg. 2001;234(4):464–72.CrossRefPubMedPubMedCentral
30.
go back to reference Mason A, Street A. Publishing outcome data: is it an effective approach? J Eval Clin Pract. 2006;12(1):37–48.CrossRefPubMed Mason A, Street A. Publishing outcome data: is it an effective approach? J Eval Clin Pract. 2006;12(1):37–48.CrossRefPubMed
31.
go back to reference Dziuban SW, McIlduff JB, Miller SJ, Dal Col RH. How a New York cardiac surgery program uses outcomes data. Ann Thorac Surg. 1994;58(6):1871–6.CrossRefPubMed Dziuban SW, McIlduff JB, Miller SJ, Dal Col RH. How a New York cardiac surgery program uses outcomes data. Ann Thorac Surg. 1994;58(6):1871–6.CrossRefPubMed
32.
go back to reference Davies H. Falling public trust in health services: implications for accountability. J Health Serv Res Policy. 1999;4(4):193–4.CrossRefPubMed Davies H. Falling public trust in health services: implications for accountability. J Health Serv Res Policy. 1999;4(4):193–4.CrossRefPubMed
34.
go back to reference US Department of Health & Human Services FDA. Patient reported outcome measures: use in medical product development to support labelling claims. Maryland: Department of Health & Human Support Food & Drug Administration; 2009. US Department of Health & Human Services FDA. Patient reported outcome measures: use in medical product development to support labelling claims. Maryland: Department of Health & Human Support Food & Drug Administration; 2009.
35.
go back to reference Black N, Browne J, van der Meulen J, Jamieson L, Copley L, Lewsey J. Is there overutilisation of cataract surgery in England? Br J Ophthalmol. 2009;93(1):13–7.CrossRefPubMed Black N, Browne J, van der Meulen J, Jamieson L, Copley L, Lewsey J. Is there overutilisation of cataract surgery in England? Br J Ophthalmol. 2009;93(1):13–7.CrossRefPubMed
36.
go back to reference Fung SS, Luis J, Hussain B, Bunce C, Hingorani M, Hancox J. Patient reported outcome measuring tools in cataract surgery–clinical comparison in a tertiary hospital. J Cataract Refract Surg. 2016;42(12):1759–67.CrossRefPubMed Fung SS, Luis J, Hussain B, Bunce C, Hingorani M, Hancox J. Patient reported outcome measuring tools in cataract surgery–clinical comparison in a tertiary hospital. J Cataract Refract Surg. 2016;42(12):1759–67.CrossRefPubMed
37.
go back to reference Mukamel DB, Glance LG, Dick AW, Osler TM. Measuring quality for public reporting of health provider quality: making it meaningful to patients. Am J Public Health. 2010;100(2):264–9.CrossRefPubMedPubMedCentral Mukamel DB, Glance LG, Dick AW, Osler TM. Measuring quality for public reporting of health provider quality: making it meaningful to patients. Am J Public Health. 2010;100(2):264–9.CrossRefPubMedPubMedCentral
38.
go back to reference Schneider EC, Epstein AM. Influence of cardiac-surgery performance reports on referral practices and access to care. A survey of cardiovascular specialists. N Engl J Med. 1996;335(4):251–6.CrossRefPubMed Schneider EC, Epstein AM. Influence of cardiac-surgery performance reports on referral practices and access to care. A survey of cardiovascular specialists. N Engl J Med. 1996;335(4):251–6.CrossRefPubMed
39.
go back to reference Keogh BE, Kinsman R. National adult cardiac surgical database report 2000–2001. London: Society of Cardio- thoracic Surgeons of Great Britain and Ireland; 2002. Keogh BE, Kinsman R. National adult cardiac surgical database report 2000–2001. London: Society of Cardio- thoracic Surgeons of Great Britain and Ireland; 2002.
40.
go back to reference Sparrow JM. Cataract surgery: benchmarks for established and trainee surgeons. Eye (Lond). 2008;22(11):1371–2.CrossRef Sparrow JM. Cataract surgery: benchmarks for established and trainee surgeons. Eye (Lond). 2008;22(11):1371–2.CrossRef
41.
43.
go back to reference Lundström M, Barry P, Henry Y, Rosen P, Stenevi U. Evidence-based guidelines for cataract surgery: guidelines based on data in the European registry of quality outcomes for cataract and refractive surgery database. J Cataract Refract Surg. 2012;38(6):1086–93.CrossRefPubMed Lundström M, Barry P, Henry Y, Rosen P, Stenevi U. Evidence-based guidelines for cataract surgery: guidelines based on data in the European registry of quality outcomes for cataract and refractive surgery database. J Cataract Refract Surg. 2012;38(6):1086–93.CrossRefPubMed
44.
go back to reference Hahn U, Krummenauer F, Kölbl B, Neuhann T, Schayan-Araghi K, Schmickler S, von Wolff K, Weindler J, Will T, Neuhann I. Determination of valid benchmarks for outcome indicators in cataract surgery: a multicenter, prospective cohort trial. Ophthalmology. 2011;118(11):2105–12.CrossRefPubMed Hahn U, Krummenauer F, Kölbl B, Neuhann T, Schayan-Araghi K, Schmickler S, von Wolff K, Weindler J, Will T, Neuhann I. Determination of valid benchmarks for outcome indicators in cataract surgery: a multicenter, prospective cohort trial. Ophthalmology. 2011;118(11):2105–12.CrossRefPubMed
45.
go back to reference Parke DW, Lum F, Rich WL. The IRIS registry: purposes and perspectives. Ophtalmolog. 2016;113(6):463–8.CrossRef Parke DW, Lum F, Rich WL. The IRIS registry: purposes and perspectives. Ophtalmolog. 2016;113(6):463–8.CrossRef
46.
go back to reference Coleman AL. How big data informs us about cataract surgery. Am J Ophthalmol. 2015;160(6):1091–103.CrossRefPubMed Coleman AL. How big data informs us about cataract surgery. Am J Ophthalmol. 2015;160(6):1091–103.CrossRefPubMed
Metadata
Title
Mapping standard ophthalmic outcome sets to metrics currently reported in eight eye hospitals
Authors
Monica Michelotti
Dirk F. de Korne
Jennifer S. Weizer
Paul P. Lee
Declan Flanagan
Simon P. Kelly
Anne Odergren
Sukhpal S. Sandhu
Charity Wai
Niek Klazinga
Aravind Haripriya
Joshua D. Stein
Melanie Hingorani
Publication date
01-12-2017
Publisher
BioMed Central
Published in
BMC Ophthalmology / Issue 1/2017
Electronic ISSN: 1471-2415
DOI
https://doi.org/10.1186/s12886-017-0667-0

Other articles of this Issue 1/2017

BMC Ophthalmology 1/2017 Go to the issue