Skip to main content
Top
Published in: Diabetologia 11/2017

Open Access 01-11-2017 | Article

Individualised variable-interval risk-based screening for sight-threatening diabetic retinopathy: the Liverpool Risk Calculation Engine

Authors: Antonio Eleuteri, Anthony C. Fisher, Deborah M. Broadbent, Marta García-Fiñana, Christopher P. Cheyne, Amu Wang, Irene M. Stratton, Mark Gabbay, Daniel Seddon, Simon P. Harding, for the Individualised Screening for Diabetic Retinopathy (ISDR) Study Group

Published in: Diabetologia | Issue 11/2017

Login to get access

Abstract

Aims/hypothesis

Individualised variable-interval risk-based screening offers better targeting and improved cost-effectiveness in screening for diabetic retinopathy. We developed a generalisable risk calculation engine (RCE) to assign personalised intervals linked to local population characteristics, and explored differences in assignment compared with current practice.

Methods

Data from 5 years of photographic screening and primary care for people with diabetes, screen negative at the first of > 1 episode, were combined in a purpose-built near-real-time warehouse. Covariates were selected from a dataset created using mixed qualitative/quantitative methods. Markov modelling predicted progression to screen-positive (referable diabetic retinopathy) against the local cohort history. Retinopathy grade informed baseline risk and multiple imputation dealt with missing data. Acceptable intervals (6, 12, 24 months) and risk threshold (2.5%) were established with patients and professional end users.

Results

Data were from 11,806 people with diabetes (46,525 episodes, 388 screen-positive). Covariates with sufficient predictive value were: duration of known disease, HbA1c, age, systolic BP and total cholesterol. Corrected AUC (95% CIs) were: 6 months 0.88 (0.83, 0.93), 12 months 0.90 (0.87, 0.93) and 24 months 0.91 (0.87, 0.94). Sensitivities/specificities for a 2.5% risk were: 6 months 0.61, 0.93, 12 months 0.67, 0.90 and 24 months 0.82, 0.81. Implementing individualised RCE-based intervals would reduce the proportion of people becoming screen-positive before the allocated screening date by > 50% and the number of episodes by 30%.

Conclusions/interpretation

The Liverpool RCE shows sufficient performance for a local introduction into practice before wider implementation, subject to external validation. This approach offers potential enhancements of screening in improved local applicability, targeting and cost-effectiveness.
Appendix
Available only for authorised users
Literature
1.
go back to reference Wild S, Roglic G, Green A, Sicree R, King H (2004) Global prevalence of diabetes: estimates for the year 2000 and projections for 2030. Diabetes Care 227:1047–1053CrossRef Wild S, Roglic G, Green A, Sicree R, King H (2004) Global prevalence of diabetes: estimates for the year 2000 and projections for 2030. Diabetes Care 227:1047–1053CrossRef
3.
go back to reference Scanlon PH (2008) The English national screening programme for sight-threatening diabetic retinopathy. J Med Screen 15:1–4CrossRefPubMed Scanlon PH (2008) The English national screening programme for sight-threatening diabetic retinopathy. J Med Screen 15:1–4CrossRefPubMed
4.
go back to reference Chalk D, Pitt M, Vaidya B, Stein K (2012) Can the retinal screening interval be safely increased to 2 years for type 2 diabetic patients without retinopathy? Diabetes Care 35:1663–1668CrossRefPubMedPubMedCentral Chalk D, Pitt M, Vaidya B, Stein K (2012) Can the retinal screening interval be safely increased to 2 years for type 2 diabetic patients without retinopathy? Diabetes Care 35:1663–1668CrossRefPubMedPubMedCentral
5.
go back to reference Olafsdottir E, Stefansson E (2007) Biennial eye screening in patients with diabetes without retinopathy: 10-year experience. Br J Ophthalmol 91:1599–1601CrossRefPubMedPubMedCentral Olafsdottir E, Stefansson E (2007) Biennial eye screening in patients with diabetes without retinopathy: 10-year experience. Br J Ophthalmol 91:1599–1601CrossRefPubMedPubMedCentral
6.
go back to reference Looker HC, Nyangoma SO, Cromie DT et al (2013) Predicted impact of extending the screening interval for diabetic retinopathy: the Scottish Diabetic Retinopathy Screening programme. Diabetologia 56:1716–1725CrossRefPubMedPubMedCentral Looker HC, Nyangoma SO, Cromie DT et al (2013) Predicted impact of extending the screening interval for diabetic retinopathy: the Scottish Diabetic Retinopathy Screening programme. Diabetologia 56:1716–1725CrossRefPubMedPubMedCentral
7.
go back to reference Leese GP, Stratton IM, Land M et al (2015) Progression of diabetes retinal status within community screening programs and potential implications for screening intervals. Diabetes Care 38:488–494CrossRefPubMed Leese GP, Stratton IM, Land M et al (2015) Progression of diabetes retinal status within community screening programs and potential implications for screening intervals. Diabetes Care 38:488–494CrossRefPubMed
8.
go back to reference Echouffo–Tcheugui BJ, Ali MK, Roglic G, Hayward RA, Narayan KM (2013) Screening intervals for diabetic retinopathy and incidence of visual loss: a systematic review. Diabet Med 30:1272–1292CrossRefPubMed Echouffo–Tcheugui BJ, Ali MK, Roglic G, Hayward RA, Narayan KM (2013) Screening intervals for diabetic retinopathy and incidence of visual loss: a systematic review. Diabet Med 30:1272–1292CrossRefPubMed
10.
go back to reference Agardh E, Tababat-Khani P (2011) Adopting 3-year screening intervals for sight-threatening retinal vascular lesions in type 2 diabetic subjects without retinopathy. Diabetes Care 34:1318–1319CrossRefPubMedPubMedCentral Agardh E, Tababat-Khani P (2011) Adopting 3-year screening intervals for sight-threatening retinal vascular lesions in type 2 diabetic subjects without retinopathy. Diabetes Care 34:1318–1319CrossRefPubMedPubMedCentral
11.
go back to reference Scanlon PH, Aldington SJ, Leal J et al (2015) Development of a cost-effectiveness model for optimisation of the screening interval in diabetic retinopathy screening. Health Technol Assess 19:74CrossRef Scanlon PH, Aldington SJ, Leal J et al (2015) Development of a cost-effectiveness model for optimisation of the screening interval in diabetic retinopathy screening. Health Technol Assess 19:74CrossRef
12.
go back to reference Lindenmeyer A, Sturt JA, Hipwell A et al (2014) Influence of primary care practices on patients’ uptake of diabetic retinopathy screening: a qualitative case study. Br J Gen Pract 64:e484–e492CrossRefPubMedPubMedCentral Lindenmeyer A, Sturt JA, Hipwell A et al (2014) Influence of primary care practices on patients’ uptake of diabetic retinopathy screening: a qualitative case study. Br J Gen Pract 64:e484–e492CrossRefPubMedPubMedCentral
13.
go back to reference Taylor-Phillips S, Mistry H, Leslie R et al (2016) Extending the diabetic retinopathy screening interval beyond 1 year: systematic review. Br J Ophthalmol 100:105–114CrossRefPubMed Taylor-Phillips S, Mistry H, Leslie R et al (2016) Extending the diabetic retinopathy screening interval beyond 1 year: systematic review. Br J Ophthalmol 100:105–114CrossRefPubMed
14.
go back to reference Hayes AJ, Leal J, Gray AM, Holman RR, Clarke PM (2013) UKPDS outcomes model 2: a new version of a model to simulate lifetime health outcomes of patients with type 2 diabetes mellitus using data from the 30 year United Kingdom Prospective Diabetes Study: UKPDS 82. Diabetologia 56:1925–1933CrossRefPubMed Hayes AJ, Leal J, Gray AM, Holman RR, Clarke PM (2013) UKPDS outcomes model 2: a new version of a model to simulate lifetime health outcomes of patients with type 2 diabetes mellitus using data from the 30 year United Kingdom Prospective Diabetes Study: UKPDS 82. Diabetologia 56:1925–1933CrossRefPubMed
15.
go back to reference Aspelund T, Þórisdóttir O, Ólafsdottir E et al (2011) Individual risk assessment and information technology to optimise screening frequency for diabetic retinopathy. Diabetologia 54:2525–2532CrossRefPubMed Aspelund T, Þórisdóttir O, Ólafsdottir E et al (2011) Individual risk assessment and information technology to optimise screening frequency for diabetic retinopathy. Diabetologia 54:2525–2532CrossRefPubMed
16.
go back to reference Papoulis A (1991) Probability, random variables, and stochastic processes, 3rd edn. McGraw-Hill, New York Papoulis A (1991) Probability, random variables, and stochastic processes, 3rd edn. McGraw-Hill, New York
17.
go back to reference Stratton IM, Aldington SJ, Taylor DJ, Adler AI, Scanlon PS (2013) A simple risk stratification for time to development of sight-threatening diabetic retinopathy. Diabetes Care 36:580–585CrossRefPubMedPubMedCentral Stratton IM, Aldington SJ, Taylor DJ, Adler AI, Scanlon PS (2013) A simple risk stratification for time to development of sight-threatening diabetic retinopathy. Diabetes Care 36:580–585CrossRefPubMedPubMedCentral
18.
go back to reference Kalbfleisch JD, Lawless JF (1985) The analysis of panel data under a Markov assumption. J Am Stat Assoc 80:863–871CrossRef Kalbfleisch JD, Lawless JF (1985) The analysis of panel data under a Markov assumption. J Am Stat Assoc 80:863–871CrossRef
19.
go back to reference Kay R (1986) A Markov model for analysing cancer markers and disease states in survival studies. Biometrics 42:855–865CrossRefPubMed Kay R (1986) A Markov model for analysing cancer markers and disease states in survival studies. Biometrics 42:855–865CrossRefPubMed
20.
go back to reference Titman AC, Sharples LD (2010) Model diagnostics for multi-state models. Stat Methods Med Res 19:621–651CrossRefPubMed Titman AC, Sharples LD (2010) Model diagnostics for multi-state models. Stat Methods Med Res 19:621–651CrossRefPubMed
21.
go back to reference van Buuren S (2012) Flexible imputation of missing data. Chapman & Hall/CRC Press, Boca RatonCrossRef van Buuren S (2012) Flexible imputation of missing data. Chapman & Hall/CRC Press, Boca RatonCrossRef
22.
go back to reference Harrell FE (2001) Regression modelling strategies: with applications to linear models, logistic regression, and survival analysis. Springer, New YorkCrossRef Harrell FE (2001) Regression modelling strategies: with applications to linear models, logistic regression, and survival analysis. Springer, New YorkCrossRef
23.
go back to reference Burnham KP, Anderson DR (2004) Multimodal inference: understanding AIC and BIC in model selection. Sociol Methods Res 33:261–304CrossRef Burnham KP, Anderson DR (2004) Multimodal inference: understanding AIC and BIC in model selection. Sociol Methods Res 33:261–304CrossRef
24.
go back to reference Austin PC, van Klaveren D, Vergouwe Y, Nieboer D, Lee DS, Steyerberg EW (2016) Geographic and temporal validity of prediction models: different approaches were useful to examine model performance. J Clin Epidemiol 79:76–85CrossRefPubMed Austin PC, van Klaveren D, Vergouwe Y, Nieboer D, Lee DS, Steyerberg EW (2016) Geographic and temporal validity of prediction models: different approaches were useful to examine model performance. J Clin Epidemiol 79:76–85CrossRefPubMed
25.
go back to reference van der Heijden AAWA, Walraven I, van’t Riet E (2014) Validation of a model to estimate personalised screening frequency to monitor diabetic retinopathy. Diabetologia 57:1332–1338CrossRefPubMed van der Heijden AAWA, Walraven I, van’t Riet E (2014) Validation of a model to estimate personalised screening frequency to monitor diabetic retinopathy. Diabetologia 57:1332–1338CrossRefPubMed
26.
go back to reference Hippisley-Cox J, Coupland C (2015) Development and validation of risk prediction equations to estimate future risk of blindness and lower limb amputation in patients with diabetes: cohort study. BMJ 351:h5441CrossRefPubMedPubMedCentral Hippisley-Cox J, Coupland C (2015) Development and validation of risk prediction equations to estimate future risk of blindness and lower limb amputation in patients with diabetes: cohort study. BMJ 351:h5441CrossRefPubMedPubMedCentral
27.
go back to reference Stratton IM, Aldington SJ, Farmer AJ, Scanlon PH (2014) Personalised risk estimation for progression to sight-threatening diabetic retinopathy: how much does clinical information add to screening data? Diabet Med 31(Suppl1):23–24 Stratton IM, Aldington SJ, Farmer AJ, Scanlon PH (2014) Personalised risk estimation for progression to sight-threatening diabetic retinopathy: how much does clinical information add to screening data? Diabet Med 31(Suppl1):23–24
28.
go back to reference Younis N, Broadbent DM, Vora JP, Harding SP (2003) Incidence of sight threatening retinopathy in type 2 diabetes in a systematic screening programme. Lancet 361:195–200CrossRefPubMed Younis N, Broadbent DM, Vora JP, Harding SP (2003) Incidence of sight threatening retinopathy in type 2 diabetes in a systematic screening programme. Lancet 361:195–200CrossRefPubMed
29.
go back to reference Porta M, Maurino M, Severini S et al (2013) Clinical characteristics influence screening intervals for diabetic retinopathy. Diabetologia 56:2147–2152CrossRefPubMed Porta M, Maurino M, Severini S et al (2013) Clinical characteristics influence screening intervals for diabetic retinopathy. Diabetologia 56:2147–2152CrossRefPubMed
30.
go back to reference Moons KGM, Kengne AP, Woodward M et al (2012) Risk prediction models: I. Development, internal validation, and assessing the incremental value of a new (bio)marker. Heart 98:683–690CrossRefPubMed Moons KGM, Kengne AP, Woodward M et al (2012) Risk prediction models: I. Development, internal validation, and assessing the incremental value of a new (bio)marker. Heart 98:683–690CrossRefPubMed
31.
go back to reference Moons KGM, Kengne AP, Grobbee DE et al (2012) Risk prediction models: II. External validation, model updating, and impact assessment. Heart 98:691–698CrossRefPubMed Moons KGM, Kengne AP, Grobbee DE et al (2012) Risk prediction models: II. External validation, model updating, and impact assessment. Heart 98:691–698CrossRefPubMed
Metadata
Title
Individualised variable-interval risk-based screening for sight-threatening diabetic retinopathy: the Liverpool Risk Calculation Engine
Authors
Antonio Eleuteri
Anthony C. Fisher
Deborah M. Broadbent
Marta García-Fiñana
Christopher P. Cheyne
Amu Wang
Irene M. Stratton
Mark Gabbay
Daniel Seddon
Simon P. Harding
for the Individualised Screening for Diabetic Retinopathy (ISDR) Study Group
Publication date
01-11-2017
Publisher
Springer Berlin Heidelberg
Published in
Diabetologia / Issue 11/2017
Print ISSN: 0012-186X
Electronic ISSN: 1432-0428
DOI
https://doi.org/10.1007/s00125-017-4386-0

Other articles of this Issue 11/2017

Diabetologia 11/2017 Go to the issue
Obesity Clinical Trial Summary

At a glance: The STEP trials

A round-up of the STEP phase 3 clinical trials evaluating semaglutide for weight loss in people with overweight or obesity.

Developed by: Springer Medicine

Highlights from the ACC 2024 Congress

Year in Review: Pediatric cardiology

Watch Dr. Anne Marie Valente present the last year's highlights in pediatric and congenital heart disease in the official ACC.24 Year in Review session.

Year in Review: Pulmonary vascular disease

The last year's highlights in pulmonary vascular disease are presented by Dr. Jane Leopold in this official video from ACC.24.

Year in Review: Valvular heart disease

Watch Prof. William Zoghbi present the last year's highlights in valvular heart disease from the official ACC.24 Year in Review session.

Year in Review: Heart failure and cardiomyopathies

Watch this official video from ACC.24. Dr. Biykem Bozkurt discusses last year's major advances in heart failure and cardiomyopathies.