Skip to main content
Top
Published in: BMC Health Services Research 1/2013

Open Access 01-12-2013 | Research article

Sensitivity and specificity of Norwegian optometrists’ evaluation of diabetic retinopathy in single-field retinal images – a cross-sectional experimental study

Authors: Vibeke Sundling, Pål Gulbrandsen, Jørund Straand

Published in: BMC Health Services Research | Issue 1/2013

Login to get access

Abstract

Background

In the working age group, diabetic retinopathy is a leading cause of visual impairment. Regular eye examinations and early treatment of retinopathy can prevent visual loss, so screening for diabetic retinopathy is cost-effective. Dilated retinal digital photography with the additional use of ophthalmoscopy is the most effective and robust method of diabetic retinopathy screening. The aim of this study was to estimate the sensitivity and specificity of diabetic retinopathy screening when performed by Norwegian optometrists.

Methods

This study employed a cross-sectional experimental design. Seventy-four optometrists working in private optometric practice were asked to screen 14 single-field retinal images for possible diabetic retinopathy. The screening was undertaken using a web-based visual identification and management of ophthalmological conditions (VIMOC) examination. The images used in the VIMOC examination were selected from a population survey and had been previously examined by two independent ophthalmologists. In order to establish a “gold standard”, images were only chosen for use in the VIMOC examination if they had elicited diagnostic agreement between the two independent ophthalmologists. To reduce the possibility of falsely high specificity occurring by chance, half the presented images were of retinas that were not affected by diabetic retinopathy. Sensitivity and specificity for diabetic retinopathy was calculated with 95% confidence intervals (CIs).

Results

The mean (95%CI) sensitivity for identifying eyes with any diabetic retinopathy was 67% (62% to 72%). The mean (95%CI) specificity for identifying eyes without diabetic retinopathy was 84% (80% to 89%). The mean (95%CI) sensitivity for identifying eyes with mild non-proliferative diabetic retinopathy or moderate non-proliferative diabetes was 54% (47% to 61%) and 100%, respectively. Only four optometrists (5%) met the required standard of at least 80% sensitivity and 95% specificity that has been previously set for diabetic retinopathy screening programmes.

Conclusions

The evaluation of retinal images for diabetic retinopathy by Norwegian optometrists does not meet the required screening standard of at least 80% sensitivity and 95% specificity. The introduction of measures to improve this situation could have implications for both formal optometric training and continuing optometric professional education.
Appendix
Available only for authorised users
Literature
1.
go back to reference Stene LC, Midthjell K, Jenum AK, Skeie S, Birkeland KI, Lund E, Joner G, Tell GS, Schirmer H: Hvor mange har diabetes mellitus i Norge?. [Prevalence of diabetes mellitus in Norway]. Tidsskr Nor Laegeforen. 2004, 124 (11): 1511-1514.PubMed Stene LC, Midthjell K, Jenum AK, Skeie S, Birkeland KI, Lund E, Joner G, Tell GS, Schirmer H: Hvor mange har diabetes mellitus i Norge?. [Prevalence of diabetes mellitus in Norway]. Tidsskr Nor Laegeforen. 2004, 124 (11): 1511-1514.PubMed
2.
go back to reference Sundling V, Platou CG, Jansson RW, Bertelsen G, Wøllo E, Gulbrandsen P: Retinopathy and visual impairment in diabetes, impaired glucose tolerance and normal glucose tolerance: the Nord-Trondelag Health Study (the HUNT study). Acta Ophthalmol. 2012, 90 (3): 237-243. 10.1111/j.1755-3768.2010.01998.x.CrossRefPubMed Sundling V, Platou CG, Jansson RW, Bertelsen G, Wøllo E, Gulbrandsen P: Retinopathy and visual impairment in diabetes, impaired glucose tolerance and normal glucose tolerance: the Nord-Trondelag Health Study (the HUNT study). Acta Ophthalmol. 2012, 90 (3): 237-243. 10.1111/j.1755-3768.2010.01998.x.CrossRefPubMed
3.
go back to reference Hapnes R, Bergrem H: Diabetic eye complications in a medium sized municipality in southwest Norway. Acta Ophthalmol Scand. 1996, 74 (5): 497-500.CrossRefPubMed Hapnes R, Bergrem H: Diabetic eye complications in a medium sized municipality in southwest Norway. Acta Ophthalmol Scand. 1996, 74 (5): 497-500.CrossRefPubMed
4.
go back to reference Kilstad HN, Sjolie AK, Goransson L, Hapnes R, Henschien HJ, Alsbirk KE, Fossen K, Bertelsen G, Holstad G, Bergrem H: Prevalence of diabetic retinopathy in Norway: report from a screening study. Acta Ophthalmol. 2012, 90 (7): 609-612. 10.1111/j.1755-3768.2011.02160.x.CrossRefPubMed Kilstad HN, Sjolie AK, Goransson L, Hapnes R, Henschien HJ, Alsbirk KE, Fossen K, Bertelsen G, Holstad G, Bergrem H: Prevalence of diabetic retinopathy in Norway: report from a screening study. Acta Ophthalmol. 2012, 90 (7): 609-612. 10.1111/j.1755-3768.2011.02160.x.CrossRefPubMed
5.
go back to reference Bertelsen G, Peto T, Lindekleiv H, Schirmer H, Solbu MD, Toft I, Sjolie AK, Njolstad I: Tromso eye study: prevalence and risk factors of diabetic retinopathy. Acta Ophthalmol. 2012, 10.1111/j.1755-3768.2012.02542.x. [Epub ahead of print]. Bertelsen G, Peto T, Lindekleiv H, Schirmer H, Solbu MD, Toft I, Sjolie AK, Njolstad I: Tromso eye study: prevalence and risk factors of diabetic retinopathy. Acta Ophthalmol. 2012, 10.1111/j.1755-3768.2012.02542.x. [Epub ahead of print].
6.
go back to reference Porta M, Bandello F: Diabetic retinopathy A clinical update. Diabetologia. 2002, 45 (12): 1617-1634. 10.1007/s00125-002-0990-7.CrossRefPubMed Porta M, Bandello F: Diabetic retinopathy A clinical update. Diabetologia. 2002, 45 (12): 1617-1634. 10.1007/s00125-002-0990-7.CrossRefPubMed
7.
go back to reference Olafsdottir E, Andersson DK, Stefansson E: Visual acuity in a population with regular screening for type 2 diabetes mellitus and eye disease. Acta Ophthalmol Scand. 2007, 85 (1): 40-45.CrossRefPubMed Olafsdottir E, Andersson DK, Stefansson E: Visual acuity in a population with regular screening for type 2 diabetes mellitus and eye disease. Acta Ophthalmol Scand. 2007, 85 (1): 40-45.CrossRefPubMed
8.
go back to reference Scanlon PH, Foy C, Chen FK: Visual acuity measurement and ocular co-morbidity in diabetic retinopathy screening. Br J Ophthalmol. 2008, 92 (6): 775-778. 10.1136/bjo.2007.128561.CrossRefPubMed Scanlon PH, Foy C, Chen FK: Visual acuity measurement and ocular co-morbidity in diabetic retinopathy screening. Br J Ophthalmol. 2008, 92 (6): 775-778. 10.1136/bjo.2007.128561.CrossRefPubMed
9.
go back to reference Zoega GM, Gunnarsdottir T, Bjornsdottir S, Hreietharsson AB, Viggosson G, Stefansson E: Screening compliance and visual outcome in diabetes. Acta Ophthalmol Scand. 2005, 83 (6): 687-690. 10.1111/j.1600-0420.2005.00541.x.CrossRefPubMed Zoega GM, Gunnarsdottir T, Bjornsdottir S, Hreietharsson AB, Viggosson G, Stefansson E: Screening compliance and visual outcome in diabetes. Acta Ophthalmol Scand. 2005, 83 (6): 687-690. 10.1111/j.1600-0420.2005.00541.x.CrossRefPubMed
10.
go back to reference Jeppesen P, Bek T: The occurrence and causes of registered blindness in diabetes patients in Arhus County, Denmark. Acta Ophthalmol Scand. 2004, 82 (5): 526-530. 10.1111/j.1600-0420.2004.00313.x.CrossRefPubMed Jeppesen P, Bek T: The occurrence and causes of registered blindness in diabetes patients in Arhus County, Denmark. Acta Ophthalmol Scand. 2004, 82 (5): 526-530. 10.1111/j.1600-0420.2004.00313.x.CrossRefPubMed
11.
go back to reference Prasad S, Kamath GG, Jones K, Clearkin LG, Phillips RP: Prevalence of blindness and visual impairment in a population of people with diabetes. Eye. 2001, 15 (Pt 5): 640-643.CrossRefPubMed Prasad S, Kamath GG, Jones K, Clearkin LG, Phillips RP: Prevalence of blindness and visual impairment in a population of people with diabetes. Eye. 2001, 15 (Pt 5): 640-643.CrossRefPubMed
12.
go back to reference Broadbent DM, Scott JA, Vora JP, Harding SP: Prevalence of diabetic eye disease in an inner city population: the Liverpool Diabetic Eye Study. Eye. 1999, 13: 160-165. 10.1038/eye.1999.43.CrossRefPubMed Broadbent DM, Scott JA, Vora JP, Harding SP: Prevalence of diabetic eye disease in an inner city population: the Liverpool Diabetic Eye Study. Eye. 1999, 13: 160-165. 10.1038/eye.1999.43.CrossRefPubMed
13.
go back to reference Hove MN, Kristensen JK, Lauritzen T, Bek T: The prevalence of retinopathy in an unselected population of type 2 diabetes patients from Arhus County, Denmark. Acta Ophthalmol Scand. 2004, 82 (4): 443-448. 10.1111/j.1600-0420.2004.00270.x.CrossRefPubMed Hove MN, Kristensen JK, Lauritzen T, Bek T: The prevalence of retinopathy in an unselected population of type 2 diabetes patients from Arhus County, Denmark. Acta Ophthalmol Scand. 2004, 82 (4): 443-448. 10.1111/j.1600-0420.2004.00270.x.CrossRefPubMed
14.
go back to reference Backlund LB, Algvere PV, Rosenqvist U: New blindness in diabetes reduced by more than one-third in Stockholm County. Diabet Med. 1997, 14 (9): 732-740. 10.1002/(SICI)1096-9136(199709)14:9<732::AID-DIA474>3.0.CO;2-J.CrossRefPubMed Backlund LB, Algvere PV, Rosenqvist U: New blindness in diabetes reduced by more than one-third in Stockholm County. Diabet Med. 1997, 14 (9): 732-740. 10.1002/(SICI)1096-9136(199709)14:9<732::AID-DIA474>3.0.CO;2-J.CrossRefPubMed
15.
go back to reference Kristinsson JK, Hauksdottir H, Stefansson E, Jonasson F, Gislason I: Active prevention in diabetic eye disease. A 4-year follow-up. Acta Ophthalmol Scand. 1997, 75 (3): 249-254.CrossRefPubMed Kristinsson JK, Hauksdottir H, Stefansson E, Jonasson F, Gislason I: Active prevention in diabetic eye disease. A 4-year follow-up. Acta Ophthalmol Scand. 1997, 75 (3): 249-254.CrossRefPubMed
16.
go back to reference Stefansson E, Bek T, Porta M, Larsen N, Kristinsson JK, Agardh E: Screening and prevention of diabetic blindness. Acta Ophthalmol Scand. 2000, 78 (4): 374-385. 10.1034/j.1600-0420.2000.078004374.x.CrossRefPubMed Stefansson E, Bek T, Porta M, Larsen N, Kristinsson JK, Agardh E: Screening and prevention of diabetic blindness. Acta Ophthalmol Scand. 2000, 78 (4): 374-385. 10.1034/j.1600-0420.2000.078004374.x.CrossRefPubMed
17.
go back to reference Javitt JC, Aiello LP: Cost-effectiveness of detecting and treating diabetic retinopathy. Ann Intern Med. 1996, 124 (1 Pt 2): 164-169.CrossRefPubMed Javitt JC, Aiello LP: Cost-effectiveness of detecting and treating diabetic retinopathy. Ann Intern Med. 1996, 124 (1 Pt 2): 164-169.CrossRefPubMed
18.
go back to reference Hutchinson A, McIntosh A, Peters J, O’Keeffe C, Khunti K, Baker R, Booth A: Effectiveness of screening and monitoring tests for diabetic retinopathy–a systematic review. Diabet Med. 2000, 17 (7): 495-506. 10.1046/j.1464-5491.2000.00250.x.CrossRefPubMed Hutchinson A, McIntosh A, Peters J, O’Keeffe C, Khunti K, Baker R, Booth A: Effectiveness of screening and monitoring tests for diabetic retinopathy–a systematic review. Diabet Med. 2000, 17 (7): 495-506. 10.1046/j.1464-5491.2000.00250.x.CrossRefPubMed
19.
go back to reference Gillibrand W, Broadbent D, Harding S, Vora J: The English national risk-reduction programme for preservation of sight in diabetes. Mol Cell Biochem. 2004, 261 (1–2): 183-185.CrossRefPubMed Gillibrand W, Broadbent D, Harding S, Vora J: The English national risk-reduction programme for preservation of sight in diabetes. Mol Cell Biochem. 2004, 261 (1–2): 183-185.CrossRefPubMed
20.
go back to reference Helsedirektoratet: Nasjonale faglige retningslinjer (IS-1674). Diabetes - Forebygging, diagnostikk og behandling [National professional guidelines. Diabetes - Prevention, diagnostics and treatment]. 2009, Oslo: Helsedirektoratet Helsedirektoratet: Nasjonale faglige retningslinjer (IS-1674). Diabetes - Forebygging, diagnostikk og behandling [National professional guidelines. Diabetes - Prevention, diagnostics and treatment]. 2009, Oslo: Helsedirektoratet
21.
go back to reference Claudi T, Cooper JG, Midthjell K, Daae C, Furuseth K, Hanssen KF: NSAMs handlingsprogram for diabetes i allmennpraksis 2005 (NSAMs guidelines for diabetes in general practice 2005). 2005 Claudi T, Cooper JG, Midthjell K, Daae C, Furuseth K, Hanssen KF: NSAMs handlingsprogram for diabetes i allmennpraksis 2005 (NSAMs guidelines for diabetes in general practice 2005). 2005
22.
go back to reference Optikerforbund N: Retningslinjer i klinisk optometri. 2005, Oslo: Norges Optikerforbund Optikerforbund N: Retningslinjer i klinisk optometri. 2005, Oslo: Norges Optikerforbund
23.
go back to reference Sundling V, Gulbrandsen P, Bragadottir R, Bakketeig LS, Jervell J, Straand J: Suspected retinopathies in Norwegian optometric practice with emphasis on patients with diabetes: a cross-sectional study. BMC Health Serv Res. 2008, 8: 38-10.1186/1472-6963-8-38.CrossRefPubMedPubMedCentral Sundling V, Gulbrandsen P, Bragadottir R, Bakketeig LS, Jervell J, Straand J: Suspected retinopathies in Norwegian optometric practice with emphasis on patients with diabetes: a cross-sectional study. BMC Health Serv Res. 2008, 8: 38-10.1186/1472-6963-8-38.CrossRefPubMedPubMedCentral
24.
go back to reference Schmid KL, Swann PG, Pedersen C, Schmid LM: The detection of diabetic retinopathy by Australian optometrists. Clin Exp Optom. 2002, 85 (4): 221-228. 10.1111/j.1444-0938.2002.tb03041.x.CrossRefPubMed Schmid KL, Swann PG, Pedersen C, Schmid LM: The detection of diabetic retinopathy by Australian optometrists. Clin Exp Optom. 2002, 85 (4): 221-228. 10.1111/j.1444-0938.2002.tb03041.x.CrossRefPubMed
25.
go back to reference Olson JA, Strachan FM, Hipwell JH, Goatman KA, McHardy KC, Forrester JV, Sharp PF: A comparative evaluation of digital imaging, retinal photography and optometrist examination in screening for diabetic retinopathy. Diabet Med. 2003, 20 (7): 528-534. 10.1046/j.1464-5491.2003.00969.x.CrossRefPubMed Olson JA, Strachan FM, Hipwell JH, Goatman KA, McHardy KC, Forrester JV, Sharp PF: A comparative evaluation of digital imaging, retinal photography and optometrist examination in screening for diabetic retinopathy. Diabet Med. 2003, 20 (7): 528-534. 10.1046/j.1464-5491.2003.00969.x.CrossRefPubMed
26.
go back to reference Hulme SA, Tin UA, Hardy KJ, Joyce PW: Evaluation of a district-wide screening programme for diabetic retinopathy utilizing trained optometrists using slit-lamp and Volk lenses. Diabet Med. 2002, 19 (9): 741-745. 10.1046/j.1464-5491.2002.00677.x.CrossRefPubMed Hulme SA, Tin UA, Hardy KJ, Joyce PW: Evaluation of a district-wide screening programme for diabetic retinopathy utilizing trained optometrists using slit-lamp and Volk lenses. Diabet Med. 2002, 19 (9): 741-745. 10.1046/j.1464-5491.2002.00677.x.CrossRefPubMed
27.
go back to reference Prasad S, Kamath GG, Jones K, Clearkin LG, Phillips RP: Effectiveness of optometrist screening for diabetic retinopathy using slit-lamp biomicroscopy. Eye. 2001, 15 (Pt 5): 595-601.CrossRefPubMed Prasad S, Kamath GG, Jones K, Clearkin LG, Phillips RP: Effectiveness of optometrist screening for diabetic retinopathy using slit-lamp biomicroscopy. Eye. 2001, 15 (Pt 5): 595-601.CrossRefPubMed
28.
go back to reference Gibbins RL, Owens DR, Allen JC, Eastman L: Practical application of the European Field Guide in screening for diabetic retinopathy by using ophthalmoscopy and 35 mm retinal slides. Diabetologia. 1998, 41 (1): 59-64. 10.1007/s001250050867.CrossRefPubMed Gibbins RL, Owens DR, Allen JC, Eastman L: Practical application of the European Field Guide in screening for diabetic retinopathy by using ophthalmoscopy and 35 mm retinal slides. Diabetologia. 1998, 41 (1): 59-64. 10.1007/s001250050867.CrossRefPubMed
29.
go back to reference Harvey JN, Craney L, Nagendran S, Ng CS: Towards comprehensive population-based screening for diabetic retinopathy: operation of the North Wales diabetic retinopathy screening programme using a central patient register and various screening methods. J Med Screen. 2006, 13 (2): 87-92. 10.1258/096914106777589669.CrossRefPubMed Harvey JN, Craney L, Nagendran S, Ng CS: Towards comprehensive population-based screening for diabetic retinopathy: operation of the North Wales diabetic retinopathy screening programme using a central patient register and various screening methods. J Med Screen. 2006, 13 (2): 87-92. 10.1258/096914106777589669.CrossRefPubMed
30.
go back to reference Sundling V, Gulbrandsen P, Bragadottir R, Bakketeig LS, Jervell J, Straand J: Optometric practice in Norway: a cross-sectional nationwide study. Acta Ophthalmol Scand. 2007, 85 (6): 671-676. 10.1111/j.1600-0420.2007.00929.x.CrossRefPubMed Sundling V, Gulbrandsen P, Bragadottir R, Bakketeig LS, Jervell J, Straand J: Optometric practice in Norway: a cross-sectional nationwide study. Acta Ophthalmol Scand. 2007, 85 (6): 671-676. 10.1111/j.1600-0420.2007.00929.x.CrossRefPubMed
31.
go back to reference British Diabetic Association: Retinal photographic screening for diabetic eye disease. A British Diabetic Association Report. 1997, London: British Diabetic Association British Diabetic Association: Retinal photographic screening for diabetic eye disease. A British Diabetic Association Report. 1997, London: British Diabetic Association
32.
go back to reference Aakre BM, Svarverud E: Utdanning for klinisk kompetanse (Education towards clinical competence). Optikeren. 2011, 5: 52-53. Aakre BM, Svarverud E: Utdanning for klinisk kompetanse (Education towards clinical competence). Optikeren. 2011, 5: 52-53.
33.
go back to reference Wilkinson CP, Ferris FL, Klein RE, Lee PP, Agardh CD, Davis M, Dills D, Kampik A, Pararajasegaram R, Verdaguer JT: Proposed international clinical diabetic retinopathy and diabetic macular edema disease severity scales. Ophthalmology. 2003, 110 (9): 1677-1682. 10.1016/S0161-6420(03)00475-5.CrossRefPubMed Wilkinson CP, Ferris FL, Klein RE, Lee PP, Agardh CD, Davis M, Dills D, Kampik A, Pararajasegaram R, Verdaguer JT: Proposed international clinical diabetic retinopathy and diabetic macular edema disease severity scales. Ophthalmology. 2003, 110 (9): 1677-1682. 10.1016/S0161-6420(03)00475-5.CrossRefPubMed
34.
go back to reference Buxton MJ, Sculpher MJ, Ferguson BA, Humphreys JE, Altman JF, Spiegelhalter DJ, Kirby AJ, Jacob JS, Bacon H, Dudbridge SB, et al: Screening for treatable diabetic retinopathy: a comparison of different methods. Diabet Med. 1991, 8 (4): 371-377. 10.1111/j.1464-5491.1991.tb01612.x.CrossRefPubMed Buxton MJ, Sculpher MJ, Ferguson BA, Humphreys JE, Altman JF, Spiegelhalter DJ, Kirby AJ, Jacob JS, Bacon H, Dudbridge SB, et al: Screening for treatable diabetic retinopathy: a comparison of different methods. Diabet Med. 1991, 8 (4): 371-377. 10.1111/j.1464-5491.1991.tb01612.x.CrossRefPubMed
Metadata
Title
Sensitivity and specificity of Norwegian optometrists’ evaluation of diabetic retinopathy in single-field retinal images – a cross-sectional experimental study
Authors
Vibeke Sundling
Pål Gulbrandsen
Jørund Straand
Publication date
01-12-2013
Publisher
BioMed Central
Published in
BMC Health Services Research / Issue 1/2013
Electronic ISSN: 1472-6963
DOI
https://doi.org/10.1186/1472-6963-13-17

Other articles of this Issue 1/2013

BMC Health Services Research 1/2013 Go to the issue