Skip to main content
Top
Published in: BMC Ophthalmology 1/2006

Open Access 01-12-2006 | Research article

Development and validation of a computerized expert system for evaluation of automated visual fields from the Ischemic Optic Neuropathy Decompression Trial

Authors: Steven E Feldon, Lori Levin, Roberta W Scherer, Anthony Arnold, Sophia M Chung, Lenworth N Johnson, Gregory Kosmorsky, Steven A Newman, Joanne Katz, Patricia Langenberg, P David Wilson, Shalom E Kelman, Kay Dickersin, members of the Ischemic Optic Neuropathy Decompression Trial Research Group

Published in: BMC Ophthalmology | Issue 1/2006

Login to get access

Abstract

Background

The objective of this report is to describe the methods used to develop and validate a computerized system to analyze Humphrey visual fields obtained from patients with non-arteritic anterior ischemic optic neuropathy (NAION) and enrolled in the Ischemic Optic Neuropathy Decompression Trial (IONDT). The IONDT was a multicenter study that included randomized and non-randomized patients with newly diagnosed NAION in the study eye. At baseline, randomized eyes had visual acuity of 20/64 or worse and non-randomized eyes had visual acuity of better than 20/64 or were associated with patients refusing randomization. Visual fields were measured before treatment using the Humphrey Field Analyzer with the 24-2 program, foveal threshold, and size III stimulus.

Methods

We used visual fields from 189 non-IONDT eyes with NAION to develop the computerized classification system. Six neuro-ophthalmologists ("expert panel") described definitions for visual field patterns defects using 19 visual fields representing a range of pattern defect types. The expert panel then used 120 visual fields, classified using these definitions, to refine the rules, generating revised definitions for 13 visual field pattern defects and 3 levels of severity. These definitions were incorporated into a rule-based computerized classification system run on Excel® software. The computerized classification system was used to categorize visual field defects for an additional 95 NAION visual fields, and the expert panel was asked to independently classify the new fields and subsequently whether they agreed with the computer classification. To account for test variability over time, we derived an adjustment factor from the pooled short term fluctuation. We examined change in defects with and without adjustment in visual fields of study participants who demonstrated a visual acuity decrease within 30 days of NAION onset (progressive NAION).

Results

Despite an agreed upon set of rules, there was not good agreement among the expert panel when their independent visual classifications were compared. A majority did concur with the computer classification for 91 of 95 visual fields. Remaining classification discrepancies could not be resolved without modifying existing definitions.
Without using the adjustment factor, visual fields of 63.6% (14/22) patients with progressive NAION and no central defect, and all (7/7) patients with a paracentral defect, worsened within 30 days of NAION onset. After applying the adjustment factor, the visual fields of the same patients with no initial central defect and 5/7 of the patients with a paracentral defect were seen to worsen.

Conclusion

The IONDT developed a rule-based computerized system that consistently defines pattern and severity of visual fields of NAION patients for use in a research setting.
Appendix
Available only for authorised users
Literature
1.
go back to reference Ischemic Optic Neuropathy Decompression Trial Research Group: The Ischemic Optic Neuropathy Decompression Trial (IONDT): design and methods. Control Clin Trials. 1998, 19: 276-296. 10.1016/S0197-2456(98)00003-8.CrossRef Ischemic Optic Neuropathy Decompression Trial Research Group: The Ischemic Optic Neuropathy Decompression Trial (IONDT): design and methods. Control Clin Trials. 1998, 19: 276-296. 10.1016/S0197-2456(98)00003-8.CrossRef
2.
go back to reference Ischemic Optic Neuropathy Decompression Trial Research Group: Optic nerve decompression surgery for nonarteritic anterior ischemic optic neuropathy (NAION) is not effective and may be harmful. JAMA. 1995, 273: 625-632. 10.1001/jama.273.8.625.CrossRef Ischemic Optic Neuropathy Decompression Trial Research Group: Optic nerve decompression surgery for nonarteritic anterior ischemic optic neuropathy (NAION) is not effective and may be harmful. JAMA. 1995, 273: 625-632. 10.1001/jama.273.8.625.CrossRef
3.
go back to reference Advanced Glaucoma Intervention Study investigators: Advanced glaucoma intervention study: 2. Visual field test scoring and reliability. Ophthalmology. 1994, 101: 1445-1455.CrossRef Advanced Glaucoma Intervention Study investigators: Advanced glaucoma intervention study: 2. Visual field test scoring and reliability. Ophthalmology. 1994, 101: 1445-1455.CrossRef
4.
go back to reference Katz J, Sommer A, Gaasterland D, Anderson DR: Comparison of analytic algorithms for detecting glaucomatous visual field loss. Arch Ophthalmol. 1991, 109: 1684-1689.CrossRefPubMed Katz J, Sommer A, Gaasterland D, Anderson DR: Comparison of analytic algorithms for detecting glaucomatous visual field loss. Arch Ophthalmol. 1991, 109: 1684-1689.CrossRefPubMed
5.
go back to reference Leske MC, Heijl A, Hyman L, Bengtsson B: Early Manifest Glaucoma Trial: Design and baseline data. Ophthalmology. 1999, 106: 2144-53. 10.1016/S0161-6420(99)90497-9.CrossRefPubMed Leske MC, Heijl A, Hyman L, Bengtsson B: Early Manifest Glaucoma Trial: Design and baseline data. Ophthalmology. 1999, 106: 2144-53. 10.1016/S0161-6420(99)90497-9.CrossRefPubMed
6.
go back to reference Musch DC, Lichter PR, Guire KE, Standardi CL, the CIGTS Study Group: The Collaborative Initial Glaucoma Treatment Study: study design, methods, and baseline characteristic of enrolled patients. Ophthalmology. 1999, 106: 653-662. 10.1016/S0161-6420(99)90147-1.CrossRefPubMed Musch DC, Lichter PR, Guire KE, Standardi CL, the CIGTS Study Group: The Collaborative Initial Glaucoma Treatment Study: study design, methods, and baseline characteristic of enrolled patients. Ophthalmology. 1999, 106: 653-662. 10.1016/S0161-6420(99)90147-1.CrossRefPubMed
7.
go back to reference Keltner JL, Johnson CA, Beck RW, Cleary PA, Spurr JO, the Optic Neuritis Study Group: Quality control functions of the visual field reading center (VFRC) for the Optic Neuritis Study Group. Control Clin Trials. 1995, 14: 143-159. 10.1016/0197-2456(93)90016-7.CrossRef Keltner JL, Johnson CA, Beck RW, Cleary PA, Spurr JO, the Optic Neuritis Study Group: Quality control functions of the visual field reading center (VFRC) for the Optic Neuritis Study Group. Control Clin Trials. 1995, 14: 143-159. 10.1016/0197-2456(93)90016-7.CrossRef
8.
go back to reference Molino G, Marzuoli M, Molino F, Battista S, Bar F, Torchio M, Lavelle SM, Corless G, Cappello N: Validation of ICTERUS, a knowledge-based expert system for jaundice diagnosis. Method Inform Med. 2000, 39: 311-318. Molino G, Marzuoli M, Molino F, Battista S, Bar F, Torchio M, Lavelle SM, Corless G, Cappello N: Validation of ICTERUS, a knowledge-based expert system for jaundice diagnosis. Method Inform Med. 2000, 39: 311-318.
9.
go back to reference Choplin NT, Edwards RP: Basic principles of visual field interpretation. Visual Field Testing with the Humphrey Field Analyzer. 1995, SLACK Incorporated, Thorofare, NJ Choplin NT, Edwards RP: Basic principles of visual field interpretation. Visual Field Testing with the Humphrey Field Analyzer. 1995, SLACK Incorporated, Thorofare, NJ
10.
go back to reference Hernandez C, Sancho JJ, Belmonte MA, Sierra C, Sanz F: Validation of the medical expert system RENOIR. Comput Biomed Res. 1994, 27: 456-71. 10.1006/cbmr.1994.1034.CrossRefPubMed Hernandez C, Sancho JJ, Belmonte MA, Sierra C, Sanz F: Validation of the medical expert system RENOIR. Comput Biomed Res. 1994, 27: 456-71. 10.1006/cbmr.1994.1034.CrossRefPubMed
11.
go back to reference Sutton GC: How accurate is computer-aided diagnosis. Lancet. 1989, 2 (8668): 905-908. 10.1016/S0140-6736(89)91560-2.CrossRefPubMed Sutton GC: How accurate is computer-aided diagnosis. Lancet. 1989, 2 (8668): 905-908. 10.1016/S0140-6736(89)91560-2.CrossRefPubMed
12.
go back to reference Hirsbrunner H-P, Fankhauser F, Jenni A, Fundhouser A: Evaluating a perimetric expert system: experience with Octosmart. Graefes Arch Clin Exp Ophthalmol. 1990, 228: 237-241. 10.1007/BF00920027.CrossRefPubMed Hirsbrunner H-P, Fankhauser F, Jenni A, Fundhouser A: Evaluating a perimetric expert system: experience with Octosmart. Graefes Arch Clin Exp Ophthalmol. 1990, 228: 237-241. 10.1007/BF00920027.CrossRefPubMed
13.
go back to reference Werner EB, Saheb N, Thomas D: Variability of static visual threshold responses in patients with elevated IOPs. Arch Ophthalmol. 1982, 100: 1627-1631.CrossRefPubMed Werner EB, Saheb N, Thomas D: Variability of static visual threshold responses in patients with elevated IOPs. Arch Ophthalmol. 1982, 100: 1627-1631.CrossRefPubMed
14.
go back to reference Keltner JL, Johnson CA, Quigg JM, Cello KE, Kass MA, Gordon MO for the Ocular Hypertension Treatment Study Group: Confirmation of visual field abnormalities in the Ocular Hypertension Treatment Study. Arch Ophthalmol. 2000, 118: 1187-1194.CrossRefPubMed Keltner JL, Johnson CA, Quigg JM, Cello KE, Kass MA, Gordon MO for the Ocular Hypertension Treatment Study Group: Confirmation of visual field abnormalities in the Ocular Hypertension Treatment Study. Arch Ophthalmol. 2000, 118: 1187-1194.CrossRefPubMed
15.
go back to reference De la Rosa MG, Reyes JAA, Sierra MAG: Rapid assessment of the visual field in glaucoma using an analysis based on multiple correlations. Graefes Arch Clin Exp Ophthalmol. 1990, 228: 387-391. 10.1007/BF00927247.CrossRef De la Rosa MG, Reyes JAA, Sierra MAG: Rapid assessment of the visual field in glaucoma using an analysis based on multiple correlations. Graefes Arch Clin Exp Ophthalmol. 1990, 228: 387-391. 10.1007/BF00927247.CrossRef
16.
go back to reference Katz J: Scoring systems for measuring progression of visual field loss in clinical trials of glaucoma treatment. Ophthalmology. 1999, 106: 391-395. 10.1016/S0161-6420(99)90052-0.CrossRefPubMed Katz J: Scoring systems for measuring progression of visual field loss in clinical trials of glaucoma treatment. Ophthalmology. 1999, 106: 391-395. 10.1016/S0161-6420(99)90052-0.CrossRefPubMed
17.
go back to reference McNaught AI, Crabb DP, Fitzke FW, Hitchings RA: Modelling series of visual fields to detect progression in normal-tension glaucoma. Graefes Arch Clin Exp Ophthalmol. 1995, 233: 750-755. 10.1007/BF00184085.CrossRefPubMed McNaught AI, Crabb DP, Fitzke FW, Hitchings RA: Modelling series of visual fields to detect progression in normal-tension glaucoma. Graefes Arch Clin Exp Ophthalmol. 1995, 233: 750-755. 10.1007/BF00184085.CrossRefPubMed
18.
go back to reference Keltner JL, Johnson CA, Spurr JO, Back RW, Optic Neuritis Study Group: Baseline visual field profile of optic neuritis; the experience of the Optic Neuritis Treatment Trial. Arch Ophthalmol. 1993, 111: 231-234.CrossRefPubMed Keltner JL, Johnson CA, Spurr JO, Back RW, Optic Neuritis Study Group: Baseline visual field profile of optic neuritis; the experience of the Optic Neuritis Treatment Trial. Arch Ophthalmol. 1993, 111: 231-234.CrossRefPubMed
19.
go back to reference Keltner JL, Johnson CA, Cello KE, Edwards MA, Bandermann SE, Kass MA, Gordon MO for the Ocular Hypertension Study Group: Classification of visual field abnormalitieis in the Ocular Hypertension Treatment Study. Arch Ophthalmol. 2003, 121: 643-65. 10.1001/archopht.121.5.643.CrossRefPubMed Keltner JL, Johnson CA, Cello KE, Edwards MA, Bandermann SE, Kass MA, Gordon MO for the Ocular Hypertension Study Group: Classification of visual field abnormalitieis in the Ocular Hypertension Treatment Study. Arch Ophthalmol. 2003, 121: 643-65. 10.1001/archopht.121.5.643.CrossRefPubMed
20.
go back to reference Brigatti L, Hoffman D, Caprioli J: Neural networks to identify glaucoma with structural and functional measurements. Am J Ophthalmol. 1996, 121: 511-521.CrossRefPubMed Brigatti L, Hoffman D, Caprioli J: Neural networks to identify glaucoma with structural and functional measurements. Am J Ophthalmol. 1996, 121: 511-521.CrossRefPubMed
21.
go back to reference Goldbaum MH, Sample PA, Chan K, Williams J, Lee TW, Blumenthal E, Girkin CA, Zangwill LM, Bowd C, Sejnowski T, Weinreb RN: Comparing Machine Learning Classifiers for Diagnosing Glaucoma from Standard Automated Perimetry. Invest Ophthalmol Vis Sci. 2002, 43: 162-169.PubMed Goldbaum MH, Sample PA, Chan K, Williams J, Lee TW, Blumenthal E, Girkin CA, Zangwill LM, Bowd C, Sejnowski T, Weinreb RN: Comparing Machine Learning Classifiers for Diagnosing Glaucoma from Standard Automated Perimetry. Invest Ophthalmol Vis Sci. 2002, 43: 162-169.PubMed
22.
go back to reference Keating D, Mutlukan E, Evans A, McGarvie J, Damato B: A back propagation neural network for the classification of visual field data. Phys Med Biol. 1993, 38: 1263-1270. 10.1088/0031-9155/38/9/006.CrossRef Keating D, Mutlukan E, Evans A, McGarvie J, Damato B: A back propagation neural network for the classification of visual field data. Phys Med Biol. 1993, 38: 1263-1270. 10.1088/0031-9155/38/9/006.CrossRef
23.
go back to reference Kelman SE, Perell HF, D'Autrechy L, Scott RJ: A neural network can differentiate glaucoma and optic neuropathy visual fields through pattern recognition. Perimetry Update 1990/91. Proceedings of the Sixth International Perimetric Society Meeting, Malmo, Sweden, June 17–20, 1990. Edited by: Mills RP, Heijl A. 1991, Amsterdam/New York: Kugler Publications, 287-290. Kelman SE, Perell HF, D'Autrechy L, Scott RJ: A neural network can differentiate glaucoma and optic neuropathy visual fields through pattern recognition. Perimetry Update 1990/91. Proceedings of the Sixth International Perimetric Society Meeting, Malmo, Sweden, June 17–20, 1990. Edited by: Mills RP, Heijl A. 1991, Amsterdam/New York: Kugler Publications, 287-290.
25.
go back to reference Feldon SE: Computerized expert system for evaluation of automated visual fields from the Ischemic Optic Neuropathy Decompression Trial: Methods, baseline fields, and six-month longitudinal follow-up. Trans Am Ophthalmol Soc. 2004, 102: 269-303.PubMedPubMedCentral Feldon SE: Computerized expert system for evaluation of automated visual fields from the Ischemic Optic Neuropathy Decompression Trial: Methods, baseline fields, and six-month longitudinal follow-up. Trans Am Ophthalmol Soc. 2004, 102: 269-303.PubMedPubMedCentral
Metadata
Title
Development and validation of a computerized expert system for evaluation of automated visual fields from the Ischemic Optic Neuropathy Decompression Trial
Authors
Steven E Feldon
Lori Levin
Roberta W Scherer
Anthony Arnold
Sophia M Chung
Lenworth N Johnson
Gregory Kosmorsky
Steven A Newman
Joanne Katz
Patricia Langenberg
P David Wilson
Shalom E Kelman
Kay Dickersin
members of the Ischemic Optic Neuropathy Decompression Trial Research Group
Publication date
01-12-2006
Publisher
BioMed Central
Published in
BMC Ophthalmology / Issue 1/2006
Electronic ISSN: 1471-2415
DOI
https://doi.org/10.1186/1471-2415-6-34

Other articles of this Issue 1/2006

BMC Ophthalmology 1/2006 Go to the issue