Skip to main content
Top
Published in: BMC Medical Informatics and Decision Making 1/2017

Open Access 01-12-2017 | Research article

An ontology-aware integration of clinical models, terminologies and guidelines: an exploratory study of the Scale for the Assessment and Rating of Ataxia (SARA)

Authors: Haitham Maarouf, María Taboada, Hadriana Rodriguez, Manuel Arias, Ángel Sesar, María Jesús Sobrido

Published in: BMC Medical Informatics and Decision Making | Issue 1/2017

Login to get access

Abstract

Background

Electronic rating scales represent an important resource for standardized data collection. However, the ability to exploit reasoning on rating scale data is still limited. The objective of this work is to facilitate the integration of the semantics required to automatically interpret collections of standardized clinical data. We developed an electronic prototype for the Scale of the Assessment and Rating of Ataxia (SARA), broadly used in neurology. In order to address the modeling challenges of the SARA, we propose to combine the best performances from OpenEHR clinical archetypes, guidelines and ontologies.

Methods

A scaled-down version of the Human Phenotype Ontology (HPO) was built, extracting the terms that describe the SARA tests from free-text sources. This version of the HPO was then used as backbone to normalize the content of the SARA through clinical archetypes. The knowledge required to exploit reasoning on the SARA data was modeled as separate information-processing units interconnected via the defined archetypes. Each unit used the most appropriate technology to formally represent the required knowledge.

Results

Based on this approach, we implemented a prototype named SARA Management System, to be used for both the assessment of cerebellar syndrome and the production of a clinical synopsis. For validation purposes, we used recorded SARA data from 28 anonymous subjects affected by Spinocerebellar Ataxia Type 36 (SCA36). When comparing the performance of our prototype with that of two independent experts, weighted kappa scores ranged from 0.62 to 0.86.

Conclusions

The combination of archetypes, phenotype ontologies and electronic information-processing rules can be used to automate the extraction of relevant clinical knowledge from plain scores of rating scales. Our results reveal a substantial degree of agreement between the results achieved by an ontology-aware system and the human experts.
Appendix
Available only for authorised users
Literature
1.
go back to reference Robinson PN, Mungall CJ, Haendel M. Capturing phenotypes for precision medicine. Mol Case Stud. 2015;1(1):a000372.CrossRef Robinson PN, Mungall CJ, Haendel M. Capturing phenotypes for precision medicine. Mol Case Stud. 2015;1(1):a000372.CrossRef
2.
go back to reference Baynam G, Walters M, Claes P, Kung S, LeSouef P, Dawkins H, et al. Phenotyping: targeting genotype's rich cousin for diagnosis. J Paediatr Child Health. 2015;51(4):381–6.PubMed Baynam G, Walters M, Claes P, Kung S, LeSouef P, Dawkins H, et al. Phenotyping: targeting genotype's rich cousin for diagnosis. J Paediatr Child Health. 2015;51(4):381–6.PubMed
3.
go back to reference Grinnon ST, Miller K, Marler JR, Lu Y, Stout A, Odenkirchen J, Kunitz S. National institute of neurological disorders and stroke common data element project–approach and methods. Clin Trials. 2012;9(3):322–9.CrossRefPubMedPubMedCentral Grinnon ST, Miller K, Marler JR, Lu Y, Stout A, Odenkirchen J, Kunitz S. National institute of neurological disorders and stroke common data element project–approach and methods. Clin Trials. 2012;9(3):322–9.CrossRefPubMedPubMedCentral
4.
go back to reference Köhler S, Vasilevsky NA, Engelstad M, et al. The human phenotype ontology in 2017. Nucleic Acids Res. 2017;45:D865–76.CrossRefPubMed Köhler S, Vasilevsky NA, Engelstad M, et al. The human phenotype ontology in 2017. Nucleic Acids Res. 2017;45:D865–76.CrossRefPubMed
6.
go back to reference Hobart JC, Cano SJ, Zajicek JP, Thompson AJ. Rating scales as outcome measures for clinical trials in neurology: problems, solutions, and recommendations. Lancet Neurol. 2007;6(12):1094–105.CrossRefPubMed Hobart JC, Cano SJ, Zajicek JP, Thompson AJ. Rating scales as outcome measures for clinical trials in neurology: problems, solutions, and recommendations. Lancet Neurol. 2007;6(12):1094–105.CrossRefPubMed
8.
go back to reference Pangman VC, Sloan J, Guse L. An examination of psychometric properties of the mini-mental state examination and the standardized mini-mental state examination: implications for clinical practice. Appl Nurs Res. 2000;13(4):209–13.CrossRefPubMed Pangman VC, Sloan J, Guse L. An examination of psychometric properties of the mini-mental state examination and the standardized mini-mental state examination: implications for clinical practice. Appl Nurs Res. 2000;13(4):209–13.CrossRefPubMed
9.
go back to reference Teasdale G, Maas A, Lecky F, Manley G, Stocchetti N, Murray G. The Glasgow coma scale at 40 years: standing the test of time. Lancet Neurol. 2014;13(8):844–54.CrossRefPubMed Teasdale G, Maas A, Lecky F, Manley G, Stocchetti N, Murray G. The Glasgow coma scale at 40 years: standing the test of time. Lancet Neurol. 2014;13(8):844–54.CrossRefPubMed
10.
go back to reference Goetz CG, Tilley BC, Shaftman SR, Stebbins GT, Fahn S, Martinez-Martin P, et al. Movement Disorder Society-sponsored revision of the unified Parkinson’s disease rating scale (MDS-UPDRS): scale presentation and clinimetric testing results. Mov Disord. 2008;23(15):2129–70.CrossRefPubMed Goetz CG, Tilley BC, Shaftman SR, Stebbins GT, Fahn S, Martinez-Martin P, et al. Movement Disorder Society-sponsored revision of the unified Parkinson’s disease rating scale (MDS-UPDRS): scale presentation and clinimetric testing results. Mov Disord. 2008;23(15):2129–70.CrossRefPubMed
11.
go back to reference Schmitz-Hübsch T, Fimmers R, Rakowicz M, Rola R, Zdzienicka E, Fancellu R, et al. Responsiveness of different rating instruments in spinocerebellar ataxia patients. Neurol. 2010;74(8):678–84.CrossRef Schmitz-Hübsch T, Fimmers R, Rakowicz M, Rola R, Zdzienicka E, Fancellu R, et al. Responsiveness of different rating instruments in spinocerebellar ataxia patients. Neurol. 2010;74(8):678–84.CrossRef
12.
go back to reference Saute JAM, Donis KC, Serrano-Munuera C, Genis D, Ramirez LT, Mazzetti P, et al. Ataxia rating scales—psychometric profiles, natural history and their application in clinical trials. Cerebellum. 2012;11(2):488–504.CrossRefPubMed Saute JAM, Donis KC, Serrano-Munuera C, Genis D, Ramirez LT, Mazzetti P, et al. Ataxia rating scales—psychometric profiles, natural history and their application in clinical trials. Cerebellum. 2012;11(2):488–504.CrossRefPubMed
13.
go back to reference Min H, Ohira R, Collins MA, Bondy J, Avis NE, Tchuvatkina O, et al. Sharing behavioral data through a grid infrastructure using data standards. J Am Med Inform Assoc. 2014;21(4):642–9.CrossRefPubMed Min H, Ohira R, Collins MA, Bondy J, Avis NE, Tchuvatkina O, et al. Sharing behavioral data through a grid infrastructure using data standards. J Am Med Inform Assoc. 2014;21(4):642–9.CrossRefPubMed
17.
go back to reference Oniki TA, Zhuo N, Beebe CE, Liu H, Coyle JF, Parker CG, et al. Clinical element models in the SHARPn consortium. J Am Med Inform Assoc. 2016;23(2):248–56. Oniki TA, Zhuo N, Beebe CE, Liu H, Coyle JF, Parker CG, et al. Clinical element models in the SHARPn consortium. J Am Med Inform Assoc. 2016;23(2):248–56.
18.
go back to reference Braun M, Brandt AU, Schulz S, Boeker M. Validating archetypes for the multiple sclerosis functional composite. BMC Med. 2014;14(1):64.CrossRef Braun M, Brandt AU, Schulz S, Boeker M. Validating archetypes for the multiple sclerosis functional composite. BMC Med. 2014;14(1):64.CrossRef
19.
go back to reference Meizoso M, Iglesias JL, Martinez D, Taboada M. Semantic similarity-based alignment between clinical archetypes and SNOMED CT: an application to observations. Int J Med Inform. 2012;81(8):566–78.CrossRef Meizoso M, Iglesias JL, Martinez D, Taboada M. Semantic similarity-based alignment between clinical archetypes and SNOMED CT: an application to observations. Int J Med Inform. 2012;81(8):566–78.CrossRef
20.
go back to reference Berges I, Bermudez J, Illarramendi A. Binding SNOMED CT terms to archetype elements. Methods Inf Med. 2015;54(1):45–9.CrossRefPubMed Berges I, Bermudez J, Illarramendi A. Binding SNOMED CT terms to archetype elements. Methods Inf Med. 2015;54(1):45–9.CrossRefPubMed
21.
go back to reference Anani N, Chen R, Moreira TP, Koch S. Retrospective checking of compliance with practice guidelines for acute stroke care: a novel experiment using openEHR’s guideline definition language. BMC Med. 2014;14(1):39. Anani N, Chen R, Moreira TP, Koch S. Retrospective checking of compliance with practice guidelines for acute stroke care: a novel experiment using openEHR’s guideline definition language. BMC Med. 2014;14(1):39.
22.
go back to reference Lin C-H, Lo Y-C, Hung P-Y, Liou D-M. Building chronic kidney disease clinical practice guidelines using the openEHR guideline definition language. Methods Inf Med. 2016;55(6):495–505.CrossRefPubMed Lin C-H, Lo Y-C, Hung P-Y, Liou D-M. Building chronic kidney disease clinical practice guidelines using the openEHR guideline definition language. Methods Inf Med. 2016;55(6):495–505.CrossRefPubMed
23.
go back to reference Martínez-Costa C, Menárguez-Tortosa M, Fernández-Breis JT, Maldonado JA. A model-driven approach for representing clinical archetypes for semantic web environments. J Biomed Inform. 2009;42(1):150–64.CrossRefPubMed Martínez-Costa C, Menárguez-Tortosa M, Fernández-Breis JT, Maldonado JA. A model-driven approach for representing clinical archetypes for semantic web environments. J Biomed Inform. 2009;42(1):150–64.CrossRefPubMed
24.
go back to reference Lezcano L, Sicilia M-A, Rodríguez-Solano C. Integrating reasoning and clinical archetypes using OWL ontologies and SWRL rules. J Biomed Inform. 2011;44(2):343–53.CrossRefPubMed Lezcano L, Sicilia M-A, Rodríguez-Solano C. Integrating reasoning and clinical archetypes using OWL ontologies and SWRL rules. J Biomed Inform. 2011;44(2):343–53.CrossRefPubMed
25.
go back to reference Tao C, Jiang G, Oniki TA, Freimuth RR, Zhu Q, Sharma D, et al. A semantic-web oriented representation of the clinical element model for secondary use of electronic health records data. J Am Med Inform Assoc. 2013;20(3):554–62.CrossRefPubMed Tao C, Jiang G, Oniki TA, Freimuth RR, Zhu Q, Sharma D, et al. A semantic-web oriented representation of the clinical element model for secondary use of electronic health records data. J Am Med Inform Assoc. 2013;20(3):554–62.CrossRefPubMed
26.
go back to reference Menárguez-Tortosa M, Fernández-Breis JT. OWL-based reasoning methods for validating archetypes. J Biomed Inform. 2013;46(2):304–17.CrossRefPubMed Menárguez-Tortosa M, Fernández-Breis JT. OWL-based reasoning methods for validating archetypes. J Biomed Inform. 2013;46(2):304–17.CrossRefPubMed
27.
go back to reference Ellouze AS, Bouaziz R, Ghorbel H. Integrating semantic dimension into openEHR archetypes for the management of cerebral palsy electronic medical records. J Biomed Inform. 2016;63:307–24.CrossRefPubMed Ellouze AS, Bouaziz R, Ghorbel H. Integrating semantic dimension into openEHR archetypes for the management of cerebral palsy electronic medical records. J Biomed Inform. 2016;63:307–24.CrossRefPubMed
28.
go back to reference Mugzach O, Peleg M, Bagley SC, Guter SJ, Cook EH, Altman RB. An ontology for autism spectrum disorder (ASD) to infer ASD phenotypes from autism diagnostic interview-revised data. J Biomed Inform. 2015;56:333–47.CrossRefPubMedPubMedCentral Mugzach O, Peleg M, Bagley SC, Guter SJ, Cook EH, Altman RB. An ontology for autism spectrum disorder (ASD) to infer ASD phenotypes from autism diagnostic interview-revised data. J Biomed Inform. 2015;56:333–47.CrossRefPubMedPubMedCentral
29.
go back to reference Marcos M, Maldonado JA, Martínez-Salvador B, Bosca D, Robles M. Interoperability of clinical decision-support systems and electronic health records using archetypes: a case study in clinical trial eligibility. J Biomed Inform. 2013;46(4):676–89.CrossRefPubMed Marcos M, Maldonado JA, Martínez-Salvador B, Bosca D, Robles M. Interoperability of clinical decision-support systems and electronic health records using archetypes: a case study in clinical trial eligibility. J Biomed Inform. 2013;46(4):676–89.CrossRefPubMed
30.
go back to reference Fernandez-Breis JT, Maldonado JA, Marcos M, Legaz-García MDC, Moner D, Torres-Sospedra J, et al. Leveraging electronic healthcare record standards and semantic web technologies for the identification of patient cohorts. J Am Med Inform Assoc. 2013;20(e2):e288–96.CrossRefPubMedPubMedCentral Fernandez-Breis JT, Maldonado JA, Marcos M, Legaz-García MDC, Moner D, Torres-Sospedra J, et al. Leveraging electronic healthcare record standards and semantic web technologies for the identification of patient cohorts. J Am Med Inform Assoc. 2013;20(e2):e288–96.CrossRefPubMedPubMedCentral
31.
go back to reference González-Ferrer A, Peleg M. Understanding requirements of clinical data standards for developing interoperable knowledge-based DSS: a case study. Comput Stand Interfaces. 2015;42:125–36.CrossRef González-Ferrer A, Peleg M. Understanding requirements of clinical data standards for developing interoperable knowledge-based DSS: a case study. Comput Stand Interfaces. 2015;42:125–36.CrossRef
32.
go back to reference Schmitz-Hübsch T, Du Montcel ST, Baliko L, Berciano J, Boesch S, Depondt C, et al. Scale for the assessment and rating of ataxia development of a new clinical scale. Neurol. 2006;66(11):1717–20.CrossRef Schmitz-Hübsch T, Du Montcel ST, Baliko L, Berciano J, Boesch S, Depondt C, et al. Scale for the assessment and rating of ataxia development of a new clinical scale. Neurol. 2006;66(11):1717–20.CrossRef
33.
go back to reference Taboada M, Rodríguez H, Martínez D, Pardo M, Sobrido MJ. Automated semantic annotation of rare disease cases: a case study. Database. 2014;2014:bau045.CrossRefPubMedPubMedCentral Taboada M, Rodríguez H, Martínez D, Pardo M, Sobrido MJ. Automated semantic annotation of rare disease cases: a case study. Database. 2014;2014:bau045.CrossRefPubMedPubMedCentral
34.
go back to reference Seidenberg J, and Rector A. Web ontology segmentation: analysis, classification and use. Proc 15th Int conf world wide web. 2006. ACM.CrossRef Seidenberg J, and Rector A. Web ontology segmentation: analysis, classification and use. Proc 15th Int conf world wide web. 2006. ACM.CrossRef
35.
go back to reference Stuckenschmidt H, Parent C, Spaccapietra S. Modular ontologies: concepts, theories and techniques for knowledge modularization. LNCS 5445. Springer; 2009. Stuckenschmidt H, Parent C, Spaccapietra S. Modular ontologies: concepts, theories and techniques for knowledge modularization. LNCS 5445. Springer; 2009.
36.
go back to reference Horridge M, Bechhofer S. The owl api: a java api for owl ontologies. Semantic Web. 2011;2(1):11–21. Horridge M, Bechhofer S. The owl api: a java api for owl ontologies. Semantic Web. 2011;2(1):11–21.
37.
go back to reference Aguiar P, Pardo J, Arias M, Quintáns B, Fernández-Prieto M, Martínez-Regueiro R, et al. PET and MRI detection of early and progressive neurodegeneration in spinocerebellar ataxia type 36. Mov Disord. 2017;32(2):264–73. Aguiar P, Pardo J, Arias M, Quintáns B, Fernández-Prieto M, Martínez-Regueiro R, et al. PET and MRI detection of early and progressive neurodegeneration in spinocerebellar ataxia type 36. Mov Disord. 2017;32(2):264–73.
38.
go back to reference Lee S, O’Keefe RM. Developing a strategy for expert system verification and validation. IEEE Trans Syst Man Cybern. 1994;24(4):643–55.CrossRef Lee S, O’Keefe RM. Developing a strategy for expert system verification and validation. IEEE Trans Syst Man Cybern. 1994;24(4):643–55.CrossRef
39.
go back to reference Cohen J. A coefficient of agreement for nominal scales. Educ Psychol Meas. 1960;20(1):37–46.CrossRef Cohen J. A coefficient of agreement for nominal scales. Educ Psychol Meas. 1960;20(1):37–46.CrossRef
40.
go back to reference Cohen J. Weighted kappa: nominal scale agreement provision for scaled disagreement or partial credit. Psychol Bull. 1968;70(4):213.CrossRefPubMed Cohen J. Weighted kappa: nominal scale agreement provision for scaled disagreement or partial credit. Psychol Bull. 1968;70(4):213.CrossRefPubMed
41.
go back to reference Viera AJ, Garrett JM. Understanding interobserver agreement: the kappa statistic. Fam Med. 2005;37(5):360–3.PubMed Viera AJ, Garrett JM. Understanding interobserver agreement: the kappa statistic. Fam Med. 2005;37(5):360–3.PubMed
42.
go back to reference Mielke PW Jr, Berry KJ, Johnston JE. Unweighted and weighted kappa as measures of agreement for multiple judges. Int J Manag. 2009;26(2):213. Mielke PW Jr, Berry KJ, Johnston JE. Unweighted and weighted kappa as measures of agreement for multiple judges. Int J Manag. 2009;26(2):213.
43.
go back to reference Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977;33:159–74.CrossRefPubMed Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977;33:159–74.CrossRefPubMed
44.
go back to reference Pathak J, Johnson TM, Chute CG. Survey of modular ontology techniques and their applications in the biomedical domain. Integr Comput Aided Eng. 2009;16(3):225–42.PubMedPubMedCentral Pathak J, Johnson TM, Chute CG. Survey of modular ontology techniques and their applications in the biomedical domain. Integr Comput Aided Eng. 2009;16(3):225–42.PubMedPubMedCentral
45.
go back to reference Smith B, Ashburner M, Rosse C, Bard J, Bug W, Ceusters W, et al. The OBO foundry: coordinated evolution of ontologies to support biomedical data integration. Nat Biotechnol. 2007;25(11):1251–5.CrossRefPubMedPubMedCentral Smith B, Ashburner M, Rosse C, Bard J, Bug W, Ceusters W, et al. The OBO foundry: coordinated evolution of ontologies to support biomedical data integration. Nat Biotechnol. 2007;25(11):1251–5.CrossRefPubMedPubMedCentral
46.
go back to reference McCray AT, Trevvett P, Frost HR. Modeling the autism spectrum disorder phenotype. Neuroinformatics. 2013;2(2):291–305. McCray AT, Trevvett P, Frost HR. Modeling the autism spectrum disorder phenotype. Neuroinformatics. 2013;2(2):291–305.
Metadata
Title
An ontology-aware integration of clinical models, terminologies and guidelines: an exploratory study of the Scale for the Assessment and Rating of Ataxia (SARA)
Authors
Haitham Maarouf
María Taboada
Hadriana Rodriguez
Manuel Arias
Ángel Sesar
María Jesús Sobrido
Publication date
01-12-2017
Publisher
BioMed Central
Published in
BMC Medical Informatics and Decision Making / Issue 1/2017
Electronic ISSN: 1472-6947
DOI
https://doi.org/10.1186/s12911-017-0568-4

Other articles of this Issue 1/2017

BMC Medical Informatics and Decision Making 1/2017 Go to the issue