Skip to main content
Top
Published in: BMC Medical Informatics and Decision Making 1/2013

Open Access 01-12-2013 | Research article

Evaluation of data completeness in the electronic health record for the purpose of patient recruitment into clinical trials: a retrospective analysis of element presence

Authors: Felix Köpcke, Benjamin Trinczek, Raphael W Majeed, Björn Schreiweis, Joachim Wenk, Thomas Leusch, Thomas Ganslandt, Christian Ohmann, Björn Bergh, Rainer Röhrig, Martin Dugas, Hans-Ulrich Prokosch

Published in: BMC Medical Informatics and Decision Making | Issue 1/2013

Login to get access

Abstract

Background

Computerized clinical trial recruitment support is one promising field for the application of routine care data for clinical research. The primary task here is to compare the eligibility criteria defined in trial protocols with patient data contained in the electronic health record (EHR). To avoid the implementation of different patient definitions in multi-site trials, all participating research sites should use similar patient data from the EHR. Knowledge of the EHR data elements which are commonly available from most EHRs is required to be able to define a common set of criteria. The objective of this research is to determine for five tertiary care providers the extent of available data compared with the eligibility criteria of randomly selected clinical trials.

Methods

Each participating study site selected three clinical trials at random. All eligibility criteria sentences were broken up into independent patient characteristics, which were then assigned to one of the 27 semantic categories for eligibility criteria developed by Luo et al. We report on the fraction of patient characteristics with corresponding structured data elements in the EHR and on the fraction of patients with available data for these elements. The completeness of EHR data for the purpose of patient recruitment is calculated for each semantic group.

Results

351 eligibility criteria from 15 clinical trials contained 706 patient characteristics. In average, 55% of these characteristics could be documented in the EHR. Clinical data was available for 64% of all patients, if corresponding data elements were available. The total completeness of EHR data for recruitment purposes is 35%. The best performing semantic groups were ‘age’ (89%), ‘gender’ (89%), ‘addictive behaviour’ (74%), ‘disease, symptom and sign’ (64%) and ‘organ or tissue status’ (61%). No data was available for 6 semantic groups.

Conclusions

There exists a significant gap in structure and content between data documented during patient care and data required for patient eligibility assessment. Nevertheless, EHR data on age and gender of the patient, as well as selected information on his disease can be complete enough to allow for an effective support of the manual screening process with an intelligent preselection of patients and patient data.
Appendix
Available only for authorised users
Literature
1.
go back to reference Prokosch HU, Ganslandt T: Perspectives for medical informatics. Reusing the electronic medical record for clinical research. Methods Inf Med. 2009, 48 (1): 38-44.PubMed Prokosch HU, Ganslandt T: Perspectives for medical informatics. Reusing the electronic medical record for clinical research. Methods Inf Med. 2009, 48 (1): 38-44.PubMed
2.
go back to reference Safran C, Bloomrosen M, Hammond WE, Labkoff S, Markel-Fox S, Tang PC, Detmer DE: Toward a National Framework for the Secondary Use of Health Data: An American Medical Informatics Association White Paper. J Am Med Inform Assoc. 2007, 14: 1-9.CrossRefPubMedPubMedCentral Safran C, Bloomrosen M, Hammond WE, Labkoff S, Markel-Fox S, Tang PC, Detmer DE: Toward a National Framework for the Secondary Use of Health Data: An American Medical Informatics Association White Paper. J Am Med Inform Assoc. 2007, 14: 1-9.CrossRefPubMedPubMedCentral
3.
go back to reference Cuggia M, Besana P, Glasspool D: Comparing semi-automatic systems for recruitment of patients to clinical trials. Int J Med Inform. 2011, 80 (6): 371-388. 10.1016/j.ijmedinf.2011.02.003.CrossRefPubMed Cuggia M, Besana P, Glasspool D: Comparing semi-automatic systems for recruitment of patients to clinical trials. Int J Med Inform. 2011, 80 (6): 371-388. 10.1016/j.ijmedinf.2011.02.003.CrossRefPubMed
4.
go back to reference Ohno-Machado L, Wang S, Mar P, Boxwala A: Decision support for clinical trial eligibility determination in breast cancer. Proceedings of the AMIA symposium 6-10 November 1999 Washington, DC, USA. Edited by: Lorenzi NM. 1999, Philadelphia, PA, USA: Hanley & Belfus, 340-344. Ohno-Machado L, Wang S, Mar P, Boxwala A: Decision support for clinical trial eligibility determination in breast cancer. Proceedings of the AMIA symposium 6-10 November 1999 Washington, DC, USA. Edited by: Lorenzi NM. 1999, Philadelphia, PA, USA: Hanley & Belfus, 340-344.
5.
go back to reference Dugas M, Lange M, Berdel WE, Müller-Tidow C: Workflow to improve patient recruitment for clinical trials within hospital information systems - a case-study. Trials. 2008, 9: 2-10.1186/1745-6215-9-2.CrossRefPubMedPubMedCentral Dugas M, Lange M, Berdel WE, Müller-Tidow C: Workflow to improve patient recruitment for clinical trials within hospital information systems - a case-study. Trials. 2008, 9: 2-10.1186/1745-6215-9-2.CrossRefPubMedPubMedCentral
6.
go back to reference Patel C, Cimino JJ, Dolby J, Fokoue A, Kalyanpur A, Kershenbaum A, Ma L, Schonberg E, Srinivas K: Matching patient records to clinical trials using ontologies. ISWC'07/ASWC'07 Proceedings of the 6th international semantic web conference and 2nd Asian semantic web conference 11-15 November, 2007 Busan, Korea. Edited by: Aberer K, Choi KS, Noy N, Allemang D, Lee KI, Nixon L, Golbeck J, Mika P, Maynard D, Mizoguchi R, Schreiber G, Cudré-Mauroux P. 2007, Berlin, Germany: Springer-Verlag, 816-829. Patel C, Cimino JJ, Dolby J, Fokoue A, Kalyanpur A, Kershenbaum A, Ma L, Schonberg E, Srinivas K: Matching patient records to clinical trials using ontologies. ISWC'07/ASWC'07 Proceedings of the 6th international semantic web conference and 2nd Asian semantic web conference 11-15 November, 2007 Busan, Korea. Edited by: Aberer K, Choi KS, Noy N, Allemang D, Lee KI, Nixon L, Golbeck J, Mika P, Maynard D, Mizoguchi R, Schreiber G, Cudré-Mauroux P. 2007, Berlin, Germany: Springer-Verlag, 816-829.
7.
go back to reference Weng C, Tu SW, Sim I, Richesson R: Formal representation of eligibility criteria: a literature review. J Biomed Inform. 2010, 43 (3): 451-467. 10.1016/j.jbi.2009.12.004.CrossRefPubMed Weng C, Tu SW, Sim I, Richesson R: Formal representation of eligibility criteria: a literature review. J Biomed Inform. 2010, 43 (3): 451-467. 10.1016/j.jbi.2009.12.004.CrossRefPubMed
8.
go back to reference Lonsdale D, Tustison C, Parker C, Embley DW: Formulating Queries for Assessing Clinical Trial Eligibility. NLDB'06 Proceedings of the 11th international conference on Applications of Natural Language to Information Systems 31 May – 2 June, 2006 Klagenfurt, Austria. Edited by: Kop C, Fliedl G, Mayr HC, Métais E. 2006, Berlin, Germany: Springer-Verlag, 82-93. Lonsdale D, Tustison C, Parker C, Embley DW: Formulating Queries for Assessing Clinical Trial Eligibility. NLDB'06 Proceedings of the 11th international conference on Applications of Natural Language to Information Systems 31 May – 2 June, 2006 Klagenfurt, Austria. Edited by: Kop C, Fliedl G, Mayr HC, Métais E. 2006, Berlin, Germany: Springer-Verlag, 82-93.
9.
go back to reference Chan KS, Fowles JB, Weiner JP: Electronic health records and the reliability and validity of quality measures: a review of the literature. Med Care Res Rev. 2010, 67 (5): 503-527. 10.1177/1077558709359007. Epub 2010 Feb 11CrossRefPubMed Chan KS, Fowles JB, Weiner JP: Electronic health records and the reliability and validity of quality measures: a review of the literature. Med Care Res Rev. 2010, 67 (5): 503-527. 10.1177/1077558709359007. Epub 2010 Feb 11CrossRefPubMed
10.
go back to reference Pringle M, Ward P, Chilvers C: Assessment of the completeness and accuracy of computer medical records in four practices committed to recording data on computer. Br J Gen Pract. 1995, 45 (399): 537-541.PubMedPubMedCentral Pringle M, Ward P, Chilvers C: Assessment of the completeness and accuracy of computer medical records in four practices committed to recording data on computer. Br J Gen Pract. 1995, 45 (399): 537-541.PubMedPubMedCentral
11.
go back to reference Scobie S, Basnett I, McCartney P: Can general practice data be used for needs assessment and health care planning in an inner-London district?. J Public Health Med. 1995, 17 (4): 475-483.PubMed Scobie S, Basnett I, McCartney P: Can general practice data be used for needs assessment and health care planning in an inner-London district?. J Public Health Med. 1995, 17 (4): 475-483.PubMed
12.
go back to reference Forster M, Bailey C, Brinkhof MW, Graber C, Boulle A, Spohr M, Balestre E, May M, Keiser O, Jahn A, Egger M: ART-LINC collaboration of International Epidemiological Databases to Evaluate AIDS: Electronic medical record systems, data quality and loss to follow-up: survey of antiretroviral therapy programmes in resource-limited settings. Bull World Health Organ. 2008, 86 (12): 939-947. 10.2471/BLT.07.049908.CrossRefPubMedPubMedCentral Forster M, Bailey C, Brinkhof MW, Graber C, Boulle A, Spohr M, Balestre E, May M, Keiser O, Jahn A, Egger M: ART-LINC collaboration of International Epidemiological Databases to Evaluate AIDS: Electronic medical record systems, data quality and loss to follow-up: survey of antiretroviral therapy programmes in resource-limited settings. Bull World Health Organ. 2008, 86 (12): 939-947. 10.2471/BLT.07.049908.CrossRefPubMedPubMedCentral
13.
go back to reference Botsis T, Hartvigsen G, Chen F, Weng C: Secondary Use of EHR: Data Quality Issues and Informatics Opportunities. AMIA Summits Transl Sci Proc. 2010, 2010: 1-5.PubMedPubMedCentral Botsis T, Hartvigsen G, Chen F, Weng C: Secondary Use of EHR: Data Quality Issues and Informatics Opportunities. AMIA Summits Transl Sci Proc. 2010, 2010: 1-5.PubMedPubMedCentral
14.
go back to reference Luo Z, Yetisgen-Yildiz M, Weng C: Dynamic categorization of clinical research eligibility criteria by hierarchical clustering. J Biomed Inform. 2011, 44 (6): 927-935. 10.1016/j.jbi.2011.06.001. Epub 2011 Jun 12CrossRefPubMedPubMedCentral Luo Z, Yetisgen-Yildiz M, Weng C: Dynamic categorization of clinical research eligibility criteria by hierarchical clustering. J Biomed Inform. 2011, 44 (6): 927-935. 10.1016/j.jbi.2011.06.001. Epub 2011 Jun 12CrossRefPubMedPubMedCentral
15.
go back to reference Forrey AW, McDonald CJ, DeMoor G, Huff SM, Leavelle D, Leland D, Fiers T, Charles L, Griffin B, Stalling F, Tullis A, Hutchins K, Baenziger J: Logical Observation Identifiers, Names, and Codes (LOINC) database: a public use set of codes and names for electronic reporting of clinical laboratory results. Clin Chem. 1996, 42: 81-90.PubMed Forrey AW, McDonald CJ, DeMoor G, Huff SM, Leavelle D, Leland D, Fiers T, Charles L, Griffin B, Stalling F, Tullis A, Hutchins K, Baenziger J: Logical Observation Identifiers, Names, and Codes (LOINC) database: a public use set of codes and names for electronic reporting of clinical laboratory results. Clin Chem. 1996, 42: 81-90.PubMed
16.
go back to reference El Fadly A, Rance B, Lucas N, Mead C, Chatellier G, Lastic PY, Jaulent MC, Daniel C: Integrating clinical research with the Healthcare Enterprise: from the RE-USE project to the EHR4CR platform. J Biomed Inform. 2011, 44 (1): 94-102. 10.1016/j.jbi.2010.10.002. Epub 2011 Aug 25CrossRef El Fadly A, Rance B, Lucas N, Mead C, Chatellier G, Lastic PY, Jaulent MC, Daniel C: Integrating clinical research with the Healthcare Enterprise: from the RE-USE project to the EHR4CR platform. J Biomed Inform. 2011, 44 (1): 94-102. 10.1016/j.jbi.2010.10.002. Epub 2011 Aug 25CrossRef
17.
go back to reference McGinnis KA, Skanderson M, Levin FL, Brandt C, Erdos J, Justice AC: Comparison of two VA laboratory data repositories indicates that missing data vary despite originating from the same source. Medical Care. 2009, 47: 121-124. 10.1097/MLR.0b013e31817d69c2.CrossRefPubMedPubMedCentral McGinnis KA, Skanderson M, Levin FL, Brandt C, Erdos J, Justice AC: Comparison of two VA laboratory data repositories indicates that missing data vary despite originating from the same source. Medical Care. 2009, 47: 121-124. 10.1097/MLR.0b013e31817d69c2.CrossRefPubMedPubMedCentral
18.
go back to reference Persell SD, Dunne AP, Lloyd-Jones DM, Baker DW: Electronic health record-based cardiac risk assessment and identification of unmet preventive needs. Medical Care. 2009, 47: 418-424. 10.1097/MLR.0b013e31818dce21.CrossRefPubMed Persell SD, Dunne AP, Lloyd-Jones DM, Baker DW: Electronic health record-based cardiac risk assessment and identification of unmet preventive needs. Medical Care. 2009, 47: 418-424. 10.1097/MLR.0b013e31818dce21.CrossRefPubMed
19.
go back to reference Thiru K, Hassey A, Sullivan F: Systematic review of scope and quality of electronic patient record data in primary care. BMJ. 2003, 326 (7398): 1070-10.1136/bmj.326.7398.1070.CrossRefPubMedPubMedCentral Thiru K, Hassey A, Sullivan F: Systematic review of scope and quality of electronic patient record data in primary care. BMJ. 2003, 326 (7398): 1070-10.1136/bmj.326.7398.1070.CrossRefPubMedPubMedCentral
20.
go back to reference Ross J, Tu S, Carini S, Sim I: Analysis of eligibility criteria complexity in clinical trials. AMIA Summits Transl Sci Proc March 12–13, 2010. 2010, Bethesda, MD: American Medical Informatics Association, 46-50. Ross J, Tu S, Carini S, Sim I: Analysis of eligibility criteria complexity in clinical trials. AMIA Summits Transl Sci Proc March 12–13, 2010. 2010, Bethesda, MD: American Medical Informatics Association, 46-50.
21.
go back to reference Weiskopf NG, Weng C: Methods and dimensions of electronic health record data quality assessment: enabling reuse for clinical research. J Am Med Inform Assoc. 2013, 20: 144-151. 10.1136/amiajnl-2011-000681.CrossRefPubMedPubMedCentral Weiskopf NG, Weng C: Methods and dimensions of electronic health record data quality assessment: enabling reuse for clinical research. J Am Med Inform Assoc. 2013, 20: 144-151. 10.1136/amiajnl-2011-000681.CrossRefPubMedPubMedCentral
22.
go back to reference van der Lei J: Use and abuse of computer-stored medical records. Methods Inf Med. 1991, 30: 79-80.PubMed van der Lei J: Use and abuse of computer-stored medical records. Methods Inf Med. 1991, 30: 79-80.PubMed
23.
go back to reference O'Malley KJ, Cook KF, Price MD, Raiford Wildes K, Hurdle JF, Ashton CM: Measuring Diagnoses: ICD Code Accuracy. Health Serv Res. 2005, 40 (5 Pt 2): 1620-1639.CrossRefPubMedPubMedCentral O'Malley KJ, Cook KF, Price MD, Raiford Wildes K, Hurdle JF, Ashton CM: Measuring Diagnoses: ICD Code Accuracy. Health Serv Res. 2005, 40 (5 Pt 2): 1620-1639.CrossRefPubMedPubMedCentral
24.
go back to reference Campbell SE, Campbell MK, Grimshaw JM, Walker AE: A systematic review of discharge coding accuracy. J Public Health Med. 2001, 23 (3): 205-211. 10.1093/pubmed/23.3.205.CrossRefPubMed Campbell SE, Campbell MK, Grimshaw JM, Walker AE: A systematic review of discharge coding accuracy. J Public Health Med. 2001, 23 (3): 205-211. 10.1093/pubmed/23.3.205.CrossRefPubMed
Metadata
Title
Evaluation of data completeness in the electronic health record for the purpose of patient recruitment into clinical trials: a retrospective analysis of element presence
Authors
Felix Köpcke
Benjamin Trinczek
Raphael W Majeed
Björn Schreiweis
Joachim Wenk
Thomas Leusch
Thomas Ganslandt
Christian Ohmann
Björn Bergh
Rainer Röhrig
Martin Dugas
Hans-Ulrich Prokosch
Publication date
01-12-2013
Publisher
BioMed Central
Published in
BMC Medical Informatics and Decision Making / Issue 1/2013
Electronic ISSN: 1472-6947
DOI
https://doi.org/10.1186/1472-6947-13-37

Other articles of this Issue 1/2013

BMC Medical Informatics and Decision Making 1/2013 Go to the issue