Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2014

Open Access 01-12-2014 | Research article

Comparison of two data collection processes in clinical studies: electronic and paper case report forms

Authors: Anaïs Le Jeannic, Céline Quelen, Corinne Alberti, Isabelle Durand-Zaleski

Published in: BMC Medical Research Methodology | Issue 1/2014

Login to get access

Abstract

Background

Electronic Case Report Forms (eCRFs) are increasingly chosen by investigators and sponsors of clinical research instead of the traditional pen-and-paper data collection (pCRFs). Previous studies suggested that eCRFs avoided mistakes, shortened the duration of clinical studies and reduced data collection costs.

Methods

Our objectives were to describe and contrast both objective and subjective efficiency of pCRF and eCRF use in clinical studies. A total of 27 studies (11 eCRF, 16 pCRF) sponsored by the Paris hospital consortium, conducted and completed between 2001 and 2011 were included. Questionnaires were emailed to investigators of those studies, as well as clinical research associates and data managers working in Paris hospitals, soliciting their level of satisfaction and preferences for eCRFs and pCRFs. Mean costs and timeframes were compared using bootstrap methods, linear and logistic regression.

Results

The total cost per patient was 374€ ±351 with eCRFs vs. 1,135€ ±1,234 with pCRFs. Time between the opening of the first center and the database lock was 31.7 months Q1 = 24.6; Q3 = 42.8 using eCRFs, vs. 39.8 months Q1 = 31.7; Q3 = 52.2 with pCRFs (p = 0.11). Electronic CRFs were globally preferred by all (31/72 vs. 15/72 for paper) for easier monitoring and improved data quality.

Conclusions

This study found that eCRFs and pCRFs are used in studies with different patient numbers, center numbers and risk. The first ones are more advantageous in large, low–risk studies and gain support from a majority of stakeholders.
Appendix
Available only for authorised users
Literature
1.
go back to reference Day S, Fayers P, Harvey D: Double data entry: what value, what price?. Control Clin Trials. 1998, 19: 15-24. 10.1016/S0197-2456(97)00096-2.CrossRefPubMed Day S, Fayers P, Harvey D: Double data entry: what value, what price?. Control Clin Trials. 1998, 19: 15-24. 10.1016/S0197-2456(97)00096-2.CrossRefPubMed
2.
go back to reference Nahm ML, Pieper CF, Cunningham MM: Quantifying data quality for clinical trials using electronic data capture. PLoS ONE. 2008, 3: e3049-10.1371/journal.pone.0003049.CrossRefPubMedPubMedCentral Nahm ML, Pieper CF, Cunningham MM: Quantifying data quality for clinical trials using electronic data capture. PLoS ONE. 2008, 3: e3049-10.1371/journal.pone.0003049.CrossRefPubMedPubMedCentral
3.
go back to reference Kuchinke W, Ohmann C, Yang Q, Salas N, Lauritsen J, Gueyffier F, Leizorovicz A, Schade-Brittinger C, Wittenberg M, Voko Z, Gaynor S, Cooney M, Doran P, Maggioni A, Lorimer A, Torres F, McPherson G, Charwill J, Hellstrom M, Lejeune S: Heterogeneity prevails: the state of clinical trial data management in Europe - results of a survey of ECRIN centres. Trials. 2010, 11: 79-10.1186/1745-6215-11-79.CrossRefPubMedPubMedCentral Kuchinke W, Ohmann C, Yang Q, Salas N, Lauritsen J, Gueyffier F, Leizorovicz A, Schade-Brittinger C, Wittenberg M, Voko Z, Gaynor S, Cooney M, Doran P, Maggioni A, Lorimer A, Torres F, McPherson G, Charwill J, Hellstrom M, Lejeune S: Heterogeneity prevails: the state of clinical trial data management in Europe - results of a survey of ECRIN centres. Trials. 2010, 11: 79-10.1186/1745-6215-11-79.CrossRefPubMedPubMedCentral
4.
go back to reference El Emam K, Jonker E, Sampson M, Krleza-Jerić K, Neisa A: The use of electronic data capture tools in clinical trials: Web-survey of 259 Canadian trials. J Med Internet Res. 2009, 11: e8-10.2196/jmir.1120.CrossRefPubMedPubMedCentral El Emam K, Jonker E, Sampson M, Krleza-Jerić K, Neisa A: The use of electronic data capture tools in clinical trials: Web-survey of 259 Canadian trials. J Med Internet Res. 2009, 11: e8-10.2196/jmir.1120.CrossRefPubMedPubMedCentral
5.
go back to reference Litchfield J, Freeman J, Schou H, Elsley M, Fuller R, Chubb B: Is the future for clinical trials internet-based? A cluster randomized clinical trial. Clin Trials. 2005, 2: 72-79. 10.1191/1740774505cn069oa.CrossRefPubMed Litchfield J, Freeman J, Schou H, Elsley M, Fuller R, Chubb B: Is the future for clinical trials internet-based? A cluster randomized clinical trial. Clin Trials. 2005, 2: 72-79. 10.1191/1740774505cn069oa.CrossRefPubMed
6.
go back to reference Estellat C, Tubach F, Costa Y, Hoffmann I, Mantz J, Ravaud P: Data capture by digital pen in clinical trials: a qualitative and quantitative study. Contemp Clin Trials. 2008, 29: 314-323. 10.1016/j.cct.2007.09.007.CrossRefPubMed Estellat C, Tubach F, Costa Y, Hoffmann I, Mantz J, Ravaud P: Data capture by digital pen in clinical trials: a qualitative and quantitative study. Contemp Clin Trials. 2008, 29: 314-323. 10.1016/j.cct.2007.09.007.CrossRefPubMed
7.
go back to reference Brophy S, Burrows CL, Brooks C, Gravenor MB, Siebert S, Allen SJ: Internet-based randomised controlled trials for the evaluation of complementary and alternative medicines: probiotics in spondyloarthropathy. BMC Musculoskelet Disord. 2008, 9: 4-10.1186/1471-2474-9-4.CrossRefPubMedPubMedCentral Brophy S, Burrows CL, Brooks C, Gravenor MB, Siebert S, Allen SJ: Internet-based randomised controlled trials for the evaluation of complementary and alternative medicines: probiotics in spondyloarthropathy. BMC Musculoskelet Disord. 2008, 9: 4-10.1186/1471-2474-9-4.CrossRefPubMedPubMedCentral
8.
go back to reference Kush R, Alschuler L, Ruggeri R, Cassells S, Gupta N, Bain L, Claise K, Shah M, Nahm M: Implementing single source: the STARBRITE proof-of-concept study. J Am Med Inform Assoc. 2007, 14: 662-673. 10.1197/jamia.M2157.CrossRefPubMedPubMedCentral Kush R, Alschuler L, Ruggeri R, Cassells S, Gupta N, Bain L, Claise K, Shah M, Nahm M: Implementing single source: the STARBRITE proof-of-concept study. J Am Med Inform Assoc. 2007, 14: 662-673. 10.1197/jamia.M2157.CrossRefPubMedPubMedCentral
9.
go back to reference Cole E, Pisano ED, Clary GJ, Zeng D, Koomen M, Kuzmiak CM, Seo BK, Lee Y, Pavic D: A comparative study of mobile electronic data entry systems for clinical trials data collection. Int J Med Inform. 2006, 75: 722-729. 10.1016/j.ijmedinf.2005.10.007.CrossRefPubMed Cole E, Pisano ED, Clary GJ, Zeng D, Koomen M, Kuzmiak CM, Seo BK, Lee Y, Pavic D: A comparative study of mobile electronic data entry systems for clinical trials data collection. Int J Med Inform. 2006, 75: 722-729. 10.1016/j.ijmedinf.2005.10.007.CrossRefPubMed
10.
go back to reference Brandt CA, Argraves S, Money R, Ananth G, Trocky NM, Nadkarni PM: Informatics tools to improve clinical research study implementation. Contemp Clin Trials. 2006, 27: 112-122. 10.1016/j.cct.2005.11.013.CrossRefPubMed Brandt CA, Argraves S, Money R, Ananth G, Trocky NM, Nadkarni PM: Informatics tools to improve clinical research study implementation. Contemp Clin Trials. 2006, 27: 112-122. 10.1016/j.cct.2005.11.013.CrossRefPubMed
11.
go back to reference Galliher JM, Stewart TV, Pathak PK, Werner JJ, Dickinson LM, Hickner JM: Data collection outcomes comparing paper forms with PDA forms in an office-based patient survey. Ann Fam Med. 2008, 6: 154-160. 10.1370/afm.762.CrossRefPubMedPubMedCentral Galliher JM, Stewart TV, Pathak PK, Werner JJ, Dickinson LM, Hickner JM: Data collection outcomes comparing paper forms with PDA forms in an office-based patient survey. Ann Fam Med. 2008, 6: 154-160. 10.1370/afm.762.CrossRefPubMedPubMedCentral
12.
go back to reference Herzberg S, Rahbar K, Stegger L, Schäfers M, Dugas M: Concept and implementation of a computer-based reminder system to increase completeness in clinical documentation. Int J Med Inform. 2011, 80: 351-358. 10.1016/j.ijmedinf.2011.02.004.CrossRefPubMed Herzberg S, Rahbar K, Stegger L, Schäfers M, Dugas M: Concept and implementation of a computer-based reminder system to increase completeness in clinical documentation. Int J Med Inform. 2011, 80: 351-358. 10.1016/j.ijmedinf.2011.02.004.CrossRefPubMed
13.
go back to reference Thwin SS, Clough-Gorr KM, McCarty MC, Lash TL, Alford SH, Buist DSM, Enger SM, Field TS, Frost F, Wei F, Silliman RA: Automated inter-rater reliability assessment and electronic data collection in a multi-center breast cancer study. BMC Med Res Method. 2007, 7: 23-10.1186/1471-2288-7-23.CrossRef Thwin SS, Clough-Gorr KM, McCarty MC, Lash TL, Alford SH, Buist DSM, Enger SM, Field TS, Frost F, Wei F, Silliman RA: Automated inter-rater reliability assessment and electronic data collection in a multi-center breast cancer study. BMC Med Res Method. 2007, 7: 23-10.1186/1471-2288-7-23.CrossRef
14.
go back to reference Walther B, Hossin S, Townend J, Abernethy N, Parker D, Jeffries D: Comparison of Electronic Data Capture (EDC) with the standard data capture method for clinical trial data. PLoS ONE. 2011, 6: e25348-10.1371/journal.pone.0025348.CrossRefPubMedPubMedCentral Walther B, Hossin S, Townend J, Abernethy N, Parker D, Jeffries D: Comparison of Electronic Data Capture (EDC) with the standard data capture method for clinical trial data. PLoS ONE. 2011, 6: e25348-10.1371/journal.pone.0025348.CrossRefPubMedPubMedCentral
15.
go back to reference Journot V, Pignon J-P, Gaultier C, Daurat V, Bouxin-Métro A, Giraudeau B, Preux P-M, Tréluyer J-M, Chevret S, Plättner V, Thalamas C, Clisant S, Ravaud P, Chêne G: Validation of a risk-assessment scale and a risk-adapted monitoring plan for academic clinical research studies–the Pre-Optimon study. Contemp Clin Trials. 2011, 32: 16-24. 10.1016/j.cct.2010.10.001.CrossRefPubMed Journot V, Pignon J-P, Gaultier C, Daurat V, Bouxin-Métro A, Giraudeau B, Preux P-M, Tréluyer J-M, Chevret S, Plättner V, Thalamas C, Clisant S, Ravaud P, Chêne G: Validation of a risk-assessment scale and a risk-adapted monitoring plan for academic clinical research studies–the Pre-Optimon study. Contemp Clin Trials. 2011, 32: 16-24. 10.1016/j.cct.2010.10.001.CrossRefPubMed
16.
go back to reference Paul J, Seib R, Prescott T: The Internet and clinical trials: background, online resources, examples and issues. J Med Internet Res. 2005, 7: e5-10.2196/jmir.7.1.e5.CrossRefPubMedPubMedCentral Paul J, Seib R, Prescott T: The Internet and clinical trials: background, online resources, examples and issues. J Med Internet Res. 2005, 7: e5-10.2196/jmir.7.1.e5.CrossRefPubMedPubMedCentral
17.
go back to reference Dorman K, Saade GR, Smith H, Moise KJ: Use of the world wide web in research: randomization in a multicenter clinical trial of treatment for twin-twin transfusion syndrome. Obstet Gynecol. 2000, 96: 636-639. 10.1016/S0029-7844(00)00978-9.PubMed Dorman K, Saade GR, Smith H, Moise KJ: Use of the world wide web in research: randomization in a multicenter clinical trial of treatment for twin-twin transfusion syndrome. Obstet Gynecol. 2000, 96: 636-639. 10.1016/S0029-7844(00)00978-9.PubMed
18.
go back to reference Pavlović I, Kern T, Miklavcic D: Comparison of paper-based and electronic data collection process in clinical trials: costs simulation study. Contemp Clin Trials. 2009, 30: 300-316. 10.1016/j.cct.2009.03.008.CrossRefPubMed Pavlović I, Kern T, Miklavcic D: Comparison of paper-based and electronic data collection process in clinical trials: costs simulation study. Contemp Clin Trials. 2009, 30: 300-316. 10.1016/j.cct.2009.03.008.CrossRefPubMed
19.
go back to reference Marks RG: Validating electronic source data in clinical trials. Control Clin Trials. 2004, 25: 437-446. 10.1016/j.cct.2004.07.001.CrossRefPubMed Marks RG: Validating electronic source data in clinical trials. Control Clin Trials. 2004, 25: 437-446. 10.1016/j.cct.2004.07.001.CrossRefPubMed
20.
go back to reference Lallas CD, Preminger GM, Pearle MS, Leveillee RJ, Lingeman JE, Schwope JP, Pietrow PK, Auge BK: Internet based multi-institutional clinical research: a convenient and secure option. J Urol. 2004, 171: 1880-1885. 10.1097/01.ju.0000120221.39184.3c.CrossRefPubMed Lallas CD, Preminger GM, Pearle MS, Leveillee RJ, Lingeman JE, Schwope JP, Pietrow PK, Auge BK: Internet based multi-institutional clinical research: a convenient and secure option. J Urol. 2004, 171: 1880-1885. 10.1097/01.ju.0000120221.39184.3c.CrossRefPubMed
21.
go back to reference López-Carrero C, Arriaza E, Bolaños E, Ciudad A, Municio M, Ramos J, Hesen W: Internet in clinical research based on a pilot experience. Contemp Clin Trials. 2005, 26: 234-243. 10.1016/j.cct.2004.11.017.CrossRefPubMed López-Carrero C, Arriaza E, Bolaños E, Ciudad A, Municio M, Ramos J, Hesen W: Internet in clinical research based on a pilot experience. Contemp Clin Trials. 2005, 26: 234-243. 10.1016/j.cct.2004.11.017.CrossRefPubMed
22.
go back to reference Welker JA: Implementation of electronic data capture systems: barriers and solutions. Contemp Clin Trials. 2007, 28: 329-336. 10.1016/j.cct.2007.01.001.CrossRefPubMed Welker JA: Implementation of electronic data capture systems: barriers and solutions. Contemp Clin Trials. 2007, 28: 329-336. 10.1016/j.cct.2007.01.001.CrossRefPubMed
23.
go back to reference Ventres W, Kooienga S, Vuckovic N, Marlin R, Nygren P, Stewart V: Physicians, patients, and the electronic health record: an ethnographic analysis. Ann Fam Med. 2006, 4: 124-131. 10.1370/afm.425.CrossRefPubMedPubMedCentral Ventres W, Kooienga S, Vuckovic N, Marlin R, Nygren P, Stewart V: Physicians, patients, and the electronic health record: an ethnographic analysis. Ann Fam Med. 2006, 4: 124-131. 10.1370/afm.425.CrossRefPubMedPubMedCentral
24.
go back to reference Lium J-T, Tjora A, Faxvaag A: No paper, but the same routines: a qualitative exploration of experiences in two Norwegian hospitals deprived of the paper based medical record. BMC Med Inform Decis Mak. 2008, 8: 2-10.1186/1472-6947-8-2.CrossRefPubMedPubMedCentral Lium J-T, Tjora A, Faxvaag A: No paper, but the same routines: a qualitative exploration of experiences in two Norwegian hospitals deprived of the paper based medical record. BMC Med Inform Decis Mak. 2008, 8: 2-10.1186/1472-6947-8-2.CrossRefPubMedPubMedCentral
25.
go back to reference Barber JA, Thompson SG: Analysis of cost data in randomized trials: an application of the non-parametric bootstrap. Stat Med. 2000, 19: 3219-3236. 10.1002/1097-0258(20001215)19:23<3219::AID-SIM623>3.0.CO;2-P.CrossRefPubMed Barber JA, Thompson SG: Analysis of cost data in randomized trials: an application of the non-parametric bootstrap. Stat Med. 2000, 19: 3219-3236. 10.1002/1097-0258(20001215)19:23<3219::AID-SIM623>3.0.CO;2-P.CrossRefPubMed
26.
go back to reference Marks RG, Conlon M, Ruberg SJ: Paradigm shifts in clinical trials enabled by information technology. Stat Med. 2001, 20: 2683-2696. 10.1002/sim.736.CrossRefPubMed Marks RG, Conlon M, Ruberg SJ: Paradigm shifts in clinical trials enabled by information technology. Stat Med. 2001, 20: 2683-2696. 10.1002/sim.736.CrossRefPubMed
27.
go back to reference Weber BA, Yarandi H, Rowe MA, Weber JP: A comparison study: paper-based versus web-based data collection and management. Appl Nurs Res. 2005, 18: 182-185. 10.1016/j.apnr.2004.11.003.CrossRefPubMed Weber BA, Yarandi H, Rowe MA, Weber JP: A comparison study: paper-based versus web-based data collection and management. Appl Nurs Res. 2005, 18: 182-185. 10.1016/j.apnr.2004.11.003.CrossRefPubMed
28.
go back to reference Bart T: Comparison of electronic data capture with paper data collection – Is there really an advantage? In business briefing. PharmaTech. 2003, 2003: 1-4. [World Markets Series] Bart T: Comparison of electronic data capture with paper data collection – Is there really an advantage? In business briefing. PharmaTech. 2003, 2003: 1-4. [World Markets Series]
Metadata
Title
Comparison of two data collection processes in clinical studies: electronic and paper case report forms
Authors
Anaïs Le Jeannic
Céline Quelen
Corinne Alberti
Isabelle Durand-Zaleski
Publication date
01-12-2014
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2014
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/1471-2288-14-7

Other articles of this Issue 1/2014

BMC Medical Research Methodology 1/2014 Go to the issue