Skip to main content
Key Specialties
Cardiology Diabetology Endocrinology Gastroenterology Geriatrics and Gerontology Gynecology and Obstetrics Hematology Infectious Disease Internal Medicine Nephrology Neurology Oncology Pediatrics Respiratory Medicine Rheumatology Surgery
Congress Coverage
2024 ACC Congress 2023 ESMO Congress 2023 EASD Congress 2023 ERS Congress 2023 ESC Congress
Clinical Collections
Advances in Alzheimer’s

At a glance: The STEP trials

A round-up of the STEP phase 3 clinical trials evaluating semaglutide for weight loss in people with overweight or obesity.
ADVANCED SEARCH
Log in
Top
BMC Medical Informatics and Decision Making
Published in: BMC Medical Informatics and Decision Making 1/2006

Open Access 01-12-2006 | Research article

A review of randomized controlled trials comparing the effectiveness of hand held computers with paper methods for data collection

Authors: Shannon J Lane, Nancy M Heddle, Emmy Arnold, Irwin Walker

Published in: BMC Medical Informatics and Decision Making | Issue 1/2006

Login to get access

Abstract

Background

Handheld computers are increasingly favoured over paper and pencil methods to capture data in clinical research.

Methods

This study systematically identified and reviewed randomized controlled trials (RCTs) that compared the two methods for self-recording and reporting data, and where at least one of the following outcomes was assessed: data accuracy; timeliness of data capture; and adherence to protocols for data collection.

Results

A comprehensive key word search of NLM Gateway's database yielded 9 studies fitting the criteria for inclusion. Data extraction was performed and checked by two of the authors. None of the studies included all outcomes. The results overall, favor handheld computers over paper and pencil for data collection among study participants but the data are not uniform for the different outcomes. Handheld computers appear superior in timeliness of receipt and data handling (four of four studies) and are preferred by most subjects (three of four studies). On the other hand, only one of the trials adequately compared adherence to instructions for recording and submission of data (handheld computers were superior), and comparisons of accuracy were inconsistent between five studies.

Conclusion

Handhelds are an effective alternative to paper and pencil modes of data collection; they are faster and were preferred by most users.
Literature
1.
van Gerven JM, Schoemaker RC, Jacobs LD, Reints A, MJ OM, Hoedemaker HG, Cohen AF: Self-medication of a single headache episode with ketoprofen, ibuprofen or placebo, home-monitored with an electronic patient diary. Br J Clin Pharmacol. 1996, 42: 475-481. 10.1046/j.1365-2125.1996.43613.x.CrossRefPubMedPubMedCentral
2.
Jamison RN, Raymond SA, Levine JG, Slawsby EA, Nedeljkovic SS, Katz NP: Electronic diaries for monitoring chronic pain: 1-year validation study. Pain. 2001, 91: 277-285. 10.1016/S0304-3959(00)00450-4.CrossRefPubMed
3.
Scharer LO, Hartweg V, Hoern M, Graesslin Y, Strobl N, Frey S, Biedermann C, Walser S, Walden J: Electronic diary for bipolar patients. Neuropsychobiology. 2002, 46 Suppl 1: 10-12.PubMed
4.
5.
Caro JJS, Caro I, Caro J, Wouters F, Juniper EF: Does electronic implementation of questionnaires used in asthma alter responses compared to paper implementation?. Qual Life Res. 2001, 10: 683-691. 10.1023/A:1013811109820.CrossRefPubMed
6.
Gupta PC: Survey of sociodemographic characteristics of tobacco use among 99,598 individuals in Bombay, India using handheld computers. Tob Control. 1996, 5: 114-120.CrossRefPubMedPubMedCentral
7.
Saleh KJ, Radosevich DM, Kassim RA, Moussa M, Dykes D, Bottolfson H, Gioe TJ, Robinson H: Comparison of commonly used orthopaedic outcome measures using palm-top computers and paper surveys. J Orthop Res. 2002, 20: 1146-1151. 10.1016/S0736-0266(02)00059-1.CrossRefPubMed
8.
Rabin JM, McNett J, Badlani GH: A computerized voiding diary. J Reprod Med. 1996, 41: 801-806.PubMed
9.
Rabin JM, McNett J, Badlani GH: "Compu-Void II": the computerized voiding diary. J Med Syst. 1996, 20: 19-34. 10.1007/BF02260871.CrossRefPubMed
10.
Shiffman S, Hufford M, Hickcox M, Paty JA, Gnys M, Kassel JD: Remember that? A comparison of real-time versus retrospective recall of smoking lapses. J Consult Clin Psychol. 1997, 65: 292-300. 10.1037/0022-006X.65.2.292.a.CrossRefPubMed
11.
Shiffman S, Elash CA, Paton SM, Gwaltney CJ, Paty JA, Clark DB, Liu KS, Di Marino ME: Comparative efficacy of 24-hour and 16-hour transdermal nicotine patches for relief of morning craving. Addiction. 2000, 95: 1185-1195. 10.1046/j.1360-0443.2000.95811855.x.CrossRefPubMed
12.
Wright P, Rogers N, Hall C, Wilson B, Evans J, Emslie H, Bartram C: Comparison of pocket-computer memory aids for people with brain injury. Brain Inj. 2001, 15: 787-800. 10.1080/02699050110045161.CrossRefPubMed
13.
Wright P, Rogers N, Hall C, Wilson B, Evans J, Emslie H: Enhancing an appointment diary on a pocket computer for use by people after brain injury. Int J Rehabil Res. 2001, 24: 299-308. 10.1097/00004356-200112000-00006.CrossRefPubMed
14.
Johannes CB, Crawford SL, Woods J, Goldstein RB, Tran D, Mehrotra S, Johnson KB, Santoro N: An electronic menstrual cycle calendar: comparison of data quality with a paper version. Menopause. 2000, 7: 200-208.CrossRefPubMed
15.
Selanikio JD, Kemmer TM, Bovill M, Geisler K: Mobile computing in the humanitarian assistance setting: an introduction and some first steps. J Med Syst. 2002, 26: 113-125. 10.1023/A:1014853825636.CrossRefPubMed
16.
Fletcher LA, Erickson DJ, Toomey TL, Wagenaar AC: Handheld computers. A feasible alternative to paper forms for field data collection. Eval Rev. 2003, 27: 165-178. 10.1177/0193841X02250527.CrossRefPubMed
17.
Clarke WL, Cox DJ, Gonder-Frederick LA, Kovatchev B: Hypoglycemia and the decision to drive a motor vehicle by persons with diabetes. JAMA. 1999, 282: 750-754. 10.1001/jama.282.8.750.CrossRefPubMed
18.
Wegner KE, Smyth JM, Crosby RD, Wittrock D, Wonderlich SA, Mitchell JE: An evaluation of the relationship between mood and binge eating in the natural environment using ecological momentary assessment. Int J Eat Disord. 2002, 32: 352-361. 10.1002/eat.10086.CrossRefPubMed
19.
Iregui M, Ward S, Clinikscale D, Clayton D, Kollef MH: Use of a handheld computer by respiratory care practitioners to improve the efficiency of weaning patients from mechanical ventilation. Crit Care Med. 2002, 30: 2038-2043. 10.1097/00003246-200209000-00014.CrossRefPubMed
20.
Sellors JW, Hayward R, Swanson G, Ali A, Haynes RB, Bourque R, Moore KA, Lohfeld L, Dalby D, Howard M: Comparison of deferral rates using a computerized versus written blood donor questionnaire: a randomized, cross-over study [ISRCTN84429599]25. BMC Public Health. 2002, 2: 14-10.1186/1471-2458-2-14.CrossRefPubMedPubMedCentral
21.
Henker B, Whalen CK, Jamner LD, Delfino RJ: Anxiety, affect, and activity in teenagers: monitoring daily life with electronic diaries. J Am Acad Child Adolesc Psychiatry. 2002, 41: 660-670. 10.1097/00004583-200206000-00005.CrossRefPubMed
22.
23.
Miller SM, Beattie MM, Butt AA: Personal digital assistant infectious diseases applications for health care professionals. Clin Infect Dis. 2003, 36: 1018-1029. 10.1086/368198.CrossRefPubMed
24.
MM W, R S, C H, WP M, JL W: Clinical documentation: the handheld computer as a survival tool. MD Computing. 1998, 15: 356-358.
25.
W G, A H, Gillies: Hand-held computers in healthcare: what software programs are available?. New Zealand Medical Journal. 2002, 115: U180-
26.
Keplar KE, Urbanski CJ: Personal digital assistant applications for the healthcare provider. Ann Pharmacother. 2003, 37: 287-296. 10.1345/aph.1C394.CrossRefPubMed
27.
Lehman K: Clinical nursing instructors' use of handheld computers for student recordkeeping and evaluation. J Nurs Educ. 2003, 42: 41-42.PubMed
28.
Usatine R: Teaching and practicing medicine with handheld computers. Fam Med. 2002, 34: 719-720.PubMed
29.
30.
Koop A, Mosges R: The use of handheld computers in clinical trials. Control Clin Trials. 2002, 23: 469-480. 10.1016/S0197-2456(02)00224-6.CrossRefPubMed
31.
DL S, GR N: PDQ Epidemiology. 1996, St Louis, Mosby-Year Book Inc., 48-78. 2nd edition
32.
Walker I, Sigouin C, Sek J, Almonte T, Carruthers J, Chan A, Pai M, Heddle N: Comparing hand-held computers and paper diaries for haemophilia home therapy: a randomized trial. Haemophilia. 2004, 10: 698-704. 10.1111/j.1365-2516.2004.01046.x.CrossRefPubMed
33.
Quinn P, Goka J, Richardson H: Assessment of an electronic daily diary in patients with overactive bladder. BJU Int. 2003, 91: 647-652. 10.1046/j.1464-410X.2003.04168.x.CrossRefPubMed
34.
Jamison RN, Gracely RH, Raymond SA, Levine JG, Marino B, Herrmann TJ, Daly M, Fram D, Katz NP: Comparative study of electronic vs. paper VAS ratings: a randomized, crossover trial using healthy volunteers. Pain. 2002, 99: 341-347. 10.1016/S0304-3959(02)00178-1.CrossRefPubMed
35.
Lal SO, Smith FW, Davis JP, Castro HY, Smith DW, Chinkes DL, Barrow RE: Palm computer demonstrates a fast and accurate means of burn data collection. J Burn Care Rehabil. 2000, 21: 559-561.CrossRefPubMed
36.
McBride JS, Anderson RT, Bahnson JL: Using a hand-held computer to collect data in an orthopedic outpatient clinic: a randomized trial of two survey methods. Med Care. 1999, 37: 647-651. 10.1097/00005650-199907000-00004.CrossRefPubMed
37.
Stratton RJ, Stubbs RJ, Hughes D, King N, Blundell JE, Elia M: Comparison of the traditional paper visual analogue scale questionnaire with an Apple Newton electronic appetite rating system (EARS) in free living subjects feeding ad libitum. Eur J Clin Nutr. 1998, 52: 737-741. 10.1038/sj.ejcn.1600636.CrossRefPubMed
38.
B T, GK C, MH D, FGE B, SP M, LM CA, D. B: The use of Electronic Diaries in Respiratory Studies. Drug Information Journal. 1997, 31: 759-764.
39.
Drummond HE, Ghosh S, Ferguson A, Brackenridge D, Tiplady B: Electronic quality of life questionnaires: a comparison of pen-based electronic questionnaires with conventional paper in a gastrointestinal study. Qual Life Res. 1995, 4: 21-26. 10.1007/BF00434379.CrossRefPubMed
40.
Rivellese AA, Ventura MM, Vespasiani G, Bruni M, Moriconi V, Pacioni D, Sulpini MT, Borrelli R, Giacco A, Cangemi C, .: Evaluation of new computerized method for recording 7-day food intake in IDDM patients. Diabetes Care. 1991, 14: 602-604.CrossRefPubMed
41.
Arnold E, Heddle N, Lane S, Sek J, Almonte T, Walker I: Handheld computers and paper diaries for documenting the use of factor concentrates used in haemophilia home therapy: a qualitative study. Haemophilia. 2005, 11: 216-226. 10.1111/j.1365-2516.2005.01095.x.CrossRefPubMed
42.
Christiansen DH, Hosking JD, Dannenberg AL, Williams OD: Computer-assisted data collection in multicenter epidemiologic research. The Atherosclerosis Risk in Communities Study. Control Clin Trials. 1990, 11: 101-115. 10.1016/0197-2456(90)90004-L.CrossRefPubMed
43.
Robinson D: Data capture using hand-held computers. J Psychiatr Ment Health Nurs. 1994, 1: 126-127.CrossRefPubMed
44.
45.
A L, J W, .: Data capture from the sponsors' and investigator's perspective: Balancing quality, speed, and cost. Drug Information Journal. 1998, 32: 871-886.CrossRef
46.
Stone AA, Shiffman S, Schwartz JE, Broderick JE, Hufford MR: Patient non-compliance with paper diaries. BMJ. 2002, 324: 1193-1194. 10.1136/bmj.324.7347.1193.CrossRefPubMedPubMedCentral
47.
Stone AA, Shiffman S, Schwartz JE, Broderick JE, Hufford MR: Patient compliance with paper and electronic diaries. Control Clin Trials. 2003, 24: 182-199. 10.1016/S0197-2456(02)00320-3.CrossRefPubMed
48.
Ricard N, Kind P, Christian S, Jensen M, Stewart J: Link between patient preferences and treatment outcomes in seasonal allergic rhinitis: an empiric investigation. Clin Ther. 1999, 21: 268-277. 10.1016/S0149-2918(00)88284-3.CrossRefPubMed
49.
Kaplan B: Evaluating informatics applications--some alternative approaches: theory, social interactionism, and call for methodological pluralism. Int J Med Inform. 2001, 64: 39-56. 10.1016/S1386-5056(01)00184-8.CrossRefPubMed
50.
A S: Integrating quantitative and qualitative methods in patient care information system evaluation: guidance for the organizational decision maker. Methods Inf Med. 2003, 32: 141-150.
51.
Kushniruk A: Evaluation in the design of health information systems: application of approaches emerging from usability engineering. Comput Biol Med. 2002, 32: 141-149. 10.1016/S0010-4825(02)00011-2.CrossRefPubMed
Metadata
Title
A review of randomized controlled trials comparing the effectiveness of hand held computers with paper methods for data collection
Authors
Shannon J Lane
Nancy M Heddle
Emmy Arnold
Irwin Walker
Publication date
01-12-2006
Publisher
BioMed Central
Published in
BMC Medical Informatics and Decision Making / Issue 1/2006
Electronic ISSN: 1472-6947
DOI
https://doi.org/10.1186/1472-6947-6-23

Other articles of this Issue 1/2006

BMC Medical Informatics and Decision Making 1/2006 Go to the issue

Research article

Locating previously unknown patterns in data-mining results: a dual data- and knowledge-mining method

Research article

A survey of factors affecting clinician acceptance of clinical decision support

Research article

IT-adoption and the interaction of task, technology and individuals: a fit framework and a case study

Research article

Optimal management of adults with pharyngitis – a multi-criteria decision analysis

Research article

Consumer e-health education in HIV/AIDS: a pilot study of a web-based video workshop

Research article

The CAP cancer protocols – a case study of caCORE based data standards implementation to integrate with the Cancer Biomedical Informatics Grid