Skip to main content
Top
Published in: Implementation Science 1/2014

Open Access 01-12-2014 | Research

Patient-specific computer-based decision support in primary healthcare—a randomized trial

Authors: Tiina Kortteisto, Jani Raitanen, Jorma Komulainen, Ilkka Kunnamo, Marjukka Mäkelä, Pekka Rissanen, Minna Kaila

Published in: Implementation Science | Issue 1/2014

Login to get access

Abstract

Background

Computer-based decision support systems are a promising method for incorporating research evidence into clinical practice. However, evidence is still scant on how such information technology solutions work in primary healthcare when support is provided across many health problems. In Finland, we designed a trial where a set of evidence-based, patient-specific reminders was introduced into the local Electronic Patient Record (EPR) system. The aim was to measure the effects of such reminders on patient care. The hypothesis was that the total number of triggered reminders would decrease in the intervention group compared with the control group, indicating an improvement in patient care.

Methods

From July 2009 to October 2010 all the patients of one health center were randomized to an intervention or a control group. The intervention consisted of patient-specific reminders concerning 59 different health conditions triggered when the healthcare professional (HCP) opened and used the EPR. In the intervention group, the triggered reminders were shown to the HCP; in the control group, the triggered reminders were not shown. The primary outcome measure was the change in the number of reminders triggered over 12 months. We developed a unique data gathering method, the Repeated Study Virtual Health Check (RSVHC), and used Generalized Estimation Equations (GEE) for analysing the incidence rate ratio, which is a measure of the relative difference in percentage change in the numbers of reminders triggered in the intervention group and the control group.

Results

In total, 13,588 participants were randomized and included. Contrary to our expectation, the total number of reminders triggered increased in both the intervention and the control groups. The primary outcome measure did not show a significant difference between the groups. However, with the inclusion of patients followed up over only six months, the total number of reminders increased significantly less in the intervention group than in the control group when the confounding factors (age, gender, number of diagnoses and medications) were controlled for.

Conclusions

Computerized, tailored reminders in primary care did not decrease during the 12 months of follow-up time after the introduction of a patient-specific decision support system.

Trial registration

ClinicalTrial.gov NCT00915304
Appendix
Available only for authorised users
Literature
1.
go back to reference Haynes RB, Devereaux PJ, Guyatt GH: Clinical expertise in the era of evidence-based medicine and patient choice. ACP J Club. 2002, 136 (2): A11-14. Haynes RB, Devereaux PJ, Guyatt GH: Clinical expertise in the era of evidence-based medicine and patient choice. ACP J Club. 2002, 136 (2): A11-14.
2.
go back to reference Burgers JS, Grol R, Klazinga NS, Makela M, Zaat J: Towards evidence-based clinical practice: an international survey of 18 clinical guideline programs. Int J Qual Healthcare. 2003, 15 (1): 31-45. 10.1093/intqhc/15.1.31.CrossRef Burgers JS, Grol R, Klazinga NS, Makela M, Zaat J: Towards evidence-based clinical practice: an international survey of 18 clinical guideline programs. Int J Qual Healthcare. 2003, 15 (1): 31-45. 10.1093/intqhc/15.1.31.CrossRef
3.
go back to reference Fixsen DL, Naoom SF, Blase KA, Friedman RM, Frances W: Implementation research: a synthesis of the literature. 2005, Tampa: University of South Florida, Louis de la Parte Florida Mental Health Institute, The National Implementation Research Network Fixsen DL, Naoom SF, Blase KA, Friedman RM, Frances W: Implementation research: a synthesis of the literature. 2005, Tampa: University of South Florida, Louis de la Parte Florida Mental Health Institute, The National Implementation Research Network
4.
go back to reference Hojgaard L: Forward look - implementation of medical research in clinical practice. 2011, Strasbourg: European science foundation Hojgaard L: Forward look - implementation of medical research in clinical practice. 2011, Strasbourg: European science foundation
5.
go back to reference Grol R, Wensing M, Eccles M: Implementation of changes in practice. Improving patient care: the implementation of change in clinical practice. Edited by: Grol R, Wensing M, Eccles M. 2005, Edinburgh: Elsevier, 6-14. Grol R, Wensing M, Eccles M: Implementation of changes in practice. Improving patient care: the implementation of change in clinical practice. Edited by: Grol R, Wensing M, Eccles M. 2005, Edinburgh: Elsevier, 6-14.
6.
go back to reference Oxman AD, Thomson MA, Davis DA, Haynes RB: No magic bullets: a systematic review of 102 trials of interventions to improve professional practice. CMAJ. 1995, 153 (10): 1423-1431.PubMedPubMedCentral Oxman AD, Thomson MA, Davis DA, Haynes RB: No magic bullets: a systematic review of 102 trials of interventions to improve professional practice. CMAJ. 1995, 153 (10): 1423-1431.PubMedPubMedCentral
7.
go back to reference Lugtenberg M, Burgers JS, Westert GP: Effects of evidence-based clinical practice guidelines on quality of care: a systematic review. Qual Saf Healthcare. 2009, 18 (5): 385-392. 10.1136/qshc.2008.028043.CrossRef Lugtenberg M, Burgers JS, Westert GP: Effects of evidence-based clinical practice guidelines on quality of care: a systematic review. Qual Saf Healthcare. 2009, 18 (5): 385-392. 10.1136/qshc.2008.028043.CrossRef
8.
go back to reference Greenes RA: Clinical decision support: the road ahead. 2007, Boston: Academic Greenes RA: Clinical decision support: the road ahead. 2007, Boston: Academic
9.
go back to reference Garg AX, Adhikari NK, McDonald H, Rosas-Arellano MP, Devereaux PJ, Beyene J, Sam J, Haynes RB: Effects of computerized clinical decision support systems on practitioner performance and patient outcomes: a systematic review. JAMA. 2005, 293 (10): 1223-1238. 10.1001/jama.293.10.1223.CrossRefPubMed Garg AX, Adhikari NK, McDonald H, Rosas-Arellano MP, Devereaux PJ, Beyene J, Sam J, Haynes RB: Effects of computerized clinical decision support systems on practitioner performance and patient outcomes: a systematic review. JAMA. 2005, 293 (10): 1223-1238. 10.1001/jama.293.10.1223.CrossRefPubMed
10.
go back to reference Kawamoto K, Houlihan CA, Balas EA, Lobach DF: Improving clinical practice using clinical decision support systems: a systematic review of trials to identify features critical to success. BMJ. 2005, 330 (7494): 765-10.1136/bmj.38398.500764.8F.CrossRefPubMedPubMedCentral Kawamoto K, Houlihan CA, Balas EA, Lobach DF: Improving clinical practice using clinical decision support systems: a systematic review of trials to identify features critical to success. BMJ. 2005, 330 (7494): 765-10.1136/bmj.38398.500764.8F.CrossRefPubMedPubMedCentral
11.
go back to reference Shortliffe EH: Computer programs to support clinical decision making. JAMA. 1987, 258 (1): 61-66. 10.1001/jama.1987.03400010065029.CrossRefPubMed Shortliffe EH: Computer programs to support clinical decision making. JAMA. 1987, 258 (1): 61-66. 10.1001/jama.1987.03400010065029.CrossRefPubMed
12.
go back to reference Shojania KG, Jennings A, Mayhew A, Ramsay CR, Eccles MP, Grimshaw J: The effects of on-screen, point of care computer reminders on processes and outcomes of care. Cochrane Database Syst Rev. 2009, 3: CD001096 Shojania KG, Jennings A, Mayhew A, Ramsay CR, Eccles MP, Grimshaw J: The effects of on-screen, point of care computer reminders on processes and outcomes of care. Cochrane Database Syst Rev. 2009, 3: CD001096
13.
go back to reference Bell LM, Grundmeier R, Localio R, Zorc J, Fiks AG, Zhang X, Stephens TB, Swietlik M, Guevara JP: Electronic health record-based decision support to improve asthma care: a cluster-randomized trial. Pediatrics. 2010, 125 (4): e770-777. 10.1542/peds.2009-1385.CrossRefPubMed Bell LM, Grundmeier R, Localio R, Zorc J, Fiks AG, Zhang X, Stephens TB, Swietlik M, Guevara JP: Electronic health record-based decision support to improve asthma care: a cluster-randomized trial. Pediatrics. 2010, 125 (4): e770-777. 10.1542/peds.2009-1385.CrossRefPubMed
14.
go back to reference McCullough A, Fisher M, Goldstein AO, Kramer KD, Ripley-Moffitt C: Smoking as a vital sign: prompts to ask and assess increase cessation counseling. J Am Board Fam Med. 2009, 22 (6): 625-632. 10.3122/jabfm.2009.06.080211.CrossRefPubMed McCullough A, Fisher M, Goldstein AO, Kramer KD, Ripley-Moffitt C: Smoking as a vital sign: prompts to ask and assess increase cessation counseling. J Am Board Fam Med. 2009, 22 (6): 625-632. 10.3122/jabfm.2009.06.080211.CrossRefPubMed
15.
go back to reference Padberg FT, Hauck K, Mercer RG, Lal BK, Pappas PJ: Screening for abdominal aortic aneurysm with electronic clinical reminders. Am J Surg. 2009, 198 (5): 670-674. 10.1016/j.amjsurg.2009.07.021.CrossRefPubMed Padberg FT, Hauck K, Mercer RG, Lal BK, Pappas PJ: Screening for abdominal aortic aneurysm with electronic clinical reminders. Am J Surg. 2009, 198 (5): 670-674. 10.1016/j.amjsurg.2009.07.021.CrossRefPubMed
16.
go back to reference Schriefer SP, Landis SE, Turbow DJ, Patch SC: Effect of a computerized body mass index prompt on diagnosis and treatment of adult obesity. Fam Med. 2009, 41 (7): 502-507.PubMed Schriefer SP, Landis SE, Turbow DJ, Patch SC: Effect of a computerized body mass index prompt on diagnosis and treatment of adult obesity. Fam Med. 2009, 41 (7): 502-507.PubMed
17.
go back to reference Balas EA, Weingarten S, Garb CT, Blumenthal D, Boren SA, Brown GD: Improving preventive care by prompting physicians. Arch Intern Med. 2000, 160 (3): 301-308. 10.1001/archinte.160.3.301.CrossRefPubMed Balas EA, Weingarten S, Garb CT, Blumenthal D, Boren SA, Brown GD: Improving preventive care by prompting physicians. Arch Intern Med. 2000, 160 (3): 301-308. 10.1001/archinte.160.3.301.CrossRefPubMed
18.
go back to reference Car J, Black A, Anandan C, Cresswell K, Pagliari C, McKinstry B, Procter R, Majeed A, Sheikh A: The impact of eHealth on the quality & safety of healthcare. A systematic overview & synthesis of the literature. Report for the NHS Connecting for Health Evaluation Programme. 2008, London: Imperial College London Car J, Black A, Anandan C, Cresswell K, Pagliari C, McKinstry B, Procter R, Majeed A, Sheikh A: The impact of eHealth on the quality & safety of healthcare. A systematic overview & synthesis of the literature. Report for the NHS Connecting for Health Evaluation Programme. 2008, London: Imperial College London
19.
go back to reference Huckvale C, Car J, Akiyama M, Jaafar S, Khoja T, Bin Khalid A, Sheikh A, Majeed A: Information technology for patient safety. Qual Saf Healthcare. 2010, 19 (Suppl 2): i25-33. 10.1136/qshc.2009.038497.CrossRef Huckvale C, Car J, Akiyama M, Jaafar S, Khoja T, Bin Khalid A, Sheikh A, Majeed A: Information technology for patient safety. Qual Saf Healthcare. 2010, 19 (Suppl 2): i25-33. 10.1136/qshc.2009.038497.CrossRef
20.
go back to reference Bryan C, Boren SA: The use and effectiveness of electronic clinical decision support tools in the ambulatory/primary care setting: a systematic review of the literature. Inform Prim Care. 2008, 16 (2): 79-91.PubMed Bryan C, Boren SA: The use and effectiveness of electronic clinical decision support tools in the ambulatory/primary care setting: a systematic review of the literature. Inform Prim Care. 2008, 16 (2): 79-91.PubMed
21.
go back to reference Gosling AS, Westbrook JI, Spencer R: Nurses’ use of online clinical evidence. J Adv Nurs. 2004, 47 (2): 201-211. 10.1111/j.1365-2648.2004.03079.x.CrossRefPubMed Gosling AS, Westbrook JI, Spencer R: Nurses’ use of online clinical evidence. J Adv Nurs. 2004, 47 (2): 201-211. 10.1111/j.1365-2648.2004.03079.x.CrossRefPubMed
22.
go back to reference Gill JM, Chen YX, Glutting JJ, Diamond JJ, Lieberman MI: Impact of decision support in electronic medical records on lipid management in primary care. Popul Health Manag. 2009, 12 (5): 221-226. 10.1089/pop.2009.0003.CrossRefPubMed Gill JM, Chen YX, Glutting JJ, Diamond JJ, Lieberman MI: Impact of decision support in electronic medical records on lipid management in primary care. Popul Health Manag. 2009, 12 (5): 221-226. 10.1089/pop.2009.0003.CrossRefPubMed
23.
go back to reference Sequist TD, Gandhi TK, Karson AS, Fiskio JM, Bugbee D, Sperling M, Cook EF, Orav EJ, Fairchild DG, Bates DW: A randomized trial of electronic clinical reminders to improve quality of care for diabetes and coronary artery disease. J Am Med Inform Assoc. 2005, 12 (4): 431-437. 10.1197/jamia.M1788.CrossRefPubMedPubMedCentral Sequist TD, Gandhi TK, Karson AS, Fiskio JM, Bugbee D, Sperling M, Cook EF, Orav EJ, Fairchild DG, Bates DW: A randomized trial of electronic clinical reminders to improve quality of care for diabetes and coronary artery disease. J Am Med Inform Assoc. 2005, 12 (4): 431-437. 10.1197/jamia.M1788.CrossRefPubMedPubMedCentral
24.
go back to reference Kortteisto T, Komulainen J, Kunnamo I, Mäkelä M, Kaila M: Implementing clinical decision support for primary care professionals – the process. Finn J eHealth eWelfare. 2012, 3 (4): 150-161. Kortteisto T, Komulainen J, Kunnamo I, Mäkelä M, Kaila M: Implementing clinical decision support for primary care professionals – the process. Finn J eHealth eWelfare. 2012, 3 (4): 150-161.
27.
go back to reference Kortteisto T, Komulainen J, Makela M, Kunnamo I, Kaila M: Clinical decision support must be useful, functional is not enough: a qualitative study of computer-based clinical decision support in primary care. BMC Health Serv Res. 2012, 12: 349-10.1186/1472-6963-12-349.CrossRefPubMedPubMedCentral Kortteisto T, Komulainen J, Makela M, Kunnamo I, Kaila M: Clinical decision support must be useful, functional is not enough: a qualitative study of computer-based clinical decision support in primary care. BMC Health Serv Res. 2012, 12: 349-10.1186/1472-6963-12-349.CrossRefPubMedPubMedCentral
29.
go back to reference McCullagh P, Nelder J: Generalized linear models. 1989, London: Chapman and Hall, 2CrossRef McCullagh P, Nelder J: Generalized linear models. 1989, London: Chapman and Hall, 2CrossRef
30.
go back to reference Liang K-Y, Zeger SL: Longitudinal data analysis using generalized linear models. Biometrika. 1986, 73 (1): 13-22. 10.1093/biomet/73.1.13.CrossRef Liang K-Y, Zeger SL: Longitudinal data analysis using generalized linear models. Biometrika. 1986, 73 (1): 13-22. 10.1093/biomet/73.1.13.CrossRef
31.
go back to reference Pan W: Akaike’s information criterion in generalized estimating equations. Biometrics. 2001, 57 (1): 120-125. 10.1111/j.0006-341X.2001.00120.x.CrossRefPubMed Pan W: Akaike’s information criterion in generalized estimating equations. Biometrics. 2001, 57 (1): 120-125. 10.1111/j.0006-341X.2001.00120.x.CrossRefPubMed
32.
go back to reference Campbell MJ, Machin D: Medical statistics: a commonsense approach. 2002, Chichester: John Wiley & Sons, Ltd, 3 Campbell MJ, Machin D: Medical statistics: a commonsense approach. 2002, Chichester: John Wiley & Sons, Ltd, 3
33.
go back to reference Eccles M, Grimshaw J, Campbell M, Ramsay C: Research designs for studies evaluating the effectiveness of change and improvement strategies. Qual Saf Healthcare. 2003, 12 (1): 47-52. 10.1136/qhc.12.1.47.CrossRef Eccles M, Grimshaw J, Campbell M, Ramsay C: Research designs for studies evaluating the effectiveness of change and improvement strategies. Qual Saf Healthcare. 2003, 12 (1): 47-52. 10.1136/qhc.12.1.47.CrossRef
34.
go back to reference Varonen H, Kortteisto T, Kaila M: What may help or hinder the implementation of computerized decision support systems (CDSSs): a focus group study with physicians. Fam Pract. 2008, 25 (3): 162-167. 10.1093/fampra/cmn020.CrossRefPubMed Varonen H, Kortteisto T, Kaila M: What may help or hinder the implementation of computerized decision support systems (CDSSs): a focus group study with physicians. Fam Pract. 2008, 25 (3): 162-167. 10.1093/fampra/cmn020.CrossRefPubMed
35.
go back to reference Roshanov PS, Fernandes N, Wilczynski JM, Hemens BJ, You JJ, Handler SM, Nieuwlaat R, Souza NM, Beyene J, Van Spall HG: Features of effective computerised clinical decision support systems: meta-regression of 162 randomised trials. BMJ. 2013, 346: f657-10.1136/bmj.f657.CrossRefPubMed Roshanov PS, Fernandes N, Wilczynski JM, Hemens BJ, You JJ, Handler SM, Nieuwlaat R, Souza NM, Beyene J, Van Spall HG: Features of effective computerised clinical decision support systems: meta-regression of 162 randomised trials. BMJ. 2013, 346: f657-10.1136/bmj.f657.CrossRefPubMed
36.
go back to reference Fransen GA, van Marrewijk CJ, Mujakovic S, Muris JW, Laheij RJ, Numans ME, de Wit NJ, Samsom M, Jansen JB, Knottnerus JA: Pragmatic trials in primary care. Methodological challenges and solutions demonstrated by the DIAMOND-study. BMC Med Res Methodol. 2007, 7: 16-10.1186/1471-2288-7-16.CrossRefPubMedPubMedCentral Fransen GA, van Marrewijk CJ, Mujakovic S, Muris JW, Laheij RJ, Numans ME, de Wit NJ, Samsom M, Jansen JB, Knottnerus JA: Pragmatic trials in primary care. Methodological challenges and solutions demonstrated by the DIAMOND-study. BMC Med Res Methodol. 2007, 7: 16-10.1186/1471-2288-7-16.CrossRefPubMedPubMedCentral
37.
go back to reference Juni P, Altman DG, Egger M: Systematic reviews in healthcare: assessing the quality of controlled clinical trials. BMJ. 2001, 323 (7303): 42-46. 10.1136/bmj.323.7303.42.CrossRefPubMedPubMedCentral Juni P, Altman DG, Egger M: Systematic reviews in healthcare: assessing the quality of controlled clinical trials. BMJ. 2001, 323 (7303): 42-46. 10.1136/bmj.323.7303.42.CrossRefPubMedPubMedCentral
38.
go back to reference Schulz KF, Grimes DA: Generation of allocation sequences in randomised trials: chance, not choice. Lancet. 2002, 359 (9305): 515-519. 10.1016/S0140-6736(02)07683-3.CrossRefPubMed Schulz KF, Grimes DA: Generation of allocation sequences in randomised trials: chance, not choice. Lancet. 2002, 359 (9305): 515-519. 10.1016/S0140-6736(02)07683-3.CrossRefPubMed
39.
go back to reference Black AD, Car J, Pagliari C, Anandan C, Cresswell K, Bokun T, McKinstry B, Procter R, Majeed A, Sheikh A: The impact of eHealth on the quality and safety of healthcare: a systematic overview. PLoS Med. 2011, 8 (1): e1000387-10.1371/journal.pmed.1000387.CrossRefPubMedPubMedCentral Black AD, Car J, Pagliari C, Anandan C, Cresswell K, Bokun T, McKinstry B, Procter R, Majeed A, Sheikh A: The impact of eHealth on the quality and safety of healthcare: a systematic overview. PLoS Med. 2011, 8 (1): e1000387-10.1371/journal.pmed.1000387.CrossRefPubMedPubMedCentral
40.
go back to reference Heselmans A, Van de Velde S, Donceel P, Aertgeerts B, Ramaekers D: Effectiveness of electronic guideline-based implementation systems in ambulatory care settings - a systematic review. Implement Sci. 2009, 4: 82-10.1186/1748-5908-4-82.CrossRefPubMedPubMedCentral Heselmans A, Van de Velde S, Donceel P, Aertgeerts B, Ramaekers D: Effectiveness of electronic guideline-based implementation systems in ambulatory care settings - a systematic review. Implement Sci. 2009, 4: 82-10.1186/1748-5908-4-82.CrossRefPubMedPubMedCentral
41.
go back to reference Martens JD, van der Weijden T, Winkens RA, Kester AD, Geerts PJ, Evers SM, Severens JL: Feasibility and acceptability of a computerised system with automated reminders for prescribing behaviour in primary care. Int J Med Inform. 2008, 77 (3): 199-207. 10.1016/j.ijmedinf.2007.05.013.CrossRefPubMed Martens JD, van der Weijden T, Winkens RA, Kester AD, Geerts PJ, Evers SM, Severens JL: Feasibility and acceptability of a computerised system with automated reminders for prescribing behaviour in primary care. Int J Med Inform. 2008, 77 (3): 199-207. 10.1016/j.ijmedinf.2007.05.013.CrossRefPubMed
42.
go back to reference Heselmans A, Aertgeerts B, Donceel P, Geens S, Van de Velde S, Ramaekers D: Family physicians’ perceptions and use of electronic clinical decision support during the first year of implementation. J Med Syst. 2012, 36 (6): 3677-3684. 10.1007/s10916-012-9841-3.CrossRefPubMed Heselmans A, Aertgeerts B, Donceel P, Geens S, Van de Velde S, Ramaekers D: Family physicians’ perceptions and use of electronic clinical decision support during the first year of implementation. J Med Syst. 2012, 36 (6): 3677-3684. 10.1007/s10916-012-9841-3.CrossRefPubMed
43.
go back to reference Herzberg S, Rahbar K, Stegger L, Schafers M, Dugas M: Concept and implementation of a computer-based reminder system to increase completeness in clinical documentation. Int J Med Inform. 2011, 80 (5): 351-358. 10.1016/j.ijmedinf.2011.02.004.CrossRefPubMed Herzberg S, Rahbar K, Stegger L, Schafers M, Dugas M: Concept and implementation of a computer-based reminder system to increase completeness in clinical documentation. Int J Med Inform. 2011, 80 (5): 351-358. 10.1016/j.ijmedinf.2011.02.004.CrossRefPubMed
44.
go back to reference Wright A, Pang J, Feblowitz JC, Maloney FL, Wilcox AR, McLoughlin KS, Ramelson H, Schneider L, Bates DW: Improving completeness of electronic problem lists through clinical decision support: a randomized, controlled trial. J Am Med Inform Assoc. 2012, 19 (4): 555-561. 10.1136/amiajnl-2011-000521.CrossRefPubMedPubMedCentral Wright A, Pang J, Feblowitz JC, Maloney FL, Wilcox AR, McLoughlin KS, Ramelson H, Schneider L, Bates DW: Improving completeness of electronic problem lists through clinical decision support: a randomized, controlled trial. J Am Med Inform Assoc. 2012, 19 (4): 555-561. 10.1136/amiajnl-2011-000521.CrossRefPubMedPubMedCentral
Metadata
Title
Patient-specific computer-based decision support in primary healthcare—a randomized trial
Authors
Tiina Kortteisto
Jani Raitanen
Jorma Komulainen
Ilkka Kunnamo
Marjukka Mäkelä
Pekka Rissanen
Minna Kaila
Publication date
01-12-2014
Publisher
BioMed Central
Published in
Implementation Science / Issue 1/2014
Electronic ISSN: 1748-5908
DOI
https://doi.org/10.1186/1748-5908-9-15

Other articles of this Issue 1/2014

Implementation Science 1/2014 Go to the issue