Skip to main content
Top
Published in: BMC Medical Informatics and Decision Making 1/2011

Open Access 01-12-2011 | Research article

Building consensus about eHealth in Slovene primary health care: Delphi study

Authors: Rade J Iljaž, Matic Meglič, Igor Švab

Published in: BMC Medical Informatics and Decision Making | Issue 1/2011

Login to get access

Abstract

Background

Slovenia's national eHealth strategy aims to develop an efficient, flexible and modern health care informatics framework that would be comparable to the most successful EU countries. To achieve this goal, the gap between availability and usage of information and communication technology by primary care physicians needs to be reduced.
As recent efforts show, consensus on information and communication technology purpose and usage in primary care needs to be established before any national information and communication technology solutions are developed.
The aim of this study was to identify the most appropriate measures in implementation of Slovene national eHealth strategy and to suggest an appropriate model for success by using the three round Delphi study.

Methods

An e-mail based, three-round Delphi study was undertaken to achieve consensus from a selected sample of nationally recognized experts from the fields of primary health care and medical informatics. The aim of this study was to identify the most appropriate measures and key obstacles in implementation of eHealth in Slovene primary health care by using the Delphi study.

Results

High levels of consensus on the majority of suggested measures were achieved among all study participants, as well as between the subgroups of experts from primary health care and medical informatics. All aims of the three-round Delphi study on eHealth implementation in Slovenian primary health care were achieved.

Conclusions

The three round decision Delphi process has proven to be effective for developing outcomes, ranking key priorities in primary care eHealth development, and achieving consensus among the most influential experts in that field. This consensus is an important contribution to future national eHealth strategies in the field of primary health care.
Appendix
Available only for authorised users
Literature
1.
go back to reference Hersh WK: Medical informatics: improving health care through information. JAMA. 2002, 288: 1955-8. 10.1001/jama.288.16.1955.CrossRefPubMed Hersh WK: Medical informatics: improving health care through information. JAMA. 2002, 288: 1955-8. 10.1001/jama.288.16.1955.CrossRefPubMed
2.
go back to reference Garrido T, Jamieson L, Zhou Y, Wiesenthal A, Liang L: Effect of electronic health records in ambulatory care: retrospective, serial, cross sectional study. BMJ. 2005, 330: 581-5. 10.1136/bmj.330.7491.581.CrossRefPubMedPubMedCentral Garrido T, Jamieson L, Zhou Y, Wiesenthal A, Liang L: Effect of electronic health records in ambulatory care: retrospective, serial, cross sectional study. BMJ. 2005, 330: 581-5. 10.1136/bmj.330.7491.581.CrossRefPubMedPubMedCentral
3.
go back to reference Booth N, Robinson P, Kohannejad J: Identification of high-quality consultation practice in PC: the effects of computer use on doctor-patient rapport - abstract paper. Informatics in Primary care. 2004, 12 (2): 75-83.PubMed Booth N, Robinson P, Kohannejad J: Identification of high-quality consultation practice in PC: the effects of computer use on doctor-patient rapport - abstract paper. Informatics in Primary care. 2004, 12 (2): 75-83.PubMed
4.
go back to reference Treweek S: The potential of electronic medical record systems to support quality improvement work and research in Norwegian general practice. BMC Health Service Research. 2003, 3: 1-9. 10.1186/1472-6963-3-10.CrossRef Treweek S: The potential of electronic medical record systems to support quality improvement work and research in Norwegian general practice. BMC Health Service Research. 2003, 3: 1-9. 10.1186/1472-6963-3-10.CrossRef
5.
go back to reference Delpierre C, Cuzin L, Fillaux J, Alvarez M, Massip P, Lang T: A systematic review of computer-based patient record systems and quality of care: more randomized clinical trials or a broader approach?. International Journal for Quality in Health Care. 2004, 16 (5): 407-416. 10.1093/intqhc/mzh064.CrossRefPubMed Delpierre C, Cuzin L, Fillaux J, Alvarez M, Massip P, Lang T: A systematic review of computer-based patient record systems and quality of care: more randomized clinical trials or a broader approach?. International Journal for Quality in Health Care. 2004, 16 (5): 407-416. 10.1093/intqhc/mzh064.CrossRefPubMed
6.
go back to reference Wager KA, Lee FW, White AW, Ward DM, Ornstein SM: Impact of an electronic medical record system on community-based PC practices. J Am Board Fam Pract. 2000, 13: 338-348.PubMed Wager KA, Lee FW, White AW, Ward DM, Ornstein SM: Impact of an electronic medical record system on community-based PC practices. J Am Board Fam Pract. 2000, 13: 338-348.PubMed
7.
go back to reference Dobrev A, Hoesner M, Huising T, Korte WB, Meyer I: Benchmarking ICT use among General Practitioners in Europe: Final report. 2008, Bonn: Empirica Dobrev A, Hoesner M, Huising T, Korte WB, Meyer I: Benchmarking ICT use among General Practitioners in Europe: Final report. 2008, Bonn: Empirica
8.
go back to reference Hippisley-Cox J, Pringle M, Cater R, Wynn A, Hammersley V, Coupland C, Hapgood R, Horsfield P, Teasdale S, Johnson C: The electronic patient record in PC--regression or progression? A cross sectional study. BMJ. 2003, 326: 1439-1443. 10.1136/bmj.326.7404.1439.CrossRefPubMedPubMedCentral Hippisley-Cox J, Pringle M, Cater R, Wynn A, Hammersley V, Coupland C, Hapgood R, Horsfield P, Teasdale S, Johnson C: The electronic patient record in PC--regression or progression? A cross sectional study. BMJ. 2003, 326: 1439-1443. 10.1136/bmj.326.7404.1439.CrossRefPubMedPubMedCentral
9.
go back to reference Tang CP, LaRosa MP, Gorden MS: Use of Computer-Based Records, Completeness of Documentation, and Appropriateness of Documented Clinical Decisions. J Am Med Inform Assoc. 1999, 6: 245-251. 10.1136/jamia.1999.0060245.CrossRefPubMedPubMedCentral Tang CP, LaRosa MP, Gorden MS: Use of Computer-Based Records, Completeness of Documentation, and Appropriateness of Documented Clinical Decisions. J Am Med Inform Assoc. 1999, 6: 245-251. 10.1136/jamia.1999.0060245.CrossRefPubMedPubMedCentral
10.
go back to reference Gagnon MP, Shaw N, Sicotte C, Mathieu L, Leduc Y, Duplantie J, Maclean J, Legare F: Users' perspectives of barriers and facilitators to implementing EHR in Canada: A study protocol. Implementation Science. 2009, 4: 20-10.1186/1748-5908-4-20.CrossRefPubMedPubMedCentral Gagnon MP, Shaw N, Sicotte C, Mathieu L, Leduc Y, Duplantie J, Maclean J, Legare F: Users' perspectives of barriers and facilitators to implementing EHR in Canada: A study protocol. Implementation Science. 2009, 4: 20-10.1186/1748-5908-4-20.CrossRefPubMedPubMedCentral
11.
go back to reference Poissant L, Pereira J, Tamblin R, Kawasumi Y: The impact of Electronic Health Records on Time Efficiency of Physicians and Nurses: A Systematic Review. J Am Med Inform Assoc. 2005, 5 (12): 505-516. 10.1197/jamia.M1700.CrossRef Poissant L, Pereira J, Tamblin R, Kawasumi Y: The impact of Electronic Health Records on Time Efficiency of Physicians and Nurses: A Systematic Review. J Am Med Inform Assoc. 2005, 5 (12): 505-516. 10.1197/jamia.M1700.CrossRef
12.
go back to reference Littlejohns P, Wyatt JC, Garvican L: Evaluating computerised health information systems: hard lessons still to be learnt. BMJ. 2003, 326 (7394): 860-3. 10.1136/bmj.326.7394.860.CrossRefPubMedPubMedCentral Littlejohns P, Wyatt JC, Garvican L: Evaluating computerised health information systems: hard lessons still to be learnt. BMJ. 2003, 326 (7394): 860-3. 10.1136/bmj.326.7394.860.CrossRefPubMedPubMedCentral
13.
go back to reference Lee F, Teich JM, Spurr CD, Bates DW: Implementation of physician order entry: user satisfaction and self-reported usage patterns. J Am Med Inform Assoc. 1996, 3: 42-55. 10.1136/jamia.1996.96342648.CrossRefPubMedPubMedCentral Lee F, Teich JM, Spurr CD, Bates DW: Implementation of physician order entry: user satisfaction and self-reported usage patterns. J Am Med Inform Assoc. 1996, 3: 42-55. 10.1136/jamia.1996.96342648.CrossRefPubMedPubMedCentral
14.
go back to reference Hunt DL, Haynes RB, Hanna SE, Smith K: Effects of computer-based clinical decision support systems on physician performance and patient outcomes: a systematic review. JAMA. 1998, 280: 1339-46. 10.1001/jama.280.15.1339.CrossRefPubMed Hunt DL, Haynes RB, Hanna SE, Smith K: Effects of computer-based clinical decision support systems on physician performance and patient outcomes: a systematic review. JAMA. 1998, 280: 1339-46. 10.1001/jama.280.15.1339.CrossRefPubMed
15.
go back to reference Hübner U, Ammenwerth E, Flemming D, Schaubmayr C, Sellemann B: IT adoption of clinical information systems in Austrian and German hospitals: results of a comparative survey with a focus on nursing. BMC Medical Informatics and Decision Making. 2010, 10: 8-CrossRefPubMedPubMedCentral Hübner U, Ammenwerth E, Flemming D, Schaubmayr C, Sellemann B: IT adoption of clinical information systems in Austrian and German hospitals: results of a comparative survey with a focus on nursing. BMC Medical Informatics and Decision Making. 2010, 10: 8-CrossRefPubMedPubMedCentral
16.
go back to reference Wong DH, Gallegos Y, Weniger MB, Clack S, Slagle J, Anderson CT: Changes in intensive care unit nurse task activity after installation of a third-generation intensive care unit information system. Crit Care Med. 2003, 31: 2488-94. 10.1097/01.CCM.0000089637.53301.EF.CrossRefPubMed Wong DH, Gallegos Y, Weniger MB, Clack S, Slagle J, Anderson CT: Changes in intensive care unit nurse task activity after installation of a third-generation intensive care unit information system. Crit Care Med. 2003, 31: 2488-94. 10.1097/01.CCM.0000089637.53301.EF.CrossRefPubMed
17.
go back to reference Kolšek M: Implementing Electronic Medical Record in Family Practice in Slovenia and Other Former Yugoslav Republics: Barriers and Requirements. Srp Arh Celok Lek. 2009, 137 (11-12): 664-669.CrossRefPubMed Kolšek M: Implementing Electronic Medical Record in Family Practice in Slovenia and Other Former Yugoslav Republics: Barriers and Requirements. Srp Arh Celok Lek. 2009, 137 (11-12): 664-669.CrossRefPubMed
18.
go back to reference Iljaž R, Kersnik J, Rozenberger M: Use of computer technology among Slovene PC physicians - a pilot study. Zdrav Var. 2005, 44: 206-214. Iljaž R, Kersnik J, Rozenberger M: Use of computer technology among Slovene PC physicians - a pilot study. Zdrav Var. 2005, 44: 206-214.
19.
go back to reference Seifert B, Svab I, Madis T, Kersnik J, Windack A, Steflova A, Byma S: Perspectives of family medicine in Central and Eastern Europe. Family Practice. 2008, 25: 113-118. 10.1093/fampra/cmn009.CrossRefPubMed Seifert B, Svab I, Madis T, Kersnik J, Windack A, Steflova A, Byma S: Perspectives of family medicine in Central and Eastern Europe. Family Practice. 2008, 25: 113-118. 10.1093/fampra/cmn009.CrossRefPubMed
20.
go back to reference Slovenian Ministry of Health: eHealth activities in Slovenia. 2008, Ministry of Health, Ljubljana, 1-3. Slovenian Ministry of Health: eHealth activities in Slovenia. 2008, Ministry of Health, Ljubljana, 1-3.
22.
go back to reference Kaplan B, Harris-Salamone KD: Health IT Success and Failure: Recommendations from Literature and an AMIA Workshop. JAMIA. 2009, 16-3: 291-91. Kaplan B, Harris-Salamone KD: Health IT Success and Failure: Recommendations from Literature and an AMIA Workshop. JAMIA. 2009, 16-3: 291-91.
23.
go back to reference Ciolan C: One-Size-Fits-All? Not always. Small + local may still be beautiful and functional. Healthcare IT management. 2008, 5 (3): 36-37. Ciolan C: One-Size-Fits-All? Not always. Small + local may still be beautiful and functional. Healthcare IT management. 2008, 5 (3): 36-37.
24.
go back to reference Murphy MK, Black NA, Lamping DL, McKee CM, Sanderson CFB, Askham J, Marteau T: Consensus development methods, and their use in clinical guideline development. Health Technol Asses. 1998, 2 (3): Murphy MK, Black NA, Lamping DL, McKee CM, Sanderson CFB, Askham J, Marteau T: Consensus development methods, and their use in clinical guideline development. Health Technol Asses. 1998, 2 (3):
25.
go back to reference Poon EG, Jha KA, Christino M, Honour MM, Fernandopulle R, Middleton B, Newhouse J, Leape L, Bates DW, Blumenthal D, Kaushal R: Assessing the level of healthcare information technology adoption in the United States: a snapshot. BMC Medical Informatics and Decision Making. 2006, 6 (1): 1-9. 10.1186/1472-6947-6-1.CrossRefPubMedPubMedCentral Poon EG, Jha KA, Christino M, Honour MM, Fernandopulle R, Middleton B, Newhouse J, Leape L, Bates DW, Blumenthal D, Kaushal R: Assessing the level of healthcare information technology adoption in the United States: a snapshot. BMC Medical Informatics and Decision Making. 2006, 6 (1): 1-9. 10.1186/1472-6947-6-1.CrossRefPubMedPubMedCentral
26.
go back to reference Neugebauer E, Troidl H: Consensus methods as tools to assess medical technologies. Surg Endosc. 1995, 9: 481-482.PubMed Neugebauer E, Troidl H: Consensus methods as tools to assess medical technologies. Surg Endosc. 1995, 9: 481-482.PubMed
28.
go back to reference Perry S, Kalberer JT: The NIH consensus development program and the assessment of health care technologies: the first two years. N Engl J Med. 1980, 303: 169-72. 10.1056/NEJM198007173030334.CrossRefPubMed Perry S, Kalberer JT: The NIH consensus development program and the assessment of health care technologies: the first two years. N Engl J Med. 1980, 303: 169-72. 10.1056/NEJM198007173030334.CrossRefPubMed
29.
go back to reference Moscovice I, Armstrong P, Shortell S: Health services research for decision-makers: the use of the Delphi technique to determine health priorities. J Health Polit Policy Law. 1988, 2: 388-410. 10.1215/03616878-2-3-388.CrossRef Moscovice I, Armstrong P, Shortell S: Health services research for decision-makers: the use of the Delphi technique to determine health priorities. J Health Polit Policy Law. 1988, 2: 388-410. 10.1215/03616878-2-3-388.CrossRef
30.
go back to reference Rauch W: The decision Delphi. Technol Forecast Soc Change. 1979, 15: 159-69. 10.1016/0040-1625(79)90011-8.CrossRef Rauch W: The decision Delphi. Technol Forecast Soc Change. 1979, 15: 159-69. 10.1016/0040-1625(79)90011-8.CrossRef
31.
go back to reference Chocholik JK, Bouchard SE, Tan JK, Ostrow DN: The Determination of Relevant Goals and Criteria Used to Select an Automated Patient Care Information System: A Delphi Approach. J Am Med Inform Assoc. 1999, 6-3: 219-33. 10.1136/jamia.1999.0060219.CrossRef Chocholik JK, Bouchard SE, Tan JK, Ostrow DN: The Determination of Relevant Goals and Criteria Used to Select an Automated Patient Care Information System: A Delphi Approach. J Am Med Inform Assoc. 1999, 6-3: 219-33. 10.1136/jamia.1999.0060219.CrossRef
32.
go back to reference Van Steenkiste BC, Jacobs JE, Verheijen NM, Levelink JH, Bottema BJAM: A Delphi technique as a method for selecting the content of an electronic patient record for asthma. International Journal of Medical Informatics. 2002, 65 (1): 7-16. 10.1016/S1386-5056(01)00223-4.CrossRefPubMed Van Steenkiste BC, Jacobs JE, Verheijen NM, Levelink JH, Bottema BJAM: A Delphi technique as a method for selecting the content of an electronic patient record for asthma. International Journal of Medical Informatics. 2002, 65 (1): 7-16. 10.1016/S1386-5056(01)00223-4.CrossRefPubMed
33.
go back to reference Haggerty J, Burge F, Lévesque JF, Gass D, Pineault R, Beaulieu MD, Santor D: Operational Definitions of Attributes of Primary Health Care: Consensus Among Canadian Experts. Annals of Family Medicine. 2007, 5-4: 336-44. 10.1370/afm.682.CrossRef Haggerty J, Burge F, Lévesque JF, Gass D, Pineault R, Beaulieu MD, Santor D: Operational Definitions of Attributes of Primary Health Care: Consensus Among Canadian Experts. Annals of Family Medicine. 2007, 5-4: 336-44. 10.1370/afm.682.CrossRef
34.
go back to reference Garåsen H, Johnsen R: The quality of communication about older patients between hospital physicians and general practitioners: a panel study assessment. BMC Health Services Research. 2007, 7: 133-CrossRefPubMedPubMedCentral Garåsen H, Johnsen R: The quality of communication about older patients between hospital physicians and general practitioners: a panel study assessment. BMC Health Services Research. 2007, 7: 133-CrossRefPubMedPubMedCentral
35.
go back to reference Skulmoski GJ, Hartman FT, Krahn J: The Delphi Method for Graduate research. Journal of Information Technology Education. 2007, 6: 1-17. Skulmoski GJ, Hartman FT, Krahn J: The Delphi Method for Graduate research. Journal of Information Technology Education. 2007, 6: 1-17.
36.
go back to reference Hsu CC, Sandford BA: The Delphi Technique: Making Sense of Consensus. Practical Assessment Research & Evaluation. 2007, 12 (10): 1-6. Hsu CC, Sandford BA: The Delphi Technique: Making Sense of Consensus. Practical Assessment Research & Evaluation. 2007, 12 (10): 1-6.
37.
go back to reference Witkin BR, Altschuld JW: Planning and conducting needs assessment: A practical guide. Thousand Oaks. 1995, CA: Sage Publications Inc, 204- Witkin BR, Altschuld JW: Planning and conducting needs assessment: A practical guide. Thousand Oaks. 1995, CA: Sage Publications Inc, 204-
38.
go back to reference Hasson F, Keeney S, McKenna H: Research guidelines for the Delphi survey technique. Journal of Advanced Nursing. 2000, 32 (4): 1008-1015.PubMed Hasson F, Keeney S, McKenna H: Research guidelines for the Delphi survey technique. Journal of Advanced Nursing. 2000, 32 (4): 1008-1015.PubMed
39.
go back to reference Ralitsa B, Akins RB, Tolson H, Cole BR: Stability of response characteristics of a Delphi panel: application of bootstrap data expansion. BMC Medical Research Methodology. 2005, 5: 37-10.1186/1471-2288-5-37.CrossRef Ralitsa B, Akins RB, Tolson H, Cole BR: Stability of response characteristics of a Delphi panel: application of bootstrap data expansion. BMC Medical Research Methodology. 2005, 5: 37-10.1186/1471-2288-5-37.CrossRef
40.
go back to reference Holey AE, Feeley LJ, Dixon J, Whittaker JV: An exploration of the use of simple statistics to measure consensus and stability in Delphi studies. BMC Medical Research Methodology. 2007, 7: 52-10.1186/1471-2288-7-52.CrossRefPubMedPubMedCentral Holey AE, Feeley LJ, Dixon J, Whittaker JV: An exploration of the use of simple statistics to measure consensus and stability in Delphi studies. BMC Medical Research Methodology. 2007, 7: 52-10.1186/1471-2288-7-52.CrossRefPubMedPubMedCentral
41.
go back to reference Schmidt RC: Managing Delphi surveys using nonparametric statistical techniques. Decision Sciences. 1997, 28 (3): 763-74. 10.1111/j.1540-5915.1997.tb01330.x.CrossRef Schmidt RC: Managing Delphi surveys using nonparametric statistical techniques. Decision Sciences. 1997, 28 (3): 763-74. 10.1111/j.1540-5915.1997.tb01330.x.CrossRef
42.
go back to reference Keller G: Applied Statistics with Microsoft Excel. 2001, Duxbury & Thomson Learning Keller G: Applied Statistics with Microsoft Excel. 2001, Duxbury & Thomson Learning
Metadata
Title
Building consensus about eHealth in Slovene primary health care: Delphi study
Authors
Rade J Iljaž
Matic Meglič
Igor Švab
Publication date
01-12-2011
Publisher
BioMed Central
Published in
BMC Medical Informatics and Decision Making / Issue 1/2011
Electronic ISSN: 1472-6947
DOI
https://doi.org/10.1186/1472-6947-11-25

Other articles of this Issue 1/2011

BMC Medical Informatics and Decision Making 1/2011 Go to the issue