Skip to main content
Top
Published in: International Journal of Clinical Pharmacy 1/2012

01-02-2012 | Review Article

An analysis of quality of systematic reviews on pharmacist health interventions

Authors: Ana Carolina Melchiors, Cassyano Januário Correr, Rafael Venson, Roberto Pontarolo

Published in: International Journal of Clinical Pharmacy | Issue 1/2012

Login to get access

Abstract

Background In the past 20 years, many studies have evaluated the impact of pharmaceutical practices on clinical, humanistic and economic outcomes. However, few studies have critically analysed the primary studies and published reviews regarding pharmaceutical practices. Aim of the Review The aim of this review is to assess the quality of systematic reviews and meta-analysis on pharmacist health interventions published from 1990 to 2009. Method The data sources used were MEDLINE, Cochrane Library, International Pharmaceutical Abstracts, Latin American and Caribbean Health Sciences, Scientific Electronic Library Online, and Scopus. Studies in which interventions were done by a pharmacist or in which the pharmacist was a health team member were included. There were no restrictions based on the type of intervention, country or languages. The data extracted by two independent reviewers were the following: publication journal, language, publication year, search strategy, study design, quality assessment of the included studies, disease, study settings, intervention description, and outcome measures. The methodological quality of systematic reviews was accessed with AMSTAR. Results A total of 151 articles were found from which 31 were included. An increase in the number of publications occurred after 2005. Nineteen reviews evaluated the quality of primary studies, and 6 of these reviews performed meta-analyses. The methodological quality of reviews was considered to be moderate (52.8 ± 22.3% for reviewer #1 and 54.8 ± 16.5% for reviewer #2); of the 31 included reviews, 7, 18 and 6 reviews had high, moderate and poor quality, respectively. Conclusion The quality of published reviews varies from moderate to poor. Improvements in the study design can be achieved by following specific recommendations, such as clearly describing the methods, performing the data extraction in duplicate, researching at least two databases, listing the included and excluded studies, employing tables with the main studies data and evaluating and reporting the scientific quality of the included articles.
Literature
1.
go back to reference Hepler CD, Strand LM. Opportunities and responsibilities in pharmaceutical care. Am J Hosp Pharm. 1990;47(3):533–43.PubMed Hepler CD, Strand LM. Opportunities and responsibilities in pharmaceutical care. Am J Hosp Pharm. 1990;47(3):533–43.PubMed
2.
go back to reference Fundación Pharmaceutical Care España. Manual de procedimentos en Atención Farmacéutica. Barcelona: PhCE. 1999;ISBN: 84-699-1180-5. Fundación Pharmaceutical Care España. Manual de procedimentos en Atención Farmacéutica. Barcelona: PhCE. 1999;ISBN: 84-699-1180-5.
3.
go back to reference Kennie NR, Schuster BG, Einarson TR. Critical analysis of the pharmaceutical care research literature. Ann Pharmacother. 1998;32(1):17–26.PubMedCrossRef Kennie NR, Schuster BG, Einarson TR. Critical analysis of the pharmaceutical care research literature. Ann Pharmacother. 1998;32(1):17–26.PubMedCrossRef
4.
go back to reference Rangel Mayoral JF, Luis Fernandez J, Liso Rubio FJ. Current research status in pharmaceutical care. Farm Hosp. 2005;29(5):335–42.PubMedCrossRef Rangel Mayoral JF, Luis Fernandez J, Liso Rubio FJ. Current research status in pharmaceutical care. Farm Hosp. 2005;29(5):335–42.PubMedCrossRef
5.
go back to reference Roughead EE, Semple SJ, Vitry AI. Pharmaceutical care services: a systematic review of published studies, 1990 to 2003, examining effectiveness in improving patient outcomes. Int J Pharm Pract. 2005;13(1):53–70.CrossRef Roughead EE, Semple SJ, Vitry AI. Pharmaceutical care services: a systematic review of published studies, 1990 to 2003, examining effectiveness in improving patient outcomes. Int J Pharm Pract. 2005;13(1):53–70.CrossRef
6.
go back to reference Shea B, Dubé C, Moher D. Assessing the quality of reports of systematic reviews: the QUOROM statement compared to other tools. In: Egger M, Smith GD, Altman DG, editors. Systematic reviews in health care: meta-analysis in context. London: BMJ Books; 2001. p. 122–39.CrossRef Shea B, Dubé C, Moher D. Assessing the quality of reports of systematic reviews: the QUOROM statement compared to other tools. In: Egger M, Smith GD, Altman DG, editors. Systematic reviews in health care: meta-analysis in context. London: BMJ Books; 2001. p. 122–39.CrossRef
7.
go back to reference Oxman AD, Guyatt GH. Validation of an index of the quality of review articles. J Clin Epidemiol. 1991;44(11):1271–8.PubMedCrossRef Oxman AD, Guyatt GH. Validation of an index of the quality of review articles. J Clin Epidemiol. 1991;44(11):1271–8.PubMedCrossRef
8.
go back to reference Oxman AD, Guyatt GH, Singer J, Goldsmith CH, Hutchison BG, Milner RA, et al. Agreement among reviewers of review articles. J Clin Epidemiol. 1991;44(1):91–8.PubMedCrossRef Oxman AD, Guyatt GH, Singer J, Goldsmith CH, Hutchison BG, Milner RA, et al. Agreement among reviewers of review articles. J Clin Epidemiol. 1991;44(1):91–8.PubMedCrossRef
9.
go back to reference Sacks HS, Berrier J, Reitman D, Ancona-Berk VA, Chalmers TC. Meta-analyses of randomized controlled trials. N Engl J Med. 1987;316(8):450–5.PubMedCrossRef Sacks HS, Berrier J, Reitman D, Ancona-Berk VA, Chalmers TC. Meta-analyses of randomized controlled trials. N Engl J Med. 1987;316(8):450–5.PubMedCrossRef
10.
go back to reference Shea BJ, Grimshaw JM, Wells GA, Boers M, Andersson N, Hamel C, et al. Development of AMSTAR: a measurement tool to assess the methodological quality of systematic reviews. BMC Med Res Methodol. 2007;7:10.PubMedCrossRef Shea BJ, Grimshaw JM, Wells GA, Boers M, Andersson N, Hamel C, et al. Development of AMSTAR: a measurement tool to assess the methodological quality of systematic reviews. BMC Med Res Methodol. 2007;7:10.PubMedCrossRef
11.
go back to reference Shea BJ, Hamel C, Wells GA, Bouter LM, Kristjansson E, Grimshaw J, et al. AMSTAR is a reliable and valid measurement tool to assess the methodological quality of systematic reviews. J Clin Epidemiol. 2009;62(10):1013–20.PubMedCrossRef Shea BJ, Hamel C, Wells GA, Bouter LM, Kristjansson E, Grimshaw J, et al. AMSTAR is a reliable and valid measurement tool to assess the methodological quality of systematic reviews. J Clin Epidemiol. 2009;62(10):1013–20.PubMedCrossRef
12.
go back to reference Oxman AD, Schunemann HJ, Fretheim A. Improving the use of research evidence in guideline development: 8. Synthesis and presentation of evidence. Health Res Policy Syst. 2006;4:20.PubMedCrossRef Oxman AD, Schunemann HJ, Fretheim A. Improving the use of research evidence in guideline development: 8. Synthesis and presentation of evidence. Health Res Policy Syst. 2006;4:20.PubMedCrossRef
13.
go back to reference Shojania KG, Bero LA. Taking advantage of the explosion of systematic reviews: an efficient MEDLINE search strategy. Eff Clin Pract. 2001;4(4):157–62.PubMed Shojania KG, Bero LA. Taking advantage of the explosion of systematic reviews: an efficient MEDLINE search strategy. Eff Clin Pract. 2001;4(4):157–62.PubMed
14.
go back to reference Kozma CM. Outcomes research and pharmacy practice. Am Pharm. 1995;NS36(7):34–40. Kozma CM. Outcomes research and pharmacy practice. Am Pharm. 1995;NS36(7):34–40.
16.
go back to reference Shea BJ, Bouter LM, Peterson J, Boers M, Andersson N, Ortiz Z, et al. External validation of a measurement tool to assess systematic reviews (AMSTAR). PLoS One. 2007;2(12):e1350.PubMedCrossRef Shea BJ, Bouter LM, Peterson J, Boers M, Andersson N, Ortiz Z, et al. External validation of a measurement tool to assess systematic reviews (AMSTAR). PLoS One. 2007;2(12):e1350.PubMedCrossRef
17.
go back to reference Mikton C, Butchart A. Child maltreatment prevention: a systematic review of reviews. Bull World Health Organ. 2009;87(5):353–61.PubMedCrossRef Mikton C, Butchart A. Child maltreatment prevention: a systematic review of reviews. Bull World Health Organ. 2009;87(5):353–61.PubMedCrossRef
18.
go back to reference Dent LA, Harris KJ, Noonan CW. Tobacco interventions delivered by pharmacists: a summary and systematic review. Pharmacotherapy. 2007;27(7):1040–51.PubMedCrossRef Dent LA, Harris KJ, Noonan CW. Tobacco interventions delivered by pharmacists: a summary and systematic review. Pharmacotherapy. 2007;27(7):1040–51.PubMedCrossRef
19.
go back to reference Finley PR, Crismon ML, Rush AJ. Evaluating the impact of pharmacists in mental health: a systematic review. Pharmacotherapy. 2003;23(12):1634–44.PubMedCrossRef Finley PR, Crismon ML, Rush AJ. Evaluating the impact of pharmacists in mental health: a systematic review. Pharmacotherapy. 2003;23(12):1634–44.PubMedCrossRef
20.
go back to reference Hanlon JT, Lindblad CI, Gray SL. Can clinical pharmacy services have a positive impact on drug-related problems and health outcomes in community-based older adults? Am J Geriatr Pharmacother. 2004;2(1):3–13.PubMedCrossRef Hanlon JT, Lindblad CI, Gray SL. Can clinical pharmacy services have a positive impact on drug-related problems and health outcomes in community-based older adults? Am J Geriatr Pharmacother. 2004;2(1):3–13.PubMedCrossRef
21.
go back to reference Kaboli PJ, Hoth AB, McClimon BJ, Schnipper JL. Clinical pharmacists and inpatient medical care: a systematic review. Arch Intern Med. 2006;166(9):955–64.PubMedCrossRef Kaboli PJ, Hoth AB, McClimon BJ, Schnipper JL. Clinical pharmacists and inpatient medical care: a systematic review. Arch Intern Med. 2006;166(9):955–64.PubMedCrossRef
22.
go back to reference Pickard AS, Hung SY. An update on evidence of clinical pharmacy services’ impact on health-related quality of life. Ann Pharmacother. 2006;40(9):1623–34.PubMedCrossRef Pickard AS, Hung SY. An update on evidence of clinical pharmacy services’ impact on health-related quality of life. Ann Pharmacother. 2006;40(9):1623–34.PubMedCrossRef
23.
go back to reference Singhal PK, Raisch DW, Gupchup GV. The impact of pharmaceutical services in community and ambulatory care settings: evidence and recommendations for future research. Ann Pharmacother. 1999;33(12):1336–55.PubMedCrossRef Singhal PK, Raisch DW, Gupchup GV. The impact of pharmaceutical services in community and ambulatory care settings: evidence and recommendations for future research. Ann Pharmacother. 1999;33(12):1336–55.PubMedCrossRef
24.
go back to reference Wubben DR, Vivian EM. Effects of pharmacist outpatient interventions on adults with diabetes mellitus: a systematic review. Pharmacotherapy. 2008;28(4):421–36.PubMedCrossRef Wubben DR, Vivian EM. Effects of pharmacist outpatient interventions on adults with diabetes mellitus: a systematic review. Pharmacotherapy. 2008;28(4):421–36.PubMedCrossRef
25.
go back to reference Blenkinsopp A, Anderson C, Armstrong M. Systematic review of the effectiveness of community pharmacy-based interventions to reduce risk behaviours and risk factors for coronary heart disease. J Public Health Med. 2003;25(2):144–53.PubMedCrossRef Blenkinsopp A, Anderson C, Armstrong M. Systematic review of the effectiveness of community pharmacy-based interventions to reduce risk behaviours and risk factors for coronary heart disease. J Public Health Med. 2003;25(2):144–53.PubMedCrossRef
26.
go back to reference Blenkinsopp A, Hassey A. Effectiveness and acceptability of community pharmacy-based interventions in type 2 diabetes: a critical review of intervention design, pharmacist and patient perspectives. Int J Pharm Pract. 2005;13(4):231–40.CrossRef Blenkinsopp A, Hassey A. Effectiveness and acceptability of community pharmacy-based interventions in type 2 diabetes: a critical review of intervention design, pharmacist and patient perspectives. Int J Pharm Pract. 2005;13(4):231–40.CrossRef
27.
go back to reference Fish A, Watson MC, Bond CM. Practice-based pharmaceutical services: a systematic review. Int J Pharm Pract. 2002;10(4):225–33.CrossRef Fish A, Watson MC, Bond CM. Practice-based pharmaceutical services: a systematic review. Int J Pharm Pract. 2002;10(4):225–33.CrossRef
28.
go back to reference Holland R, Desborough J, Goodyer L, Hall S, Wright D, Loke YK. Does pharmacist-led medication review help to reduce hospital admissions and deaths in older people? A systematic review and meta-analysis. Br J Clin Pharmacol. 2008;65(3):303–16.PubMedCrossRef Holland R, Desborough J, Goodyer L, Hall S, Wright D, Loke YK. Does pharmacist-led medication review help to reduce hospital admissions and deaths in older people? A systematic review and meta-analysis. Br J Clin Pharmacol. 2008;65(3):303–16.PubMedCrossRef
29.
go back to reference Sinclair HK, Bond CM, Stead LF. Community pharmacy personnel interventions for smoking cessation. Cochrane Database Syst Rev. 2004;(1):CD003698. Sinclair HK, Bond CM, Stead LF. Community pharmacy personnel interventions for smoking cessation. Cochrane Database Syst Rev. 2004;(1):CD003698.
30.
go back to reference Zermansky AG, Silcock J. Is medication review by primary-care pharmacists for older people cost effective? A narrative review of the literature, focusing on costs and benefits. PharmacoEconomics. 2009;27(1):11–24.PubMedCrossRef Zermansky AG, Silcock J. Is medication review by primary-care pharmacists for older people cost effective? A narrative review of the literature, focusing on costs and benefits. PharmacoEconomics. 2009;27(1):11–24.PubMedCrossRef
31.
go back to reference Bell S, McLachlan AJ, Aslani P, Whitehead P, Chen TF. Community pharmacy services to optimise the use of medications for mental illness: A systematic review. Aust New Zealand Health Policy. 2005;2(1). Bell S, McLachlan AJ, Aslani P, Whitehead P, Chen TF. Community pharmacy services to optimise the use of medications for mental illness: A systematic review. Aust New Zealand Health Policy. 2005;2(1).
32.
go back to reference Castelino RL, Bajorek BV, Chen TF. Targeting suboptimal prescribing in the elderly: a review of the impact of pharmacy services. Ann Pharmacother. 2009;43(6):1096–106.PubMedCrossRef Castelino RL, Bajorek BV, Chen TF. Targeting suboptimal prescribing in the elderly: a review of the impact of pharmacy services. Ann Pharmacother. 2009;43(6):1096–106.PubMedCrossRef
33.
go back to reference Ellitt GR, Brien JA, Aslani P, Chen TF. Quality patient care and pharmacists’ role in its continuity—a systematic review. Ann Pharmacother. 2009;43(4):677–91.PubMedCrossRef Ellitt GR, Brien JA, Aslani P, Chen TF. Quality patient care and pharmacists’ role in its continuity—a systematic review. Ann Pharmacother. 2009;43(4):677–91.PubMedCrossRef
34.
go back to reference Ponniah A, Anderson B, Shakib S, Doecke CJ, Angley M. Pharmacists’ role in the post-discharge management of patients with heart failure: a literature review. J Clin Pharm Ther. 2007;32(4):343–52.PubMedCrossRef Ponniah A, Anderson B, Shakib S, Doecke CJ, Angley M. Pharmacists’ role in the post-discharge management of patients with heart failure: a literature review. J Clin Pharm Ther. 2007;32(4):343–52.PubMedCrossRef
35.
go back to reference Koshman SL, Charrois TL, Simpson SH, McAlister FA, Tsuyuki RT. Pharmacist care of patients with heart failure: a systematic review of randomized trials. Arch Intern Med. 2008;168(7):687–94.PubMedCrossRef Koshman SL, Charrois TL, Simpson SH, McAlister FA, Tsuyuki RT. Pharmacist care of patients with heart failure: a systematic review of randomized trials. Arch Intern Med. 2008;168(7):687–94.PubMedCrossRef
36.
go back to reference Pickard AS, Johnson JA, Farris KB. The impact of pharmacist interventions on health-related quality of life. Ann Pharmacother. 1999;33(11):1167–72.PubMedCrossRef Pickard AS, Johnson JA, Farris KB. The impact of pharmacist interventions on health-related quality of life. Ann Pharmacother. 1999;33(11):1167–72.PubMedCrossRef
37.
go back to reference Rollason V, Vogt N. Reduction of polypharmacy in the elderly: a systematic review of the role of the pharmacist. Drugs Aging. 2003;20(11):817–32.PubMedCrossRef Rollason V, Vogt N. Reduction of polypharmacy in the elderly: a systematic review of the role of the pharmacist. Drugs Aging. 2003;20(11):817–32.PubMedCrossRef
38.
go back to reference Von Gunten V, Reymond JP, Beney J. Clinical and economic outcomes of pharmaceutical services related to antibiotic use: a literature review. Pharm World Sci. 2007;29(3):146–63.CrossRef Von Gunten V, Reymond JP, Beney J. Clinical and economic outcomes of pharmaceutical services related to antibiotic use: a literature review. Pharm World Sci. 2007;29(3):146–63.CrossRef
39.
go back to reference Verrue CLR, Petrovic M, Mehuys E, Remon JP, Vander Stichele R. Pharmacists’ interventions for optimization of medication use in nursing homes: a systematic review. Drugs Aging. 2009;26(1):37–49.PubMedCrossRef Verrue CLR, Petrovic M, Mehuys E, Remon JP, Vander Stichele R. Pharmacists’ interventions for optimization of medication use in nursing homes: a systematic review. Drugs Aging. 2009;26(1):37–49.PubMedCrossRef
40.
go back to reference Lindenmeyer A, Hearnshaw H, Vermeire E, Van Royen P, Wens J, Biot Y. Interventions to improve adherence to medication in people with type 2 diabetes mellitus: a review of the literature on the role of pharmacists. J Clin Pharm Ther. 2006;31(5):409–19.PubMedCrossRef Lindenmeyer A, Hearnshaw H, Vermeire E, Van Royen P, Wens J, Biot Y. Interventions to improve adherence to medication in people with type 2 diabetes mellitus: a review of the literature on the role of pharmacists. J Clin Pharm Ther. 2006;31(5):409–19.PubMedCrossRef
41.
go back to reference Machado M, Bajcar J, Guzzo GC, Einarson TR. Sensitivity of patient outcomes to pharmacist interventions. Part I: systematic review and meta-analysis in diabetes management. Ann Pharmacother. 2007;41(10):1569–82.PubMedCrossRef Machado M, Bajcar J, Guzzo GC, Einarson TR. Sensitivity of patient outcomes to pharmacist interventions. Part I: systematic review and meta-analysis in diabetes management. Ann Pharmacother. 2007;41(10):1569–82.PubMedCrossRef
42.
go back to reference Machado M, Bajcar J, Guzzo GC, Einarson TR. Sensitivity of patient outcomes to pharmacist interventions. Part II: systematic review and meta-analysis in hypertension management. Ann Pharmacother. 2007;41(11):1770–81.PubMedCrossRef Machado M, Bajcar J, Guzzo GC, Einarson TR. Sensitivity of patient outcomes to pharmacist interventions. Part II: systematic review and meta-analysis in hypertension management. Ann Pharmacother. 2007;41(11):1770–81.PubMedCrossRef
43.
go back to reference Machado M, Nassor N, Bajcar JM, Guzzo GC, Einarson TR. Sensitivity of patient outcomes to pharmacist interventions. Part III: systematic review and meta-analysis in hyperlipidemia management. Ann Pharmacother. 2008;42(9):1195–207.PubMedCrossRef Machado M, Nassor N, Bajcar JM, Guzzo GC, Einarson TR. Sensitivity of patient outcomes to pharmacist interventions. Part III: systematic review and meta-analysis in hyperlipidemia management. Ann Pharmacother. 2008;42(9):1195–207.PubMedCrossRef
44.
go back to reference Sanghera N, Chan PY, Khaki ZF, Planner C, Lee KK, Cranswick NE, et al. Interventions of hospital pharmacists in improving drug therapy in children: a systematic literature review. Drug Saf. 2006;29(11):1031–47.PubMedCrossRef Sanghera N, Chan PY, Khaki ZF, Planner C, Lee KK, Cranswick NE, et al. Interventions of hospital pharmacists in improving drug therapy in children: a systematic literature review. Drug Saf. 2006;29(11):1031–47.PubMedCrossRef
45.
go back to reference Van Wijk BLG, Klungel OH, Heerdink ER, De Boer A. Effectiveness of interventions by community pharmacists to improve patient adherence to chronic medication: a systematic review. Ann Pharmacother. 2005;39(2):319–28.PubMedCrossRef Van Wijk BLG, Klungel OH, Heerdink ER, De Boer A. Effectiveness of interventions by community pharmacists to improve patient adherence to chronic medication: a systematic review. Ann Pharmacother. 2005;39(2):319–28.PubMedCrossRef
46.
go back to reference Downs SH, Black N. The feasibility of creating a checklist for the assessment of the methodological quality both of randomised and non-randomised studies of health care interventions. J Epidemiol Community Health. 1998;52(6):377–84.PubMedCrossRef Downs SH, Black N. The feasibility of creating a checklist for the assessment of the methodological quality both of randomised and non-randomised studies of health care interventions. J Epidemiol Community Health. 1998;52(6):377–84.PubMedCrossRef
47.
go back to reference Jadad AR, Moore RA, Carroll D, Jenkinson C, Reynolds DJ, Gavaghan DJ, et al. Assessing the quality of reports of randomized clinical trials: is blinding necessary? Control Clin Trials. 1996;17(1):1–12.PubMedCrossRef Jadad AR, Moore RA, Carroll D, Jenkinson C, Reynolds DJ, Gavaghan DJ, et al. Assessing the quality of reports of randomized clinical trials: is blinding necessary? Control Clin Trials. 1996;17(1):1–12.PubMedCrossRef
48.
49.
go back to reference Deeks JJ, Dinnes J, D’Amico R, Sowden AJ, Sakarovitch C, Song F, et al. Evaluating non-randomised intervention studies. Health Technol Assess. 2003;7(27):iii–x, 1–173. Deeks JJ, Dinnes J, D’Amico R, Sowden AJ, Sakarovitch C, Song F, et al. Evaluating non-randomised intervention studies. Health Technol Assess. 2003;7(27):iii–x, 1–173.
Metadata
Title
An analysis of quality of systematic reviews on pharmacist health interventions
Authors
Ana Carolina Melchiors
Cassyano Januário Correr
Rafael Venson
Roberto Pontarolo
Publication date
01-02-2012
Publisher
Springer Netherlands
Published in
International Journal of Clinical Pharmacy / Issue 1/2012
Print ISSN: 2210-7703
Electronic ISSN: 2210-7711
DOI
https://doi.org/10.1007/s11096-011-9592-0

Other articles of this Issue 1/2012

International Journal of Clinical Pharmacy 1/2012 Go to the issue