Skip to main content
Key Specialties
Cardiology Diabetology Endocrinology Gastroenterology Geriatrics and Gerontology Gynecology and Obstetrics Hematology Infectious Disease Internal Medicine Nephrology Neurology Oncology Pediatrics Respiratory Medicine Rheumatology Surgery
Congress Coverage
2024 ACC Congress 2023 ESMO Congress 2023 EASD Congress 2023 ERS Congress 2023 ESC Congress 2023 EHA Congress 2023 ASCO Annual Meeting
Clinical Collections
Advances in Alzheimer’s

Keynote webinar | Spotlight on sleep in brain health

LIVE: Thursday 2nd May 2024, 18:00-19:30 (CEST)

Quality sleep is essential for health. But what happens to our brains when sleep patterns are disturbed? Join our experts to explore the interplay between sleep disruption and neurological diseases, and the questions that you need to be asking your patients to help you prevent the harmful effects of sleep deprivation.
ADVANCED SEARCH
Log in
Top
BMC Complementary Medicine and Therapies
Published in: BMC Complementary Medicine and Therapies 1/2016

Open Access 01-12-2016 | Research article

The quantity and quality of complementary and alternative medicine clinical practice guidelines on herbal medicines, acupuncture and spinal manipulation: systematic review and assessment using AGREE II

Authors: Jeremy Y. Ng, Laurel Liang, Anna R. Gagliardi

Published in: BMC Complementary Medicine and Therapies | Issue 1/2016

Login to get access

Abstract

Background

Complementary and alternative medicine (CAM) use is often not disclosed by patients, and can be unfamiliar to health care professionals. This may lead to underuse of beneficial CAM therapies, and overuse of other CAM therapies with little proven benefit or known contraindications. No prior research has thoroughly evaluated the credibility of knowledge-based resources. The purpose of this research was to assess the quantity and quality of CAM guidelines.

Methods

A systematic review was conducted to identify CAM guidelines. MEDLINE, EMBASE and CINAHL were searched in January 2016 from 2003 to 2015. The National Guideline Clearinghouse, National Center for Complementary and Integrative Health web site, and two CAM journals were also searched. Eligible guidelines published in English language by non-profit agencies on herbal medicine, acupuncture, or spinal manipulation for adults with any condition were assessed with the Appraisal of Guidelines, Research and Evaluation II (AGREE II) instrument.

Results

From 3,126 unique search results, 17 guidelines (two herbal medicine, three acupuncture, four spinal manipulation, eight mixed CAM therapies) published in 2003 or later and relevant to several clinical conditions were eligible. Scaled domain percentages from highest to lowest were clarity of presentation (85.3 %), scope and purpose (83.3 %), rigour of development (61.2 %), editorial independence (60.1 %), stakeholder involvement (52.0 %) and applicability (20.7 %). Quality varied within and across guidelines. None of the 17 guidelines were recommended by both appraisers; 14 were recommended as Yes or Yes with modifications.

Conclusions

Guidelines that scored well could be used by patients and health care professionals as the basis for discussion about the use of these CAM therapies. In future updates, guidelines that achieved variable or lower scores could be improved according to specifications in the AGREE II instrument, and with insight from a large number of resources that are available to support guideline development and implementation. Future research should identify CAM therapies other than those reviewed here for which guidelines are available. Research is also needed on the safety and effectiveness of CAM therapies.
Appendix
Available only for authorised users
Literature
1.
2.
Barnes PM, Powell-Griner E, McFann K, Nahin RL. Complementary and alternative medicine use among adults: United States, 2002. Semin Integr Med. 2004;2(2):54–71.CrossRef
3.
Eisenberg DM, Davis RB, Ettner SL, Appel S, Wilkey S, Van Rompay M, Kessler RC. Trends in alternative medicine use in the United States, 1990-1997: Results of a follow-up national survey. JAMA. 1998;280(18):1569–75.CrossRefPubMed
4.
Nahin RL, Barnes PM, Stussman BJ, Bloom B. Costs of complementary and alternative medicine (CAM) and frequency of visits to CAM practitioners: US 2007. Hyattsville: Diane Publishing; 2010.
5.
Esmail N. Complementary and alternative medicine in Canada: trends in use and public attitudes, 1997-2006. Vancouver: Fraser Institute; 2007.
6.
7.
Ng JY, Boon HS, Thompson AK, Whitehead CR. Making sense of “alternative”, “complementary”, “unconventional” and “integrative” medicine: exploring the terms and meanings through a textual analysis. BMC Complement Altern Med. 2016;16(134):1.
8.
9.
Walker BF, French SD, Grant W, Green S. A Cochrane review of combined chiropractic interventions for low-back pain. Spine J. 2011;36(3):230–42.CrossRef
10.
Bronfort G, Haas M, Evans R, Leininger B, Triano J. Effectiveness of manual therapies: the UK evidence report. Chiropr Man Therap. 2010;18(1):3.
11.
Bronfort G, Assendelft WJ, Evans R, Haas M, Bouter L. Efficacy of spinal manipulation for chronic headache: a systematic review. J Manipulative Physiol Ther. 2001;24(7):457–66.CrossRefPubMed
12.
Cherkin DC, Mootz RD. Chiropractic in the United States: training, practice, and research. Rockville: AHCPR Publication; 1997.
13.
Liu L, Skinner M, McDonough S, Mabire L, Baxter GD. Acupuncture for low back pain: an overview of systematic reviews. Evid Based Complement Alternat Med. 2015;2015:328196.PubMedPubMedCentral
14.
Manyanga T, Froese M, Zarychanski R, Abou-Setta A, Friesen C, Tennenhouse M, Shay BL. Pain management with acupuncture in osteoarthritis: a systematic review and meta-analysis. BMC Complement Altern Med. 2014;14(1):312.CrossRefPubMedPubMedCentral
15.
Vickers AJ, Cronin AM, Maschino AC, Lewith G, MacPherson H, Foster NE, Sherman KJ, Witt CM, Linde K. Acupuncture for chronic pain: individual patient data meta-analysis. Arch Intern Med. 2012;172(19):1444–53.CrossRefPubMedPubMedCentral
16.
Cherkin DC, Sherman KJ, Avins AL, Erro JH, Ichikawa L, Barlow WE, Delaney K, Hawkes R, Hamilton L, Pressman A, Khalsa PS. A randomized trial comparing acupuncture, simulated acupuncture, and usual care for chronic low back pain. Arch Intern Med. 2009;169(9):858–66.CrossRefPubMedPubMedCentral
17.
Yuan J, Purepong N, Kerr DP, Park J, Bradbury I, McDonough S. Effectiveness of acupuncture for low back pain: a systematic review. Spine J. 2008;33(23):E887–900.CrossRef
18.
Witt CM, Jena S, Brinkhaus B, Liecker B, Wegscheider K, Willich SN. Acupuncture for patients with chronic neck pain. Pain. 2006;125(1):98–106.CrossRefPubMed
19.
Ventola CL. Current issues regarding complementary and alternative medicine (CAM) in the United States: Part 1: The widespread use of CAM and the need for better-informed health care professionals to provide patient counseling. Pharmacol Ther. 2010;35(8):461.
20.
Barraco D, Valencia G, Riba AL, Nareddy S, Draus CB, Schwartz SM. Complementary and alternative medicine (CAM) use patterns and disclosure to physicians in acute coronary syndromes patients. Complement Ther Med. 2005;13(1):34–40.CrossRefPubMed
21.
Coulter ID, Willis EM. The rise and rise of complementary and alternative medicine: a sociological perspective. Med J Aust. 2004;180(11):587.PubMed
22.
Tsai HH, Lin HW, Simon Pickard A, Tsai HY, Mahady GB. Evaluation of documented drug interactions and contraindications associated with herbs and dietary supplements: A systematic literature review. Int J Clin Pract. 2012;66(11):1056–78.CrossRefPubMed
23.
24.
Adams KE, Cohen MH, Eisenberg D, Jonsen AR. Ethical considerations of complementary and alternative medical therapies in conventional medical settings. Ann Intern Med. 2002;137(8):660–4.CrossRefPubMed
25.
Wilkinson S, Gomella LG, Smith JA, Brawer MK, Dawson NA, Wajsman Z, Dai L, Chodak GW. Attitudes and use of complementary medicine in men with prostate cancer. J Urol. 2002;168(6):2505–9.CrossRefPubMed
26.
27.
Pearson NJ, Chesney MA. The CAM education program of the national center for complementary and alternative medicine: an overview. Acad Med. 2007;82(10):921–6.CrossRefPubMed
28.
Kroll DJ. ASHP statement on the use of dietary supplements. Am J Health Syst Pharm. 2004;61(16):1707–11.PubMed
29.
Halcón LL, Chlan LL, Kreitzer MJ, Leonard BJ. Complementary therapies and healing practices: faculty/student beliefs and attitudes and the implications for nursing education. J Prof Nurs. 2003;19(6):387–97.CrossRefPubMed
30.
Weir M. Legal issues for medical doctors in the provision of complementary and alternative medicine. Med Law. 2007;26(4):817–28.PubMed
31.
Shekelle P, Woolf S, Grimshaw JM, Schunemann H, Eccles MP. Developing clinical practice guidelines: reviewing, reporting, and publishing guidelines; updating guidelines; and the emerging issues of enhancing guideline implementability and accounting for comorbid conditions in guideline development. Implement Sci. 2012;7:62.CrossRefPubMedPubMedCentral
32.
Mickan S, Burls A, Glasziou P. Patterns of “leakage” in the utilization of clinical guidelines: a systematic review. Postgrad Med J. 2011;87(1032):670–9.CrossRefPubMedPubMedCentral
33.
Gagliardi AR, Brouwers MC. Do guidelines offer implementation advice to target users? A systematic review of guideline applicability. BMJ Open. 2015;5(2):e007047.CrossRefPubMedPubMedCentral
34.
Team V, Canaway R, Manderson L. Integration of complementary and alternative medicine information and advice in chronic disease management guidelines. Aust J Prim Health. 2011;17(2):142–9.CrossRefPubMed
35.
Ernst E. Assessments of complementary and alternative medicine: the clinical guidelines from NICE. Int J Clin Pract. 2010;64(10):1350–8.CrossRefPubMed
36.
Higgins JPT, Green S, editors. Cochrane Handbook for Systematic Reviews of Interventions Version 5.1.0. London: The Cochrane Collaboration; 2011.
37.
Moher D, Liberati A, Tetzlaff J, Altman DG. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. Ann Intern Med. 2009;151(4):264–9.CrossRefPubMed
38.
Brouwers MC, Kho ME, Browman GP, Burgers JS, Cluzeau F, Feder G, Fervers B, Graham ID, Grimshaw J, Hanna SE, Littlejohns P. AGREE II: advancing guideline development, reporting and evaluation in health care. Can Med Assoc J. 2010;182(18):E839–42.CrossRef
39.
Wieland LS, Manheimer E, Sampson M, Barnabas JP, Bouter LM, Cho K, Lee MS, Li X, Liu J, Moher D, Okabe T. Bibliometric and content analysis of the Cochrane complementary medicine field specialized register of controlled trials. Syst Rev. 2013;2:51.CrossRefPubMedPubMedCentral
40.
Fogarty S, Ramjan LM. Practice guidelines for acupuncturists using acupuncture as an adjunctive treatment for anorexia nervosa. Complement Ther Med. 2015;23(1):14–22.CrossRefPubMed
41.
Greenlee H, Balneaves LG, Carlson LE, Cohen M, Deng G, Hershman D, Mumber M, Perlmutter J, Seely D, Sen A, Zick SM. Clinical practice guidelines on the use of integrative therapies as supportive care in patients treated for breast cancer. J Natl Cancer Inst Monogr. 2014;50(2014):346–58.CrossRef
42.
Bryans R, Decina P, Descarreaux M, Duranleau M, Marcoux H, Potter B, Ruegg RP, Shaw L, Watkin R, White E. Evidence-based guidelines for the chiropractic treatment of adults with neck pain. J Manipulative Physiol Ther. 2014;37(1):42–63.CrossRefPubMed
43.
Yadav V, Bever C, Bowen J, Bowling A, Weinstock-Guttman B, Cameron M, Bourdette D, Gronseth GS, Narayanaswami P. Summary of evidence-based guideline: complementary and alternative medicine in multiple sclerosis. J Neurol. 2014;82(12):1083–92.CrossRef
44.
Deng GE, Rausch SM, Jones LW, Gulati A, Kumar NB, Greenlee H, Pietanza MC, Cassileth BR. Complementary therapies and integrative medicine in lung cancer: diagnosis and management of lung cancer: American College of Chest Physicians evidence-based clinical practice guidelines. Chest. 2013;143 Suppl 5:e420S–36.CrossRefPubMed
45.
Liu ZS, Peng WN, Liu BY, Wang J, Wang Y, Mao M, Deng YH, Yu JN, Liaw Y, Mu Y, Luo Y. Clinical practice guideline of acupuncture for herpes zoster. Chin J Integr Med. 2013;19(1):58–67.CrossRefPubMed
46.
47.
Holland S, Silberstein SD, Freitag F, Dodick DW, Argoff C, Ashman E. Evidence-based guideline update: NSAIDs and other complementary treatments for episodic migraine prevention in adults Report of the Quality Standards Subcommittee of the American Academy of Neurology and the American Headache Society. Neurology. 2012;78(17):1346–53.CrossRefPubMedPubMedCentral
48.
Bryans R, Descarreaux M, Duranleau M, Marcoux H, Potter B, Ruegg R, Shaw L, Watkin R, White E. Evidence-based guidelines for the chiropractic treatment of adults with headache. J Manipulative Physiol Ther. 2011;34(5):274–89.CrossRefPubMed
49.
Seffinger MA, Buser BR, Licciardone JC. American Osteopathic Association guidelines for osteopathic manipulative treatment (OMT) for patients with low back pain. Clinical guideline subcommittee on low back pain. J Am Osteopath Assoc. 2010;110(11):653–66.
50.
Ravindran AV, Lam RW, Filteau MJ, Lespérance F, Kennedy SH, Parikh SV, Patten SB. Canadian Network for Mood and Anxiety Treatments (CANMAT) Clinical guidelines for the management of major depressive disorder in adults.: V. Complementary and alternative medicine treatments. J Affect Disord. 2009;117 Suppl 1:S54–64.CrossRefPubMed
51.
Deng GE, Frenkel M, Cohen L, Cassileth BR, Abrams DI, Capodice JL, Courneya KS, Dryden T, Hanser S, Kumar N, Labriola D. Evidence-based clinical practice guidelines for integrative oncology: complementary therapies and botanicals. J Soc Integr Oncol. 2009;7(3):85.PubMed
52.
Filshie J, Hester J. Guidelines for providing acupuncture treatment for cancer patients–a peer-reviewed sample policy document. Acupunct Med. 2006;24(4):172–82.CrossRefPubMed
53.
Suchowersky O, Gronseth G, Perlmutter J, Reich S, Zesiewicz T, Weiner WJ. Practice Parameter: Neuroprotective strategies and alternative therapies for Parkinson disease (an evidence-based review) Report of the quality standards subcommittee of the American Academy of Neurology. J Neurol. 2006;66(7):976–82.CrossRef
54.
Anderson-Peacock E, Blouin JS, Bryans R, Danis N. Chiropractic clinical practice guideline: evidence-based treatment of adult neck pain not due to whiplash. J Can Chiropr Assoc. 2005;49(3):158.PubMedPubMedCentral
55.
Werneke U. A guide to using complementary alternative medicines in cancer. Drugs. 2005;101(5):1403–11.
56.
Mechanick JI, Brett EM, Chausmer AB, Dickey RA, Wallach S, Bergman DA, Garber JR, Hamilton CR, Handelsman Y, Holdy KE, Kukora JS. American Association of Clinical Endocrinologists medical guidelines for the clinical use of dietary supplements and nutraceuticals. Endocr Pract. 2003;9(5):417–70.CrossRefPubMed
57.
Alonso-Coello P, Irfan A, Solà I, Gich I, Delgado-Noguera M, Rigau D, Tort S, Bonfill X, Burgers J, Schunemann H. The quality of clinical practice guidelines over the last two decades: a systematic review of guideline appraisal studies. Qual Saf Health Care. 2010;19(6):1–7.
58.
Knai C, Brusamento S, Legido-Quigley H, Saliba V, Panteli D, Turk E, Car J, McKee M, Busse R. Systematic review of the methodological quality of clinical guideline development for the management of chronic disease in Europe. Health Policy. 2012;107(2):157–67.CrossRefPubMed
59.
National Health and Medical Research Council (NHMRC). Annual report on Australian clinical practice guidelines. Canberra: National Health and Medical Research Council; 2014.
60.
Weisleder P. Unethical prescriptions: alternative therapies for children with cerebral palsy. Clin Pediatr. 2010;49(1):7–11.CrossRef
61.
Singh S, Ernst E. Trick or treatment: the undeniable facts about alternative medicine. New York: WW Norton & Company; 2008.
62.
Chatfield K, Partington H, Duckworth J. The place of the university in the provision of CAM education. Aust J Homeopathic Med. 2012;24(1):16–20.
63.
64.
65.
Colquhoun D. Should NICE evaluate complementary and alternative medicines. BMJ. 2007;334:506–7.CrossRef
66.
Fischer FH, Lewith G, Witt CM, Linde K, von Ammon K, Cardini F, Falkenberg T, Fønnebø V, Johannessen H, Reiter B, Uehleke B. High prevalence but limited evidence in complementary and alternative medicine: guidelines for future research. BMC Complement Altern Med. 2014;14(1):1.CrossRef
67.
68.
Ernst E. Obstacles to research in complementary and alternative medicine. Med J Aust. 2003;179(6):279–80.PubMed
69.
Nissen N, Manderson L. Researching alternative and complementary therapies: mapping the field. Med Anthropol. 2013;32(1):1–7.CrossRefPubMed
70.
Clarke TC, Black LI, Stussman BJ, Barnes PM, Nahin RL. Trends in the use of complementary health approaches among adults: United States, 2002–2012. Natl Health Stat Report. 2015;10(79):1–16.
71.
Harris PE, Cooper KL, Relton C, Thomas KJ. Prevalence of complementary and alternative medicine (CAM) use by the general population: a systematic review and update. Int J Clin Pract. 2012;66(10):924–39.CrossRefPubMed
72.
Werneke U, Earl J, Seydel C, Horn O, Crichton P, Fannon D. Potential health risks of complementary alternative medicines in cancer patients. Br J Cancer. 2004;90(2):408–13.CrossRefPubMedPubMedCentral
73.
74.
Patel DN, Low WL, Tan LL, Tan MM, Zhang Q, Low MY, Chan CL, Koh HL. Adverse events associated with the use of complementary medicine and health supplements: An analysis of reports in the Singapore Pharmacovigilance database from 1998 to 2009. Clin Toxicol. 2012;50(6):481–9.CrossRef
75.
Angell M, Kassirer JP. Alternative medicine-the risks of untested and unregulated remedies. N Engl J Med. 1998;339(12):839–40.CrossRefPubMed
76.
Schünemann HJ, Oxman AD, Brozek J, Glasziou P, Bossuyt P, Chang S, Muti P, Jaeschke R, Guyatt GH. GRADE: assessing the quality of evidence for diagnostic recommendations. Evid Based Med. 2008;13(6):162–3.CrossRefPubMed
77.
Shiffman RN, Dixon J, Brandt C, Essaihi A, Hsiao A, Michel G, O’Connell R. The GuideLine Implementability Appraisal (GLIA): development of an instrument to identify obstacles to guideline implementation. BMC Med Inform Decis Mak. 2005;5(1):23.CrossRefPubMedPubMedCentral
78.
Schünemann HJ, Wiercioch W, Etxeandia I, Falavigna M, Santesso N, Mustafa R, Ventresca M, Brignardello-Petersen R, Laisaar KT, Kowalski S, Baldeh T. Guidelines 2.0: systematic development of a comprehensive checklist for a successful guideline enterprise. Can Med Assoc J. 2014;186(3):E123–42.CrossRef
79.
Gagliardi AR, Brouwers MC, Bhattacharyya O. A framework of the desirable features of guideline implementation tools (GItools): Delphi survey and assessment of GItools. Implement Sci. 2014;9:98.CrossRefPubMedPubMedCentral
80.
81.
Gagliardi AR, Marshall C, Huckson S, James R, Moore V. Developing a checklist for guideline implementation planning: A review and synthesis of guideline development and implementation advice. Implement Sci. 2015;10:19.CrossRefPubMedPubMedCentral
Metadata
Title
The quantity and quality of complementary and alternative medicine clinical practice guidelines on herbal medicines, acupuncture and spinal manipulation: systematic review and assessment using AGREE II
Authors
Jeremy Y. Ng
Laurel Liang
Anna R. Gagliardi
Publication date
01-12-2016
Publisher
BioMed Central
Published in
BMC Complementary Medicine and Therapies / Issue 1/2016
Electronic ISSN: 2662-7671
DOI
https://doi.org/10.1186/s12906-016-1410-8

Other articles of this Issue 1/2016

BMC Complementary Medicine and Therapies 1/2016 Go to the issue

Research article

Primary care physicians, acupuncture and chiropractic clinicians, and chronic pain patients: a qualitative analysis of communication and care coordination patterns

Research article

Usage of Plant Food Supplements (PFS) for weight control in six European countries: results from the PlantLIBRA PFS Consumer Survey 2011-2012

Research article

Effectiveness and safety of moxibustion for primary insomnia: a systematic review and meta-analysis

Research article

Antidiabetic activity of the ethyl acetate fraction of Ficus lutea (Moraceae) leaf extract: comparison of an in vitro assay with an in vivo obese mouse model

Research article

In vitro antibacterial activity and in vivo efficacy of hydrated clays on Mycobacterium ulcerans growth

Research article

Intestinal and vascular smooth muscle relaxant effect of Viscum album explains its medicinal use in hyperactive gut disorders and hypertension