Top

BMC Complementary Medicine and Therapies

Published in:

Open Access 01-12-2018 | Research article

The development of a survey instrument to measure the barriers to the conduct and application of research in complementary and alternative medicine: a Delphi study

Authors: Yasamin Veziari, Saravana Kumar, Matthew Leach

Published in: BMC Complementary Medicine and Therapies | Issue 1/2018

Abstract

Background

As Complementary and Alternative medicine (CAM) grows in popularity, there is overt recognition for research evidence to inform clinical practice. While various strategies have been trialed to overcome the barriers to such progress, it is important to first understand the extent to which these barriers impact the conduct and application of CAM research. This study aimed to garner consensus and agreement among CAM researchers and practitioners in refining and validating a preliminary survey instrument for measuring these barriers.

Methods

A three-round Delphi study was undertaken with 22 international experts of CAM research and practice. Round one gathered consensus on 30 statements listing barriers to the application and conduct of CAM research. Only rounds two and three sought consensus on revised statements. Any statement demonstrating ≥ 70% agreement on a four-point Likert scale was determined to have reached consensus.

Results

Consensus and agreement was achieved for all 30 statements listing the barriers to the application and conduct of research in CAM. Additional commentary by the Delphi participants directed whether a statement had to be split into two parts or reworded. This process resulted in the generation of the “BarrierS To the Application and Conduct of rEsearch” (oBSTACLES) instrument.

Conclusion

This study, the first of its kind on this topic, identified consensus and agreement on a series of evidence-informed statements to measure the barriers to the conduct and application of research in CAM. The uniqueness of the oBSTACLES instrument is its ability to measure barriers across the evidence-based continuum.

Available only for authorised users

World Health Organisation. Who traditional medicine strategy: 2014- 2023. WHO. 2013. http://www.who.int/traditional-complementary-integrative-medicine/en/. Accessed 20 Aug 2018.

Rayner J, Willis K, Pirotta M. What’s in a name: integrative medicine or simply good medical practice? Fam Pract. 2011. https://doi.org/10.1093/fampra/cmr032.

Leach MJ. Clinical decision making in complementary and alternative medicine. 1st ed. Victoria: Elsevier; 2010.

Frass M, Strassi R, Friehs H, Mullner M, Kundi M, Kaye A. Use and Acceptance of complementary and alternative medicine among the general population and medical personnel: a systematic review. Ochsner J. 2012;12(Suppl 1):45–56.PubMedPubMedCentral

Strattoni T, McGivern-Snofsky J. Toward a sociological understanding of complementary and alternative medicine use. J Altern Complement Med. 2007. https://doi.org/10.1089/acm.2007.7006.

Brosnan C. Epistemic cultures in complementary medicine: knowledge-making in university departments of osteopathy and Chinese medicine. Health Sociol Rev. 2016. https://doi.org/10.1080/14461242.2016.1171161.

Sarris J. Current challenges in appraising complementary medicine evidence. Med J Aust. 2012. https://doi.org/10.5694/mja11.10751.

Ernst E. Obstacles to research in complementary and alternative medicine. Med J Aust. 2003;179(Suppl 6):279–80.PubMed

Tabish SA. Complementary and Alternative healthcare: is it evidence-based? Int J Health Sci. 2008;2(Suppl 1):5–9.

10.

Bussières A, Terhorst L, Leach M, Stuber K, Evans R, Schneider M. Self-reported attitudes, skills and use of evidence-based practice among Canadian doctors of chiropractic: a national survey. J Can Chiropr Assoc. 2015;59(Suppl 4):332–48.PubMedPubMedCentral

11.

Leach MJ, Gillham D. Are complementary medicine practitioners implementing evidence based practice? Complement Ther Med. 2011. https://doi.org/10.1016/j.ctim.2011.04.002.

12.

Roecker CB, Lawrence DJ, Long CR, Vining RD. Attitudes toward evidence-based clinical practice among doctors of chiropractic with diplomate-level training in orthopedics. Chiropr Man Therap. 2013. https://doi.org/10.1186/2045-709X-21-43.

13.

Schneider MJ, Evans R, Haas M, Leach M, Hawk C, Long C. US chiropractors’ attitudes, skills and use of evidence-based practice: a cross-sectional national survey. Chiropr Man Therap. 2015. https://doi.org/10.1186/s12998-015-0060-0.

14.

Tilburt JC, Curlin FA, Kaptchuk TJ, et al. Alternative medicine research in clinical practice - a US national survey. Arch Intern Med. 2009. https://doi.org/10.1001/archinternmed.2009.49.

15.

Evans A: Complementary and alternative medicine (CAM): setting an Australian research agenda. In Proceedings of the 34th annual scientific meeting of the Clinical Oncological Society of Australia (COSA). 2007. http://www.cosa.org.au/media/1068/cosa_report_complementary-and-alternative-medicine-workshop_2007.pdf. Accessed 16 Oct 2016.

16.

Walker BF, Stomski NJ, French SD, Herbert JJ. A survey of Australian chiropractors’ attitudes and beliefs about evidence-based practice and their use of research literature and clinical practice guidelines. Chiropr Man Therap. 2013. https://doi.org/10.1186/20145-709X-21-44.

17.

Funk SG, Champagne MT, Wiese RA, Tornquist EM. BARRIERS: The barriers to research utilization scale. Appl Nurs Res. 1991. https://doi.org/10.1186/1748-5908-5-32.

18.

Leach MJ, Gillham DM. Evaluation of the evidence-based practice attitude and utilization survEy for complementary and alternative medicine practitioners. J Eval Clin Pract. 2008. https://doi.org/10.1111/j.1365-2753.2008.01046.x.

19.

Karimian Z, Sabbaghian Z, Saleh A, Sedghpour BS. Obstacles to undertaking research and their effect on research output: a survey of faculty members’ views. East Mediterr Health J. 2012;18(Suppl 11):1143–50.CrossRef

20.

Veziari Y, Leach M, Kumar S. Barriers to the conduct and application of research in complementary and alternative medicine: a systematic review. BMC Complement Altern Med. 2017. https://doi.org/10.1186/s12906-017-1660-0.

21.

Mcsharry J, Hynes L, Byrne M. Prioritising target behaviours for research in diabetes: using the nominal group technique to achieve consensus from key stakeholders. Res Involv Engagem. 2016. https://doi.org/10.1186/s40900-016-0028-9.

22.

Tongco M. Purposive sampling as a tool for informant selection. Ethnobot Res Appl. 2006. https://doi.org/10.17348/era.5.0.147-158.

23.

Boulkedid R, Abdoul H, Loustau M, ibony O, Alberti C. Using and reporting the Delphi method for selecting healthcare quality indicators: a systematic review. 2011. https://doi.org/10.1371/journal.pone.0020476.

24.

Dalkey N, Hemler O. An experimental application of the Delphi method to the use of experts. Manag Sci. 1963. https://doi.org/10.1287/mnsc.9.3.458.

25.

Steurer J. The Delphi method: an efficient procedure to generate knowledge. Skelet Radiol. 2011. https://doi.org/10.1007/s00256-011-1145-z.

26.

Mcmillan S, King M, Tully M. How to use the nominal group and Delphi techniques. Int J Clin Pharm. 2016. https://doi.org/10.1007/s11096-016-0257-x.

27.

Keeney S, Hasson F, Mckenna H. Consulting the oracle: ten lessons from using the Delphi technique in nursing research. J Adv Nurs. 2006. https://doi.org/10.1111/j.1365-2648.2006.03716.x.

28.

Giannarou L, Zervas E. Using Delphi technique to build consensus in practice. Int J Bus Sci Appl Manag. 2014;9:65–82.

29.

Skulmoski G, Hartmann F, Krahn J. The Delphi method for graduate research. J Inf Technol Educ. 2007. https://doi.org/10.28945/199.

30.

Twycross A, Chorney J, Mcgrath P, Finley G, Boliver D, Mifflin K. A Delphi study to identify indicators of poorly managed pain for paediatric postoperative and procedural pain/Une étude Delphi pour déterminer les indicateurs de douleur mal gérée après Une opération ou pendant Une intervention en pédiatrie. Pain Res Manag. 2013. https://doi.org/10.1155/2013/570478.

31.

Hsu C, Sandford BA. The Delphi technique: making sense of consensus. Pract Assess. 2007;12(Suppl 10):1–8.

32.

Hasson F, Keeney S, Mckenna H. Research guidelines for the Delphi survey technique. J Adv Nurs. 2000. https://doi.org/10.1046/j.1365-2648.2000.t01-1-01567.x.

33.

Powell C. The Delphi technique: myths and realities. J Adv Nurs. 2003. https://doi.org/10.1046/j.1365-2648.2003.02537.x.

34.

Slade SC, Dionne CE, Underwood M, Buchbinder R. Standardised method for reporting exercise programmes: protocol for a modified Delphi study. BMJ Open. 2014. https://doi.org/10.1136/bmjopen-2014-006682.

35.

Geisser ME, Alschuler KN, Hutchinson R. A Delphi study to establish important aspects of ethics review. J Empir Res Hum Res Ethics. 2011. https://doi.org/10.1525/jer.2011.6.1.21.

36.

Ludwig B. Predicting the future: have you considered using the Delphi methodology? J Ext. 1997;35:1–4.

37.

Helmy R, Zullig LL, Dunbar-Jacob J, Hughes DA, Vrijens B, Wilson IB. ESPACOMP medication adherence reporting guidelines (EMERGE): a reactive-Delphi study protocol. BMJ Open. 2017;7. https://doi.org/10.1136/bmjopen-2016-013496.

38.

Sedgwick P. Snowball sampling. BMJ. 2013. https://doi.org/10.1136/bmj.f7511.

39.

Noy C. Sampling knowledge: the hermeneutics of snowball sampling in qualitative research. Int J Soc Res Methodol. 2008. https://doi.org/10.1080/13645570701401305.

40.

Dillman LM, Smyth J, Christian LM. Internet, Phone, mail, and mixed-mode surveys: the tailored design method. 4th ed. Canada: Wiley; 2014.

41.

Sinha IP, Smyth RL, Williamson PR. Using the Delphi technique to determine which outcomes to measure in clinical trials: recommendations for the future based on a systematic review of existing studies. PLoS Med. 2011. https://doi.org/10.1371/journal.pmed.1000393.

42.

Keeney S, Mckenna H, Hasson F. The Delphi technique in nursing and Health Research. 1st ed. Oxford: Wiley-Blackwell; 2011.CrossRef

43.

Waclawski E. How I use it: survey monkey. Occup Med. 2012. https://doi.org/10.1093/occmed/kqs075.

44.

Banwell HA, Mackintosh S, Thewlis D, Landorf KB. Consensus-based recommendations of Australian podiatrists for the prescription of foot orthoses for symptomatic flexible pes planus in adults. J Foot Ankle Res. 2014. https://doi.org/10.1186/s13047-014-0049-2.

45.

Kleynen M, Braun SM, Bleijlevens MH, Lexis MA, Rasquin SM, Halfens J, et al. Using a Delphi technique to seek consensus regarding definitions, descriptions and classification of terms related to implicit and explicit forms of motor learning. PLoS One. 2014. https://doi.org/10.1371/journal.pone.0100227.

46.

Hicks C. Research methods for clinical therapists: applied project design and analysis. 5th ed. Edinburgh: Churchill Livingstone; 2009.

47.

Vernon W, Parry A, Potter M. Consensus obtained in a Delphi study of shoe wear pattern experiences amongst podiatrists. J Forensic Identif. 2003;53(Suppl 1):15–41.

48.

Day J, Bobeva M. A Generic toolkit for the successful Management of Delphi Studies. Electron J Bus Res Methodol. 2005.

49.

Alcantara J, Leach M. Chiropractic attitudes and utilization of evidence-based practice: the use of the EBASE questionnaire. Explore. 2015. https://doi.org/10.1016/j.explore.

50.

Scherer RW, Ugarte-Gil C, Schmucker C, Meerpohl JJ. Authors report lack of time as main reason for unpublished research presented at biomedical conferences: a systematic review. J Clin Epidemiol. 2015. https://doi.org/10.1016/j.jclinepi.2015.01.027.

51.

Bensoussan A, Lewith GT. Complementary medicine research in Australia: a strategy for the future. Med J Aust. 2004;181(Suppl 6):331–3.PubMed

52.

Ernst E. Funding research into complementary medicine: the situation in Britain. Complement Ther Med. 1999. https://doi.org/10.1016/S0965-2299(99)80011-9.

53.

Grace S. CAM practitioners in the Australian health workforce: an underutilized resource. BMC Complement Altern Med. 2012. https://doi.org/10.1186/1472-6882-12-205.

54.

Giordano J, Engebretson J, Garcia MK. Challenges to complementary and alternative medical research: focal issues influencing integration into a Cancer care model. Integr Cancer Ther. 2005. https://doi.org/10.1177/1534735405279179.

55.

Lewith G, Holgate S. CAM research and development. Complement Ther Nurs Midwifery. 2000. https://doi.org/10.1054/ctnm.1999.0440.

56.

Wardle J, Adams J. Are the CAM professions engaging in high-level health and medical research? Trends in publicly funded complementary medicine research grants in Australia. Complement Ther Med. 2013. https://doi.org/10.1016/j.ctim.2013.09.003.

57.

Hanson D, Allegrante JP, Sleet DA, Finch CF. Research alone is not sufficient to prevent sports injury. Br J Sports Med. 2014. https://doi.org/10.1136/bjsports-2012-091434.

58.

Jackson CL, Janamian T, Van WC, Dunbar JA. Implementation research - its importance and application in primary care: Moving evidence from theoretical to practical levels requires a collaborative effort. Med J Aust. 2014. https://doi.org/10.5694/mja14.00063.

59.

Carrington SJ, Uljarević M, Roberts A, et al. Knowledge acquisition and research evidence in autism: researcher and practitioner perspectives and engagement. Res Dev Disabil. 2016. https://doi.org/10.1016/j.ridd.2016.01.011.

60.

Aarons GA, Wells RS, Zagursky K, Fettes DL, Palinkas LA. 2009 implementing evidence-based practice in community mental health agencies: a multiple stakeholder analysis. Am J Public Health. 2009. https://doi.org/10.2105/AJPH.2009.161711.

61.

Courtney M, O'reilly M, Edwards H, Hassall S. Content validity of the ResCareQA: an Australian residential care quality assessment based on resident outcomes. Aust J Adv Nurs. 2011;28(Suppl 3):37–46.

62.

Dars S, Uden H, Kumar S, Banwell HA. When, why and how foot orthoses (FOs) should be prescribed for children with flexible pes planus: a Delphi survey of podiatrists. Peer J. 2018. https://doi.org/10.7717/peerj.4667.

63.

Sackman H. Delphi critique; expert opinion, forecasting, and group process. Massachusetts: Lexington books; 1975.

Title: The development of a survey instrument to measure the barriers to the conduct and application of research in complementary and alternative medicine: a Delphi study
Authors: Yasamin Veziari
Saravana Kumar
Matthew Leach
Publication date: 01-12-2018
Publisher: BioMed Central
Published in: BMC Complementary Medicine and Therapies / Issue 1/2018
Electronic ISSN: 2662-7671
DOI: https://doi.org/10.1186/s12906-018-2352-0

At a glance: The STEP trials

Springer Medicine

The development of a survey instrument to measure the barriers to the conduct and application of research in complementary and alternative medicine: a Delphi study

Abstract

Background

Methods

Results

Conclusion

At a glance: The STEP trials

Springer Medicine

Abstract

Background

Methods

Results

Conclusion

Please log in to get access to this content

Other articles of this Issue 1/2018

Hand-foot-mouth disease and use of steroids, intravenous immunoglobulin, and traditional Chinese herbs in a tertiary hospital in Shantou, China

Antiproliferative activities and phenolic acid content of water and ethanolic extracts of the powdered formula of Houttuynia cordata Thunb. fermented broth and Phyllanthus emblica Linn. fruit

Phytochemical analysis and antidiabetic potential of Elaeagnus umbellata (Thunb.) in streptozotocin-induced diabetic rats: pharmacological and computational approach

Effects of transcutaneous electrical nerve stimulation in the Management of Post-Injection Sciatic Pain in a non-randomized controlled clinical trial in Nnewi, Nigeria

Does Jacobson’s relaxation technique reduce consumption of psychotropic and analgesic drugs in cancer patients? A multicenter pre–post intervention study

Sotetsuflavone inhibits proliferation and induces apoptosis of A549 cells through ROS-mediated mitochondrial-dependent pathway