Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2016

Open Access 01-12-2016 | Research article

Adapting the nominal group technique for priority setting of evidence-practice gaps in implementation science

Authors: Nicole M. Rankin, Deborah McGregor, Phyllis N. Butow, Kate White, Jane L. Phillips, Jane M. Young, Sallie A. Pearson, Sarah York, Tim Shaw

Published in: BMC Medical Research Methodology | Issue 1/2016

Login to get access

Abstract

Background

There are a variety of methods for priority setting in health research but few studies have addressed how to prioritise the gaps that exist between research evidence and clinical practice. This study aimed to build a suite of robust, evidence based techniques and tools for use in implementation science projects. We applied the priority setting methodology in lung cancer care as an example.

Methods

We reviewed existing techniques and tools for priority setting in health research and the criteria used to prioritise items. An expert interdisciplinary consensus group comprised of health service, cancer and nursing researchers iteratively reviewed and adapted the techniques and tools. We tested these on evidence-practice gaps identified for lung cancer. The tools were pilot tested and finalised. A brief process evaluation was conducted.

Results

We based our priority setting on the Nominal Group Technique (NGT). The adapted tools included a matrix for individuals to privately rate priority gaps; the same matrix was used for group discussion and reaching consensus. An investment exercise was used to validate allocation of priorities across the gaps. We describe the NGT process, criteria and tool adaptations and process evaluation results.

Conclusions

The modified NGT process, criteria and tools contribute to building a suite of methods that can be applied in prioritising evidence-practice gaps. These methods could be adapted for other health settings within the broader context of implementation science projects.
Appendix
Available only for authorised users
Literature
2.
go back to reference Campbell S. Deliberative Priority Setting: a CIHR KT module; Ottawa, ON. Canadian Institutes of Health Research;2010. Campbell S. Deliberative Priority Setting: a CIHR KT module; Ottawa, ON. Canadian Institutes of Health Research;2010.
3.
go back to reference Smith N, Mitton C, Cornelissen E, Gibson J, Peacock S. Using evaluation theory in priority setting and resource allocation. J Health Organ Manag. 2012;26(4-5):655–71.CrossRefPubMed Smith N, Mitton C, Cornelissen E, Gibson J, Peacock S. Using evaluation theory in priority setting and resource allocation. J Health Organ Manag. 2012;26(4-5):655–71.CrossRefPubMed
4.
go back to reference Boivin A, Lehoux P, Lacombe R, Burgers J, Grol R. Involving patients in setting priorities for healthcare improvement: a cluster randomized trial. Implement Sci. 2014;9:24.CrossRefPubMedPubMedCentral Boivin A, Lehoux P, Lacombe R, Burgers J, Grol R. Involving patients in setting priorities for healthcare improvement: a cluster randomized trial. Implement Sci. 2014;9:24.CrossRefPubMedPubMedCentral
5.
go back to reference Boivin A, Lehoux P, Lacombe R, Lacasse A, Burgers J, Grol R. Target for improvement: a cluster randomised trial of public involvement in quality-indicator prioritisation (intervention development and study protocol). Implement Sci. 2011;6:45.CrossRefPubMedPubMedCentral Boivin A, Lehoux P, Lacombe R, Lacasse A, Burgers J, Grol R. Target for improvement: a cluster randomised trial of public involvement in quality-indicator prioritisation (intervention development and study protocol). Implement Sci. 2011;6:45.CrossRefPubMedPubMedCentral
6.
go back to reference Lomas J, Fulop N, Gagnon D, Allen P. On being a good listener: setting priorities for applied health services research. Milbank Q. 2003;81(3):363–88.CrossRefPubMedPubMedCentral Lomas J, Fulop N, Gagnon D, Allen P. On being a good listener: setting priorities for applied health services research. Milbank Q. 2003;81(3):363–88.CrossRefPubMedPubMedCentral
7.
go back to reference Delbecq AL, Van de Ven AH, Gustafson DH. Group Techniques for Program Planning: a Guide to Nominal Group and Delphi Processes. Dallas: Scott-Foresman; 1975. Delbecq AL, Van de Ven AH, Gustafson DH. Group Techniques for Program Planning: a Guide to Nominal Group and Delphi Processes. Dallas: Scott-Foresman; 1975.
8.
go back to reference Harvey N, Holmes CA. Nominal group technique: An effective method for obtaining group consensus. Int J Nurs Pract. 2012;18:188–94.CrossRefPubMed Harvey N, Holmes CA. Nominal group technique: An effective method for obtaining group consensus. Int J Nurs Pract. 2012;18:188–94.CrossRefPubMed
11.
go back to reference Clinton-McHarg T, Paul C, Sanson-Fisher R, D’Este C, Williamson A. Determining research priorities for young people with haematological cancer: a value-weighting approach. Eur J Cancer. 2010;46(18):3263–70.CrossRefPubMed Clinton-McHarg T, Paul C, Sanson-Fisher R, D’Este C, Williamson A. Determining research priorities for young people with haematological cancer: a value-weighting approach. Eur J Cancer. 2010;46(18):3263–70.CrossRefPubMed
12.
go back to reference Paul C, Sanson-Fisher R, Douglas H, Clinton-McHarg T, Williamson A. Cutting the research pie: a value-weighting approach to explore perceptions about psychosocial research priorities for adults with haematological cancers. Eur J Cancer Care. 2010;20(3):345–53.CrossRef Paul C, Sanson-Fisher R, Douglas H, Clinton-McHarg T, Williamson A. Cutting the research pie: a value-weighting approach to explore perceptions about psychosocial research priorities for adults with haematological cancers. Eur J Cancer Care. 2010;20(3):345–53.CrossRef
13.
go back to reference Bajracharya SM. An assessment of the perceived barriers and strategies to promoting early detection of colorectal cancer: a practitioners’ perspective. Int Q Community Health Educ. 2006;26(1):23–44.CrossRefPubMed Bajracharya SM. An assessment of the perceived barriers and strategies to promoting early detection of colorectal cancer: a practitioners’ perspective. Int Q Community Health Educ. 2006;26(1):23–44.CrossRefPubMed
14.
16.
go back to reference Esmail LC, Roth J, Rangarao S, et al. Getting our priorities straight: a novel framework for stakeholder-informed prioritization of cancer genomics research. Genet Med. 2013;15(2):115–22.CrossRefPubMed Esmail LC, Roth J, Rangarao S, et al. Getting our priorities straight: a novel framework for stakeholder-informed prioritization of cancer genomics research. Genet Med. 2013;15(2):115–22.CrossRefPubMed
17.
go back to reference Corner J, Wright D, Hopkinson J, Gunaratnam Y, McDonald JW, Foster C. The research priorities of patients attending UK cancer treatment centres: findings from a modified nominal group study. Br J Cancer. 2007;96(6):875–81.CrossRefPubMedPubMedCentral Corner J, Wright D, Hopkinson J, Gunaratnam Y, McDonald JW, Foster C. The research priorities of patients attending UK cancer treatment centres: findings from a modified nominal group study. Br J Cancer. 2007;96(6):875–81.CrossRefPubMedPubMedCentral
18.
19.
go back to reference Rankin N, Shaw T, McGregor D et al. The relevance of implementation science to psycho-oncology: Evidence practice gaps in lung cancer. Psycho-Oncology. 2013;22(S3): 46. Rankin N, Shaw T, McGregor D et al. The relevance of implementation science to psycho-oncology: Evidence practice gaps in lung cancer. Psycho-Oncology. 2013;22(S3): 46.
20.
go back to reference Grol R, Wensing M, Eccles M, Davis D. Improving patient care: The implementation of change in health care. West Sussex, UK: Wiley Blackwell; 2013. Grol R, Wensing M, Eccles M, Davis D. Improving patient care: The implementation of change in health care. West Sussex, UK: Wiley Blackwell; 2013.
21.
go back to reference Graham ID, Logan J, Harrison MB, et al. Lost in Knowledge Translation: Time for a Map? J Contin Educ Health Prof. 2006;26:13–24.CrossRefPubMed Graham ID, Logan J, Harrison MB, et al. Lost in Knowledge Translation: Time for a Map? J Contin Educ Health Prof. 2006;26:13–24.CrossRefPubMed
22.
go back to reference Smith N, Mitton C, Peacock S, Cornelissen E, MacLeod S. Identifying research priorities for health care priority setting: a collaborative effort between managers and researchers. BMC Health Serv Res. 2009;9:9. doi:10.1186/1472-6963-9-165.CrossRef Smith N, Mitton C, Peacock S, Cornelissen E, MacLeod S. Identifying research priorities for health care priority setting: a collaborative effort between managers and researchers. BMC Health Serv Res. 2009;9:9. doi:10.​1186/​1472-6963-9-165.CrossRef
23.
go back to reference McGregor D, Rankin N, Butow P, et al. Closing evidence-practice gaps in lung cancer: Results from priority setting in the clinical context. Asia Pac J Clin Oncol. 2016. doi:10.1111/ajco.12499.PubMed McGregor D, Rankin N, Butow P, et al. Closing evidence-practice gaps in lung cancer: Results from priority setting in the clinical context. Asia Pac J Clin Oncol. 2016. doi:10.​1111/​ajco.​12499.PubMed
24.
go back to reference Berra S, Sanchez E, Pons JMV, Tebe C, Alonso J, Aymerich M. Setting priorities in clinical and health services research: Properties of an adapted and updated method. Int J Technol Assess Health Care. 2010;26(2):217–24. doi:10.1017/s0266462310000012.CrossRefPubMed Berra S, Sanchez E, Pons JMV, Tebe C, Alonso J, Aymerich M. Setting priorities in clinical and health services research: Properties of an adapted and updated method. Int J Technol Assess Health Care. 2010;26(2):217–24. doi:10.​1017/​s026646231000001​2.CrossRefPubMed
25.
go back to reference Ghaffar A. Setting research priorities by applying the combined approach matrix. Indian J Med Res. 2009;129(4):368–75.PubMed Ghaffar A. Setting research priorities by applying the combined approach matrix. Indian J Med Res. 2009;129(4):368–75.PubMed
26.
go back to reference Global Forum for Health Research. The 3D Combined Approach Matrix: An improved tool for setting priorities in research for health. Geneva, SUI: Global Forum for Health Research; 2009. Global Forum for Health Research. The 3D Combined Approach Matrix: An improved tool for setting priorities in research for health. Geneva, SUI: Global Forum for Health Research; 2009.
27.
go back to reference Public Health Ontario, Health Nexus Canada. Priority Setting – Four Methods for Getting to What’s Important. Ottawa, ON: Ontario Health Promotion E-Bulletin; 2010. Public Health Ontario, Health Nexus Canada. Priority Setting – Four Methods for Getting to What’s Important. Ottawa, ON: Ontario Health Promotion E-Bulletin; 2010.
28.
go back to reference Potter M, Gordon S, Hamer P. The Nominal Group Technique: A useful consensus methodology in physiotherapy research. N Z J Physiother. 2004;32(3):126–30. Potter M, Gordon S, Hamer P. The Nominal Group Technique: A useful consensus methodology in physiotherapy research. N Z J Physiother. 2004;32(3):126–30.
29.
go back to reference Institute of Medicine. Crossing the Quality Chasm: A New Health System for the TwentyfirstCentury. Washington DC. National Academies Press; 2001. Institute of Medicine. Crossing the Quality Chasm: A New Health System for the TwentyfirstCentury. Washington DC. National Academies Press; 2001.
30.
go back to reference Green LW, Kreuter MW. Health Program Planning: An Educational and Ecological Approach. 4th Edition ed. McGraw-Hill Higher Education: New York; 2005. Green LW, Kreuter MW. Health Program Planning: An Educational and Ecological Approach. 4th Edition ed. McGraw-Hill Higher Education: New York; 2005.
32.
go back to reference Hermens R, Ouwens M, Vonk-Okhuijsen SY, et al. Development of quality indicators for diagnosis and treatment of patients with non-small cell lung cancer: A first step toward implementing a multidisciplinary, evidence-based guideline. Lung Cancer. 2006;54(1):117–24. doi:10.1016/j.lungcan.2006.07.001.CrossRefPubMed Hermens R, Ouwens M, Vonk-Okhuijsen SY, et al. Development of quality indicators for diagnosis and treatment of patients with non-small cell lung cancer: A first step toward implementing a multidisciplinary, evidence-based guideline. Lung Cancer. 2006;54(1):117–24. doi:10.​1016/​j.​lungcan.​2006.​07.​001.CrossRefPubMed
34.
go back to reference Shaw T, York S, Rankin NM, McGregor D, Hawkey A. Success Factors in Coordinated Cancer Care. A report commissioned by the Cancer Institute NSW. Sydney: The University of Sydney; 2014. Shaw T, York S, Rankin NM, McGregor D, Hawkey A. Success Factors in Coordinated Cancer Care. A report commissioned by the Cancer Institute NSW. Sydney: The University of Sydney; 2014.
Metadata
Title
Adapting the nominal group technique for priority setting of evidence-practice gaps in implementation science
Authors
Nicole M. Rankin
Deborah McGregor
Phyllis N. Butow
Kate White
Jane L. Phillips
Jane M. Young
Sallie A. Pearson
Sarah York
Tim Shaw
Publication date
01-12-2016
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2016
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/s12874-016-0210-7

Other articles of this Issue 1/2016

BMC Medical Research Methodology 1/2016 Go to the issue