Skip to main content
Top
Published in: International Journal of Clinical Pharmacy 3/2016

Open Access 01-06-2016 | Review Paper

How to use the nominal group and Delphi techniques

Authors: Sara S. McMillan, Michelle King, Mary P. Tully

Published in: International Journal of Clinical Pharmacy | Issue 3/2016

Login to get access

Abstract

Introduction The Nominal Group Technique (NGT) and Delphi Technique are consensus methods used in research that is directed at problem-solving, idea-generation, or determining priorities. While consensus methods are commonly used in health services literature, few studies in pharmacy practice use these methods. This paper provides an overview of the NGT and Delphi technique, including the steps involved and the types of research questions best suited to each method, with examples from the pharmacy literature. Methodology The NGT entails face-to-face discussion in small groups, and provides a prompt result for researchers. The classic NGT involves four key stages: silent generation, round robin, clarification and voting (ranking). Variations have occurred in relation to generating ideas, and how ‘consensus’ is obtained from participants. The Delphi technique uses a multistage self-completed questionnaire with individual feedback, to determine consensus from a larger group of ‘experts.’ Questionnaires have been mailed, or more recently, e-mailed to participants. When to use The NGT has been used to explore consumer and stakeholder views, while the Delphi technique is commonly used to develop guidelines with health professionals. Method choice is influenced by various factors, including the research question, the perception of consensus required, and associated practicalities such as time and geography. Limitations The NGT requires participants to personally attend a meeting. This may prove difficult to organise and geography may limit attendance. The Delphi technique can take weeks or months to conclude, especially if multiple rounds are required, and may be complex for lay people to complete.
Literature
2.
go back to reference Delbecq AL, van de Ven AH, Gustafson DH. group techniques for program planning, a guide to nominal group and Delphi processes. Glenview, IL: Scott, Foresman and Company; 1975. Delbecq AL, van de Ven AH, Gustafson DH. group techniques for program planning, a guide to nominal group and Delphi processes. Glenview, IL: Scott, Foresman and Company; 1975.
3.
go back to reference Black N, Murphy M, Lamping D, McKee M, Sanderson C, Askham J, et al. Consensus development methods: a review of best practice in creating clinical guidelines. J Health Serv Res Policy. 1999;4(4):236–48.PubMed Black N, Murphy M, Lamping D, McKee M, Sanderson C, Askham J, et al. Consensus development methods: a review of best practice in creating clinical guidelines. J Health Serv Res Policy. 1999;4(4):236–48.PubMed
4.
go back to reference Tully MP, Cantrill JA. The use of the Nominal group technique in pharmacy practice research: processes and practicalities. J Soc Admin Pharm. 1997;14:93–104. Tully MP, Cantrill JA. The use of the Nominal group technique in pharmacy practice research: processes and practicalities. J Soc Admin Pharm. 1997;14:93–104.
5.
go back to reference McMillan SS, Kelly F, Sav A, Kendall E, King MA, Whitty JA, et al. Using the nominal group technique: how to analyse across multiple groups. Health Serv Outcomes Res Method. 2014;14:92–108.CrossRef McMillan SS, Kelly F, Sav A, Kendall E, King MA, Whitty JA, et al. Using the nominal group technique: how to analyse across multiple groups. Health Serv Outcomes Res Method. 2014;14:92–108.CrossRef
6.
go back to reference Claxton JD, Ritchie JRB, Zaichkowsky J. The nominal group technique: its potential for consumer research. J Consum Res. 1980;7:308–13.CrossRef Claxton JD, Ritchie JRB, Zaichkowsky J. The nominal group technique: its potential for consumer research. J Consum Res. 1980;7:308–13.CrossRef
7.
go back to reference Bissell P, Ward PR, Noyce PR. Appropriateness measurement: application to advice-giving in community pharmacies. Soc Sci Med. 2000;51(3):343–59.CrossRefPubMed Bissell P, Ward PR, Noyce PR. Appropriateness measurement: application to advice-giving in community pharmacies. Soc Sci Med. 2000;51(3):343–59.CrossRefPubMed
8.
go back to reference Potter M, Gordon S, Hamer P. The nominal group technique: a useful consensus methodology in physiotherapy research. N Z J Physiother. 2004;32:126–30. Potter M, Gordon S, Hamer P. The nominal group technique: a useful consensus methodology in physiotherapy research. N Z J Physiother. 2004;32:126–30.
9.
go back to reference Gallagher M, Hares T, Spencer J, Bradshaw C, Webb I. The nominal group technique: A research tool for general practice? Fam Pract. 1993;10:76–81.CrossRefPubMed Gallagher M, Hares T, Spencer J, Bradshaw C, Webb I. The nominal group technique: A research tool for general practice? Fam Pract. 1993;10:76–81.CrossRefPubMed
10.
go back to reference Dening KH, Jones L, Sampson EL. Preferences for end-of-life care: a nominal group study of people with dementia and their family carers. Palliat Med. 2012;27(5):409–17.CrossRefPubMed Dening KH, Jones L, Sampson EL. Preferences for end-of-life care: a nominal group study of people with dementia and their family carers. Palliat Med. 2012;27(5):409–17.CrossRefPubMed
11.
go back to reference Bradley F, Schafheutle EI, Willis SC, Noyce PR. Changes to supervision in community pharmacy: pharmacist and pharmacy support staff views. Health Soc Care Community. 2013;21(6):644–54.PubMed Bradley F, Schafheutle EI, Willis SC, Noyce PR. Changes to supervision in community pharmacy: pharmacist and pharmacy support staff views. Health Soc Care Community. 2013;21(6):644–54.PubMed
12.
go back to reference Hutchings HA, Rapport FL, Wright S, Doel MA, Wainwright P. Obtaining consensus regarding patient-centred professionalism in community pharmacy: nominal group work activity with professionals, stakeholders and members of the public. Int J Pharm Pract. 2010;18(3):149–58.PubMed Hutchings HA, Rapport FL, Wright S, Doel MA, Wainwright P. Obtaining consensus regarding patient-centred professionalism in community pharmacy: nominal group work activity with professionals, stakeholders and members of the public. Int J Pharm Pract. 2010;18(3):149–58.PubMed
13.
go back to reference Hiligsmann M, van Durme C, Geusens P, Dellaert BG, Dirksen CD, van der Weijden T, et al. Nominal group technique to select attributes for discrete choice experiments: an example for drug treatment choice in osteoporosis. Patient Prefer Adherence. 2013;7:133–9.CrossRefPubMedPubMedCentral Hiligsmann M, van Durme C, Geusens P, Dellaert BG, Dirksen CD, van der Weijden T, et al. Nominal group technique to select attributes for discrete choice experiments: an example for drug treatment choice in osteoporosis. Patient Prefer Adherence. 2013;7:133–9.CrossRefPubMedPubMedCentral
14.
go back to reference Allen J, Dyas J, Jones M. Building consensus in health care: a guide to using the nominal group technique. Br J Community Nurs. 2004;9(3):110–4.CrossRefPubMed Allen J, Dyas J, Jones M. Building consensus in health care: a guide to using the nominal group technique. Br J Community Nurs. 2004;9(3):110–4.CrossRefPubMed
15.
go back to reference Vella K, Goldfrad C, Rowan K, Bion J, Black N. Use of consensus development to establish national research priorities in critical care. BMJ. 2000;320(7240):976–80.CrossRefPubMedPubMedCentral Vella K, Goldfrad C, Rowan K, Bion J, Black N. Use of consensus development to establish national research priorities in critical care. BMJ. 2000;320(7240):976–80.CrossRefPubMedPubMedCentral
16.
go back to reference McMillan SS, Kelly F, Sav A, Kendall E, King MA, Whitty JA, et al. Consumers and carers versus pharmacy staff: Do their priorities for Australian Pharmacy Services align? Patient. 2015;8:411–22.CrossRefPubMed McMillan SS, Kelly F, Sav A, Kendall E, King MA, Whitty JA, et al. Consumers and carers versus pharmacy staff: Do their priorities for Australian Pharmacy Services align? Patient. 2015;8:411–22.CrossRefPubMed
17.
go back to reference Duncan E. The nature and use of consensus methodology in practice. In: Kielhofner G, editor. Research in occupational therapy: methods of inquiry for enhancing practice. Philidelphia: F.A. Davis; 2006. p. 401–10. Duncan E. The nature and use of consensus methodology in practice. In: Kielhofner G, editor. Research in occupational therapy: methods of inquiry for enhancing practice. Philidelphia: F.A. Davis; 2006. p. 401–10.
18.
go back to reference Harvey N, Holmes CA. Nominal group technique: an effective method for obtaining group consensus. Int J Nurs Pract. 2012;18(2):188–94.CrossRefPubMed Harvey N, Holmes CA. Nominal group technique: an effective method for obtaining group consensus. Int J Nurs Pract. 2012;18(2):188–94.CrossRefPubMed
19.
go back to reference Elliott T, Shewchuk R. Using the nominal group technique to identify the problems experienced by persons living with severe physical disabilities. J Clin Psychol Med S. 2002;9(2):65–76.CrossRef Elliott T, Shewchuk R. Using the nominal group technique to identify the problems experienced by persons living with severe physical disabilities. J Clin Psychol Med S. 2002;9(2):65–76.CrossRef
20.
go back to reference Miller D, Shewchuk R, Elliot TR, Richards S. Nominal group technique: a process for identifying diabetes self-care issues among patients and caregivers. Diabetes Educ 2000;26(2):305–10, 312, 314. Miller D, Shewchuk R, Elliot TR, Richards S. Nominal group technique: a process for identifying diabetes self-care issues among patients and caregivers. Diabetes Educ 2000;26(2):305–10, 312, 314.
21.
go back to reference Drennan V, Walters K, Lenihan P, Cohen S, Myerson S, Iliffe S, et al. Priorities in identifying unmet need in older people attending general practice: a nominal group technique study. Fam Pract. 2007;24(5):454–60.CrossRefPubMed Drennan V, Walters K, Lenihan P, Cohen S, Myerson S, Iliffe S, et al. Priorities in identifying unmet need in older people attending general practice: a nominal group technique study. Fam Pract. 2007;24(5):454–60.CrossRefPubMed
22.
go back to reference Bond CM, Watson MC. The development of evidence-based guidelines for over-the-counter treatment of vulvovaginal candidiasis. Pharm World Sci. 2003;25(4):177–81.CrossRefPubMed Bond CM, Watson MC. The development of evidence-based guidelines for over-the-counter treatment of vulvovaginal candidiasis. Pharm World Sci. 2003;25(4):177–81.CrossRefPubMed
23.
go back to reference Tully MP, Cantrill JA. Exploring the domains of appropriateness of drug therapy, using the nominal group technique. Pharm World Sci. 2002;24:128–31.CrossRefPubMed Tully MP, Cantrill JA. Exploring the domains of appropriateness of drug therapy, using the nominal group technique. Pharm World Sci. 2002;24:128–31.CrossRefPubMed
24.
go back to reference Gastelurrutia MA, Benrimoj SI, Castrillon CC, de Amezua MJ, Fernandez-Llimos F, Faus MJ. Facilitators for practice change in Spanish community pharmacy. Pharm World Sci. 2009;31(1):32–9.CrossRefPubMed Gastelurrutia MA, Benrimoj SI, Castrillon CC, de Amezua MJ, Fernandez-Llimos F, Faus MJ. Facilitators for practice change in Spanish community pharmacy. Pharm World Sci. 2009;31(1):32–9.CrossRefPubMed
25.
go back to reference Cameron AJ, MacKeigan LD. Development and pilot testing of a multiple mini-interview for admission to a pharmacy degree program. Am J Pharm Educ 2012;76(1):10.CrossRefPubMedPubMedCentral Cameron AJ, MacKeigan LD. Development and pilot testing of a multiple mini-interview for admission to a pharmacy degree program. Am J Pharm Educ 2012;76(1):10.CrossRefPubMedPubMedCentral
26.
go back to reference Linstone HA, Turoff M. The Delphi survey: method techniques and applications. Reading: Addison-Wesley; 1975. Linstone HA, Turoff M. The Delphi survey: method techniques and applications. Reading: Addison-Wesley; 1975.
27.
go back to reference Campbell SM, Cantrill JA. Consensus methods in prescribing research. J Clin Pharm Ther. 2001;26(1):5–14.CrossRefPubMed Campbell SM, Cantrill JA. Consensus methods in prescribing research. J Clin Pharm Ther. 2001;26(1):5–14.CrossRefPubMed
28.
go back to reference Chan A, Tan SH, Wong CM, Yap KY, Ko Y. Clinically significant drug–drug interactions between oral anticancer agents and nonanticancer agents: a Delphi survey of oncology pharmacists. Clin Ther. 2009;31(Pt 2):2379–86.CrossRefPubMed Chan A, Tan SH, Wong CM, Yap KY, Ko Y. Clinically significant drug–drug interactions between oral anticancer agents and nonanticancer agents: a Delphi survey of oncology pharmacists. Clin Ther. 2009;31(Pt 2):2379–86.CrossRefPubMed
30.
go back to reference Mackellar A, Ashcroft DM, Bell D, James DH, Marriott J. Identifying criteria for the assessment of pharmacy students’ communication skills with patients. Am J Pharm Educ. 2007;71(3):50.CrossRefPubMedPubMedCentral Mackellar A, Ashcroft DM, Bell D, James DH, Marriott J. Identifying criteria for the assessment of pharmacy students’ communication skills with patients. Am J Pharm Educ. 2007;71(3):50.CrossRefPubMedPubMedCentral
31.
go back to reference Campbell SM, Cantrill JA, Roberts R. Prescribing indicators for UK general practice: Delphi consultation study. BMJ. 2000;321:1–5.CrossRef Campbell SM, Cantrill JA, Roberts R. Prescribing indicators for UK general practice: Delphi consultation study. BMJ. 2000;321:1–5.CrossRef
32.
go back to reference Baysari MT, Westbrook JI, Egan B, Day RO. Identification of strategies to reduce computerized alerts in an electronic prescribing system using a Delphi approach. Stud Health Technol Inform. 2013;192:8–12.PubMed Baysari MT, Westbrook JI, Egan B, Day RO. Identification of strategies to reduce computerized alerts in an electronic prescribing system using a Delphi approach. Stud Health Technol Inform. 2013;192:8–12.PubMed
33.
go back to reference Cantrill JA, Sibbald B, Buetow S. Indicators of the appropriateness of long term prescribing in general practice in the United Kingdom: consensus development, face and content validity, feasibility and reliability. Qual Health Care. 1998;7:130–5.CrossRefPubMedPubMedCentral Cantrill JA, Sibbald B, Buetow S. Indicators of the appropriateness of long term prescribing in general practice in the United Kingdom: consensus development, face and content validity, feasibility and reliability. Qual Health Care. 1998;7:130–5.CrossRefPubMedPubMedCentral
34.
go back to reference Aljamal M, Ashcroft DM, Tully MP. Development of indicators to assess the quality of medicines reconciliation at hospital admission: an e-Delphi study. Int J Pharm Pract 2016 (in press). Aljamal M, Ashcroft DM, Tully MP. Development of indicators to assess the quality of medicines reconciliation at hospital admission: an e-Delphi study. Int J Pharm Pract 2016 (in press).
35.
go back to reference Aronson BD, Janke KK, Traynor AP. Investigating student pharmacist perceptions of professional engagement using a modified Delphi process. Am J Pharm Educ. 2012;76(7):125.CrossRefPubMedPubMedCentral Aronson BD, Janke KK, Traynor AP. Investigating student pharmacist perceptions of professional engagement using a modified Delphi process. Am J Pharm Educ. 2012;76(7):125.CrossRefPubMedPubMedCentral
36.
go back to reference Cassar Flores A, Marshall S, Cordina M. Use of the Delphi technique to determine safety features to be included in a neonatal and paediatric prescription chart. Int J Clin Pharm. 2014;36(6):1179–89.CrossRefPubMed Cassar Flores A, Marshall S, Cordina M. Use of the Delphi technique to determine safety features to be included in a neonatal and paediatric prescription chart. Int J Clin Pharm. 2014;36(6):1179–89.CrossRefPubMed
37.
go back to reference McDermott JH, Caiola SM, Kuhn KF, Stritter FT, Beza J. A delphi survey to identify the components of a community pharmacy clerkship. Am J Pharm Educ. 1995;59(4):334–41. McDermott JH, Caiola SM, Kuhn KF, Stritter FT, Beza J. A delphi survey to identify the components of a community pharmacy clerkship. Am J Pharm Educ. 1995;59(4):334–41.
39.
go back to reference McBride AJ, Pates R, Ramadan R, McGowan C. Delphi survey of experts’ opinions on strategies used by community pharmacists to reduce over-the-counter drug misuse. Addiction. 2003;98(4):487–97.CrossRefPubMed McBride AJ, Pates R, Ramadan R, McGowan C. Delphi survey of experts’ opinions on strategies used by community pharmacists to reduce over-the-counter drug misuse. Addiction. 2003;98(4):487–97.CrossRefPubMed
40.
go back to reference Avery AJ, Savelyich BSP, Sheikh A, Cantrill J, Morris CJ, Fernando B, et al. Identifying and establishing consensus on the most important safety features of GP computer systems: e-Delphi study. Inform Prim Care. 2005;13:3–11.PubMed Avery AJ, Savelyich BSP, Sheikh A, Cantrill J, Morris CJ, Fernando B, et al. Identifying and establishing consensus on the most important safety features of GP computer systems: e-Delphi study. Inform Prim Care. 2005;13:3–11.PubMed
41.
go back to reference Plumridge RJ. Forecast of the future of hospital pharmacy in Australia. Am J Hosp Pharm. 1981;38(10):1469–72.PubMed Plumridge RJ. Forecast of the future of hospital pharmacy in Australia. Am J Hosp Pharm. 1981;38(10):1469–72.PubMed
42.
go back to reference Sinha IP, Smyth RL, Williamson PR. Using the Delphi technique to determine which outcomes to measure in clinical trials: recommendations for the future based on a systematic review of existing studies. PLoS Med. 2011;8(1):e1000393.CrossRefPubMedPubMedCentral Sinha IP, Smyth RL, Williamson PR. Using the Delphi technique to determine which outcomes to measure in clinical trials: recommendations for the future based on a systematic review of existing studies. PLoS Med. 2011;8(1):e1000393.CrossRefPubMedPubMedCentral
43.
go back to reference Ahmed R, McCaffery KJ, Aslani P. Development and validation of a question prompt list for parents of children with attention-deficit/hyperactivity disorder: a Delphi study. Health Expect 2015 Jan 19. doi:10.1111/hex.12341. Ahmed R, McCaffery KJ, Aslani P. Development and validation of a question prompt list for parents of children with attention-deficit/hyperactivity disorder: a Delphi study. Health Expect 2015 Jan 19. doi:10.​1111/​hex.​12341.
44.
go back to reference Mease PJ, Arnold LM, Crofford LJ, Williams DA, Russell IJ, Humphrey L, et al. Identifying the clinical domains of fibromyalgia: contributions from clinician and patient Delphi exercises. Arthritis Rheum. 2008;59(7):952–60.CrossRefPubMed Mease PJ, Arnold LM, Crofford LJ, Williams DA, Russell IJ, Humphrey L, et al. Identifying the clinical domains of fibromyalgia: contributions from clinician and patient Delphi exercises. Arthritis Rheum. 2008;59(7):952–60.CrossRefPubMed
Metadata
Title
How to use the nominal group and Delphi techniques
Authors
Sara S. McMillan
Michelle King
Mary P. Tully
Publication date
01-06-2016
Publisher
Springer International Publishing
Published in
International Journal of Clinical Pharmacy / Issue 3/2016
Print ISSN: 2210-7703
Electronic ISSN: 2210-7711
DOI
https://doi.org/10.1007/s11096-016-0257-x

Other articles of this Issue 3/2016

International Journal of Clinical Pharmacy 3/2016 Go to the issue
Live Webinar | 27-06-2024 | 18:00 (CEST)

Keynote webinar | Spotlight on medication adherence

Live: Thursday 27th June 2024, 18:00-19:30 (CEST)

WHO estimates that half of all patients worldwide are non-adherent to their prescribed medication. The consequences of poor adherence can be catastrophic, on both the individual and population level.

Join our expert panel to discover why you need to understand the drivers of non-adherence in your patients, and how you can optimize medication adherence in your clinics to drastically improve patient outcomes.

Prof. Kevin Dolgin
Prof. Florian Limbourg
Prof. Anoop Chauhan
Developed by: Springer Medicine
Obesity Clinical Trial Summary

At a glance: The STEP trials

A round-up of the STEP phase 3 clinical trials evaluating semaglutide for weight loss in people with overweight or obesity.

Developed by: Springer Medicine

Highlights from the ACC 2024 Congress

Year in Review: Pediatric cardiology

Watch Dr. Anne Marie Valente present the last year's highlights in pediatric and congenital heart disease in the official ACC.24 Year in Review session.

Year in Review: Pulmonary vascular disease

The last year's highlights in pulmonary vascular disease are presented by Dr. Jane Leopold in this official video from ACC.24.

Year in Review: Valvular heart disease

Watch Prof. William Zoghbi present the last year's highlights in valvular heart disease from the official ACC.24 Year in Review session.

Year in Review: Heart failure and cardiomyopathies

Watch this official video from ACC.24. Dr. Biykem Bozkurt discusses last year's major advances in heart failure and cardiomyopathies.