Skip to main content
Top
Published in: BMC Primary Care 1/2018

Open Access 01-12-2018 | Research article

Using a modified nominal group technique to develop general practice

Authors: Elisabeth Søndergaard, Ruth K. Ertmann, Susanne Reventlow, Kirsten Lykke

Published in: BMC Primary Care | Issue 1/2018

Login to get access

Abstract

Background

There are few areas of health care where sufficient research-based evidence exists and primary health care is no exception. In the absence of such evidence, the development of assisted support must be based on the opinions and experience of professionals with knowledge of the relevant field. The purpose of this research project is to explore how the nominal group technique can be used to establish consensus by analysing how it supported the development of structured, knowledge-based, electronic health records for preventive child health examinations in Danish general practice.

Methods

We convened an expert panel of five general practitioners with a special interest in the preventive child health examinations. We introduced the panel to the nominal group technique, a well-established, structured, multistep, facilitated, group meeting technique used to generate consensus. The panel used the technique to agree on the key clinical and socioeconomic themes to include in new electronic records for the seven preventive child health examinations in Denmark. The panel met three times over a four-month period between 2013 and 2014 and their meetings lasted between two-and-a-half and five hours.

Results

1) The structured and stepwise process of the nominal group technique supported our expert panel’s focus as well as their equal opportunities to speak. 2) The method’s flexibility enabled participants to work as a group and in pairs to discuss and refine thematic classifications. 3) Serial meetings supported continual evaluation, critical reflection, and knowledge searches, enabling our panel to produce a template that could be adapted for all seven preventive child health examinations.

Conclusion

The nominal group technique proved to be a useful method for reaching consensus by identifying key quality markers for use in daily clinical practice. Our study focused on the development of content and a layout for systematic, knowledge-based, electronic health records. We recommend the method as a suitable working tool for dealing with complex questions in general practice or similar settings, and we present and discuss modifications to the original model.
Footnotes
1
Creating electronic health records is part of DanChild, a research and quality development project, with the goal to develop a new national birth cohort with potential to nest randomised trials in general practice. The cohort will support the development of knowledge about child health which is highly relevant to the work in general practice.
 
Literature
1.
go back to reference Chassin M. How do we decide whether an investigation or procedure is appropriate? In: Hopkins A, editor. Appropriate investigation and treatment in clinical practice. London: Royal College of Physicians; 1989. p. 21–9. Chassin M. How do we decide whether an investigation or procedure is appropriate? In: Hopkins A, editor. Appropriate investigation and treatment in clinical practice. London: Royal College of Physicians; 1989. p. 21–9.
2.
go back to reference Campbell SM, Braspenning J, Hutchinson A, Marshall MN. Research methods used in developing and applying quality indicators in primary care. BMJ. 2003;326(7393):816–9.CrossRefPubMedPubMedCentral Campbell SM, Braspenning J, Hutchinson A, Marshall MN. Research methods used in developing and applying quality indicators in primary care. BMJ. 2003;326(7393):816–9.CrossRefPubMedPubMedCentral
3.
go back to reference Mann T. Clinical guidelines : using clinical guidelines to improve patient care within the NHS. London: Department of Health; 1996. Mann T. Clinical guidelines : using clinical guidelines to improve patient care within the NHS. London: Department of Health; 1996.
4.
go back to reference Michelsen S, Kastanje M, Flachs EM, Søndergaard G, Biering-Sørensen S, Madsen M, AMN A. Evaluation of the preventive child consultations in general practice. Copenhagen: Danish National Board of health, Statens Institut for Folkesundhed, Syddansk Universitet; 2011. Michelsen S, Kastanje M, Flachs EM, Søndergaard G, Biering-Sørensen S, Madsen M, AMN A. Evaluation of the preventive child consultations in general practice. Copenhagen: Danish National Board of health, Statens Institut for Folkesundhed, Syddansk Universitet; 2011.
5.
go back to reference Campbell SM, Ludt S, Van Lieshout J, Boffin N, Wensing M, Petek D, et al. Quality indicators for the prevention and management of cardiovascular disease in primary care in nine European countries. Eur J cardiovasc Prev Rehabil. 2008;15(5):509–15.CrossRefPubMed Campbell SM, Ludt S, Van Lieshout J, Boffin N, Wensing M, Petek D, et al. Quality indicators for the prevention and management of cardiovascular disease in primary care in nine European countries. Eur J cardiovasc Prev Rehabil. 2008;15(5):509–15.CrossRefPubMed
6.
go back to reference Schull MJ, Guttmann A, Leaver CA, Vermeulen M, Hatcher CM, Rowe BH, et al. Prioritizing performance measurement for emergency department care: consensus on evidence-based quality of care indicators. CJEM. 2011;13(5):300–9. E28–43CrossRefPubMed Schull MJ, Guttmann A, Leaver CA, Vermeulen M, Hatcher CM, Rowe BH, et al. Prioritizing performance measurement for emergency department care: consensus on evidence-based quality of care indicators. CJEM. 2011;13(5):300–9. E28–43CrossRefPubMed
7.
go back to reference Malin JL, Asch SM, Kerr EA, McGlynn EA. Evaluating the quality of cancer care: development of cancer quality indicators for a global quality assessment tool. Cancer. 2000;88(3):701–7.CrossRefPubMed Malin JL, Asch SM, Kerr EA, McGlynn EA. Evaluating the quality of cancer care: development of cancer quality indicators for a global quality assessment tool. Cancer. 2000;88(3):701–7.CrossRefPubMed
8.
go back to reference Gill PJ, Hewitson P, Peile E, Harnden A. Prioritizing areas for quality marker development in children in UK general practice: extending the use of the nominal group technique. Fam Pract. 2012;29(5):567–75.CrossRefPubMed Gill PJ, Hewitson P, Peile E, Harnden A. Prioritizing areas for quality marker development in children in UK general practice: extending the use of the nominal group technique. Fam Pract. 2012;29(5):567–75.CrossRefPubMed
9.
go back to reference Giannini EH, Ruperto N, Ravelli A, Lovell DJ, Felson DT, Martini A. Preliminary definition of improvement in juvenile arthritis. Arthritis Rheum. 1997;40(7):1202–9.CrossRefPubMed Giannini EH, Ruperto N, Ravelli A, Lovell DJ, Felson DT, Martini A. Preliminary definition of improvement in juvenile arthritis. Arthritis Rheum. 1997;40(7):1202–9.CrossRefPubMed
10.
go back to reference Wang CJ, McGlynn EA, Brook RH, Leonard CH, Piecuch RE, Hsueh SI, et al. Quality-of-care indicators for the neurodevelopmental follow-up of very low birth weight children: results of an expert panel process. Pediatrics. 2006;117(6):2080–92.CrossRefPubMed Wang CJ, McGlynn EA, Brook RH, Leonard CH, Piecuch RE, Hsueh SI, et al. Quality-of-care indicators for the neurodevelopmental follow-up of very low birth weight children: results of an expert panel process. Pediatrics. 2006;117(6):2080–92.CrossRefPubMed
12.
go back to reference Hasson F, Keeney S, McKenna H. Research guidelines for the Delphi survey technique. J Adv Nurs. 2000;32(4):1008–15.PubMed Hasson F, Keeney S, McKenna H. Research guidelines for the Delphi survey technique. J Adv Nurs. 2000;32(4):1008–15.PubMed
13.
go back to reference Wortman PM, Vinokur A, Sechrest L. Do consensus conferences work? A process evaluation of the NIH consensus development program. J Health Polit Policy Law. 1988;13(3):469–98.CrossRefPubMed Wortman PM, Vinokur A, Sechrest L. Do consensus conferences work? A process evaluation of the NIH consensus development program. J Health Polit Policy Law. 1988;13(3):469–98.CrossRefPubMed
14.
15.
16.
go back to reference Stolper E, van Leeuwen Y, van Royen P, van de Wiel M, van Bokhoven M, Houben P, et al. Establishing a European research agenda on 'gut feelings' in general practice. A qualitative study using the nominal group technique. Eur J Gen Pract. 2010;16(2):75–9.CrossRefPubMed Stolper E, van Leeuwen Y, van Royen P, van de Wiel M, van Bokhoven M, Houben P, et al. Establishing a European research agenda on 'gut feelings' in general practice. A qualitative study using the nominal group technique. Eur J Gen Pract. 2010;16(2):75–9.CrossRefPubMed
17.
go back to reference Shipman C, Gysels M, White P, Worth A, Murray SA, Barclay S, et al. Improving generalist end of life care: national consultation with practitioners, commissioners, academics, and service user groups. BMJ. 2008;337:a1720.CrossRefPubMedPubMedCentral Shipman C, Gysels M, White P, Worth A, Murray SA, Barclay S, et al. Improving generalist end of life care: national consultation with practitioners, commissioners, academics, and service user groups. BMJ. 2008;337:a1720.CrossRefPubMedPubMedCentral
18.
go back to reference Zhao Y, Chen R, Wang B, Wu T, Huang Y, Guo A. General practice on-the-job training in Chinese urban community: a qualitative study on needs and challenges. PLoS One. 2014;9(4):e94301.CrossRefPubMedPubMedCentral Zhao Y, Chen R, Wang B, Wu T, Huang Y, Guo A. General practice on-the-job training in Chinese urban community: a qualitative study on needs and challenges. PLoS One. 2014;9(4):e94301.CrossRefPubMedPubMedCentral
19.
go back to reference Laughlin T, Wetmore S, Allen T, Brailovsky C, Crichton T, Bethune C, et al. Defining competency-based evaluation objectives in family medicine: communication skills. Can Fam Physician. 2012;58(4):217–24. Laughlin T, Wetmore S, Allen T, Brailovsky C, Crichton T, Bethune C, et al. Defining competency-based evaluation objectives in family medicine: communication skills. Can Fam Physician. 2012;58(4):217–24.
20.
go back to reference Gannik D. Kvalitet i almen praksis: Praktiserende lægers syn på fagets essens, vilkår og udvikling i Viborg Amt. Forskningsenheden for Almen Praksis i København; 2004. Gannik D. Kvalitet i almen praksis: Praktiserende lægers syn på fagets essens, vilkår og udvikling i Viborg Amt. Forskningsenheden for Almen Praksis i København; 2004.
21.
go back to reference Burgers JS, Grol RP, Zaat JO, Spies TH, van der Bij AK, Mokkink HG. Characteristics of effective clinical guidelines for general practice. Br J Gen Pract. 2003;53(486):15–9.PubMedPubMedCentral Burgers JS, Grol RP, Zaat JO, Spies TH, van der Bij AK, Mokkink HG. Characteristics of effective clinical guidelines for general practice. Br J Gen Pract. 2003;53(486):15–9.PubMedPubMedCentral
22.
go back to reference Humphrey-Murto S, Varpio L, Gonsalves C, Wood TJ. Using consensus group methods such as Delphi and nominal group in medical education research. Med Teach. 2017;39(1):14–9.CrossRefPubMed Humphrey-Murto S, Varpio L, Gonsalves C, Wood TJ. Using consensus group methods such as Delphi and nominal group in medical education research. Med Teach. 2017;39(1):14–9.CrossRefPubMed
23.
go back to reference Gallagher M, Hares T, Spencer J, Bradshaw C, Webb I. The nominal group technique: a research tool for general practice? Fam Pract. 1993;10(1):76–81.CrossRefPubMed Gallagher M, Hares T, Spencer J, Bradshaw C, Webb I. The nominal group technique: a research tool for general practice? Fam Pract. 1993;10(1):76–81.CrossRefPubMed
24.
go back to reference Vejledning om forebyggende sundhedsydelser til børn og unge. National Board of health: Copenhagen, Denmark; 2011. Vejledning om forebyggende sundhedsydelser til børn og unge. National Board of health: Copenhagen, Denmark; 2011.
25.
go back to reference Lykke K, Christensen P, Reventlow S. The consultation as an interpretive dialogue about the child's health needs. Fam Pract. 2011;28(4):430–6.CrossRefPubMed Lykke K, Christensen P, Reventlow S. The consultation as an interpretive dialogue about the child's health needs. Fam Pract. 2011;28(4):430–6.CrossRefPubMed
26.
go back to reference Lykke K, Christensen P, Reventlow S. GPs’ strategies in exploring the preschool child’s wellbeing in the paediatric consultation. BMC Fam Pract. 2013;14:177.CrossRefPubMedPubMedCentral Lykke K, Christensen P, Reventlow S. GPs’ strategies in exploring the preschool child’s wellbeing in the paediatric consultation. BMC Fam Pract. 2013;14:177.CrossRefPubMedPubMedCentral
27.
go back to reference Lykke K, Christensen P, Reventlow S. "this is not normal ... "--signs that make the GP question the child's well-being. Fam Pract. 2008;25(3):146–53.CrossRefPubMed Lykke K, Christensen P, Reventlow S. "this is not normal ... "--signs that make the GP question the child's well-being. Fam Pract. 2008;25(3):146–53.CrossRefPubMed
28.
go back to reference Steinar K. The social construction of validity. Qual Inq. 1995;1(1):19–40.CrossRef Steinar K. The social construction of validity. Qual Inq. 1995;1(1):19–40.CrossRef
29.
go back to reference Corbin Dwyer S. The space between: on being an insider-outsider in qualitative research Int J Qual Methods. 2009;8(1):54–63. Corbin Dwyer S. The space between: on being an insider-outsider in qualitative research Int J Qual Methods. 2009;8(1):54–63.
30.
go back to reference He G, Huang WY, Wong SH. Understanding neighborhood environment related to Hong Kong Children’s physical activity: a qualitative study using nominal group technique. PLoS One. 2014;9(9):e106578. He G, Huang WY, Wong SH. Understanding neighborhood environment related to Hong Kong Children’s physical activity: a qualitative study using nominal group technique. PLoS One. 2014;9(9):e106578.
31.
go back to reference Van den Bruel A, Aertgeerts B, Bruyninckx R, Aerts M, Buntinx F. Signs and symptoms for diagnosis of serious infections in children: a prospective study in primary care. Br J Gen Pract. 2007;57(540):538–46.PubMedPubMedCentral Van den Bruel A, Aertgeerts B, Bruyninckx R, Aerts M, Buntinx F. Signs and symptoms for diagnosis of serious infections in children: a prospective study in primary care. Br J Gen Pract. 2007;57(540):538–46.PubMedPubMedCentral
32.
go back to reference Van den Bruel A, Haj-Hassan T, Thompson M, Buntinx F, Mant D. Diagnostic value of clinical features at presentation to identify serious infection in children in developed countries: a systematic review. Lancet. 2010;375(9717):834–45.CrossRefPubMed Van den Bruel A, Haj-Hassan T, Thompson M, Buntinx F, Mant D. Diagnostic value of clinical features at presentation to identify serious infection in children in developed countries: a systematic review. Lancet. 2010;375(9717):834–45.CrossRefPubMed
33.
go back to reference Lippert ML, Reventlow S, Kousgaard MB. The uses and implications of standards in general practice consultations. Health. 2015;21(1):3–20.CrossRef Lippert ML, Reventlow S, Kousgaard MB. The uses and implications of standards in general practice consultations. Health. 2015;21(1):3–20.CrossRef
34.
go back to reference Dahler-Larsen P. The Evaluation Society Standford: Standford University; 2012. Dahler-Larsen P. The Evaluation Society Standford: Standford University; 2012.
35.
go back to reference Munro E. The impact of audit on social work practice. Br J Soc Work. 2004;34(8):1075–95.CrossRef Munro E. The impact of audit on social work practice. Br J Soc Work. 2004;34(8):1075–95.CrossRef
36.
go back to reference Reventlow S, Tulinius C. The doctor as focus group moderator - shifting roles and negotiating positions in health research. Fam Pract. 2005;22(3):335–40.CrossRefPubMed Reventlow S, Tulinius C. The doctor as focus group moderator - shifting roles and negotiating positions in health research. Fam Pract. 2005;22(3):335–40.CrossRefPubMed
37.
go back to reference Malterud K. Qualitative research: standards, challenges, and guidelines. Lancet. 2001;358(9280):483–8.CrossRefPubMed Malterud K. Qualitative research: standards, challenges, and guidelines. Lancet. 2001;358(9280):483–8.CrossRefPubMed
38.
go back to reference Skjervheim H. Objectivism and the study of man. Oslo: Universitetsforlaget. 1959. Skjervheim H. Objectivism and the study of man. Oslo: Universitetsforlaget. 1959.
39.
go back to reference Haraway D. Situated knowledges: the science question in feminism and the privilege of partial perspective. Fem Stud. 1988;14(3):575–99.CrossRef Haraway D. Situated knowledges: the science question in feminism and the privilege of partial perspective. Fem Stud. 1988;14(3):575–99.CrossRef
Metadata
Title
Using a modified nominal group technique to develop general practice
Authors
Elisabeth Søndergaard
Ruth K. Ertmann
Susanne Reventlow
Kirsten Lykke
Publication date
01-12-2018
Publisher
BioMed Central
Published in
BMC Primary Care / Issue 1/2018
Electronic ISSN: 2731-4553
DOI
https://doi.org/10.1186/s12875-018-0811-9

Other articles of this Issue 1/2018

BMC Primary Care 1/2018 Go to the issue