Skip to main content
Top
Published in: European Archives of Oto-Rhino-Laryngology 5/2018

01-05-2018 | Miscellaneous

Diagnostic flexible pharyngo-laryngoscopy: development of a procedure specific assessment tool using a Delphi methodology

Authors: Jacob Melchiors, Mikael Johannes Vuokko Henriksen, Frederik G. Dikkers, Javier Gavilán, J. Pieter Noordzij, Marvin P. Fried, Daniel Novakovic, Johannes Fagan, Birgitte W. Charabi, Lars Konge, Christian von Buchwald

Published in: European Archives of Oto-Rhino-Laryngology | Issue 5/2018

Login to get access

Abstract

Purpose

Proper training and assessment of skill in flexible pharyngo-laryngoscopy are central in the education of otorhinolaryngologists. To facilitate an evidence-based approach to curriculum development in this field, a structured analysis of what constitutes flexible pharyngo-laryngoscopy is necessary. Our aim was to develop an assessment tool based on this analysis.

Methods

We conducted an international Delphi study involving experts from twelve countries in five continents. Utilizing reiterative assessment, the panel defined the procedure and reached consensus (defined as 80% agreement) on the phrasing of an assessment tool.

Results

Fifty panelists completed the Delphi process. The median age of the panelists was 44 years (range 33–64 years). Median experience in otorhinolaryngology was 15 years (range 6–35 years). Twenty-five were specialized in laryngology, 16 were head and neck surgeons, and nine were general otorhinolaryngologists. An assessment tool was created consisting of twelve distinct items.

Conclusion
The gathering of validity evidence for assessment of core procedural skills within Otorhinolaryngology is central to the development of a competence-based education. The use of an international Delphi panel allows for the creation of an assessment tool which is widely applicable and valid. This work allows for an informed approach to technical skills training for flexible pharyngo-laryngoscopy and as further validity evidence is gathered allows for a valid assessment of clinical performance within this important skillset.
Appendix
Available only for authorised users
Literature
1.
go back to reference Garcia M (1854) Observations on the human voice. Proc R Soc Lond 7:399–410CrossRef Garcia M (1854) Observations on the human voice. Proc R Soc Lond 7:399–410CrossRef
3.
go back to reference Sethi RKV, Kozin ED, Remenschneider AK, Lee DJ, Gray ST, Shrime MG et al (2014) Subspecialty emergency room as alternative model for otolaryngologic care: implications for emergency health care delivery. Am J Otolaryngol Head Neck Surg 35:758–765 Sethi RKV, Kozin ED, Remenschneider AK, Lee DJ, Gray ST, Shrime MG et al (2014) Subspecialty emergency room as alternative model for otolaryngologic care: implications for emergency health care delivery. Am J Otolaryngol Head Neck Surg 35:758–765
4.
go back to reference Couch ME (2010) Cummings otolaryngology—head and neck surgery, Fifth Edit. Cummings Otolaryngology Head and Neck Surgery. Copyright © 2010, 2005, 1998, 1993, 1986 by Mosby, Inc. All Rights Reserved, pp 93–107 Couch ME (2010) Cummings otolaryngology—head and neck surgery, Fifth Edit. Cummings Otolaryngology Head and Neck Surgery. Copyright © 2010, 2005, 1998, 1993, 1986 by Mosby, Inc. All Rights Reserved, pp 93–107
5.
go back to reference Paul BC, Rafii B, Achlatis S, Amin MR, Branski RC (2012) Morbidity and patient perception of flexible laryngoscopy. Ann Otol Rhinol Laryngol 121(11):708–713CrossRefPubMed Paul BC, Rafii B, Achlatis S, Amin MR, Branski RC (2012) Morbidity and patient perception of flexible laryngoscopy. Ann Otol Rhinol Laryngol 121(11):708–713CrossRefPubMed
6.
go back to reference Ongkasuwan J, Yung KC, Courey MS (2012) The physiologic impact of transnasal flexible endoscopy. Laryngoscope 122(6):1331–1334CrossRefPubMed Ongkasuwan J, Yung KC, Courey MS (2012) The physiologic impact of transnasal flexible endoscopy. Laryngoscope 122(6):1331–1334CrossRefPubMed
7.
go back to reference Sethi RKV, Kozin ED, Remenschneider AK, Lee DJ, Gliklich RE, Shrime MG et al (2015) Otolaryngology-specific emergency room as a model for resident training. Laryngoscope 125(1):99–104CrossRefPubMed Sethi RKV, Kozin ED, Remenschneider AK, Lee DJ, Gliklich RE, Shrime MG et al (2015) Otolaryngology-specific emergency room as a model for resident training. Laryngoscope 125(1):99–104CrossRefPubMed
9.
go back to reference Nasca TJ, Philibert I, Brigham T, Flynn TC (2012) The next GME accreditation system—rationale and benefits. N Engl J Med 366(11):1051–1056CrossRefPubMed Nasca TJ, Philibert I, Brigham T, Flynn TC (2012) The next GME accreditation system—rationale and benefits. N Engl J Med 366(11):1051–1056CrossRefPubMed
10.
11.
go back to reference Ghaderi I, Manji F, Park YS, Juul D, Ott M, Harris I et al (2015) Technical skills assessment toolbox. Ann Surg 261(2):251–262CrossRefPubMed Ghaderi I, Manji F, Park YS, Juul D, Ott M, Harris I et al (2015) Technical skills assessment toolbox. Ann Surg 261(2):251–262CrossRefPubMed
12.
go back to reference Messick S (1995) Validity of psychological assessment: validation of inferences from persons’ responses and performances as scientific inquiry into score meaning. Am Psychol 50(22):741–749CrossRef Messick S (1995) Validity of psychological assessment: validation of inferences from persons’ responses and performances as scientific inquiry into score meaning. Am Psychol 50(22):741–749CrossRef
13.
go back to reference Cook D, Beckman TJ (2006) Current concepts in validity and reliability for psychometric instruments: theory and application. Am J Med 119(2):166.e7–166.e16CrossRef Cook D, Beckman TJ (2006) Current concepts in validity and reliability for psychometric instruments: theory and application. Am J Med 119(2):166.e7–166.e16CrossRef
14.
go back to reference Stefanidis D, Arora S, Parrack DM, Hamad GG, Capella J, Grantcharov T et al (2012) Research priorities in surgical simulation for the 21st century. Am J Surg 203(1):49–53CrossRefPubMedPubMedCentral Stefanidis D, Arora S, Parrack DM, Hamad GG, Capella J, Grantcharov T et al (2012) Research priorities in surgical simulation for the 21st century. Am J Surg 203(1):49–53CrossRefPubMedPubMedCentral
15.
go back to reference Robinson HF, Dennick R (2015) Teaching laryngeal endoscopy skills to speech and language therapists. Curr Opin Otolaryngol Head Neck Surg 23(3):197–201CrossRefPubMed Robinson HF, Dennick R (2015) Teaching laryngeal endoscopy skills to speech and language therapists. Curr Opin Otolaryngol Head Neck Surg 23(3):197–201CrossRefPubMed
16.
go back to reference Herrmann IF, Domagk D, Strahl M, Arens C (2016) The transnasal videopanendoscopy (ViP): diagnostics of the upper aerodigestive tract using an anatomically correct model from the model to the patient. Eur Arch Otorhinolaryngol 273(3):749–754CrossRefPubMed Herrmann IF, Domagk D, Strahl M, Arens C (2016) The transnasal videopanendoscopy (ViP): diagnostics of the upper aerodigestive tract using an anatomically correct model from the model to the patient. Eur Arch Otorhinolaryngol 273(3):749–754CrossRefPubMed
17.
go back to reference Laeeq K, Pandian V, Skinner M, Masood H, Stewart CM, Weatherly R et al (2010) Learning curve for competency in flexible laryngoscopy. Laryngoscope. 120(10):1950–1953CrossRefPubMed Laeeq K, Pandian V, Skinner M, Masood H, Stewart CM, Weatherly R et al (2010) Learning curve for competency in flexible laryngoscopy. Laryngoscope. 120(10):1950–1953CrossRefPubMed
18.
go back to reference Brook CD, Platt MP, Russell K, Grillone G, Aliphas A, Noordzij JP (2015) Time to competency, reliability of flexible transnasal laryngoscopy by training level: A Pilot Study. Otolaryngol Head Neck Surg 152(5):843–850CrossRefPubMed Brook CD, Platt MP, Russell K, Grillone G, Aliphas A, Noordzij JP (2015) Time to competency, reliability of flexible transnasal laryngoscopy by training level: A Pilot Study. Otolaryngol Head Neck Surg 152(5):843–850CrossRefPubMed
19.
go back to reference Okoli C, Pawlowski SD (2004) The Delphi method as a research tool: an example, design considerations and applications. Inf Manag 42(1):15–29CrossRef Okoli C, Pawlowski SD (2004) The Delphi method as a research tool: an example, design considerations and applications. Inf Manag 42(1):15–29CrossRef
20.
go back to reference de Villiers MR, de Villiers PJT, Kent AP (2005) The Delphi technique in health sciences education research. Med Teach 27(7):639–643CrossRefPubMed de Villiers MR, de Villiers PJT, Kent AP (2005) The Delphi technique in health sciences education research. Med Teach 27(7):639–643CrossRefPubMed
21.
go back to reference Murry JW, Hammons JO. Delphi (1995) A versatile methodology for conducting qualitative research. Rev High Educ 18(4):423–436CrossRef Murry JW, Hammons JO. Delphi (1995) A versatile methodology for conducting qualitative research. Rev High Educ 18(4):423–436CrossRef
22.
go back to reference Keeney S, Hasson F, McKenna H (2006) Consulting the Oracle: ten lessons from using the Delphi techniques in nursing research. J Adv Nurs 53(2):205–212CrossRefPubMed Keeney S, Hasson F, McKenna H (2006) Consulting the Oracle: ten lessons from using the Delphi techniques in nursing research. J Adv Nurs 53(2):205–212CrossRefPubMed
23.
go back to reference Streiner DL, Norman GR, Cairney J (2015) Health measurement scales, vol 9. Oxford University Press, OxfordCrossRef Streiner DL, Norman GR, Cairney J (2015) Health measurement scales, vol 9. Oxford University Press, OxfordCrossRef
24.
go back to reference Walsh CM, Ling SC, Khanna N, Cooper MA, Grover SC, May G et al (2014) Gastrointestinal endoscopy competency assessment tool: development of a procedure-specific assessment tool for colonoscopy. Gastrointest Endosc 79(5):798–807.e5CrossRefPubMed Walsh CM, Ling SC, Khanna N, Cooper MA, Grover SC, May G et al (2014) Gastrointestinal endoscopy competency assessment tool: development of a procedure-specific assessment tool for colonoscopy. Gastrointest Endosc 79(5):798–807.e5CrossRefPubMed
25.
go back to reference Madani A, Watanabe Y, Vassiliou M, Feldman LS, Duh QY, Singer MC et al (2016) Defining competencies for safe thyroidectomy: an international Delphi consensus. Surg (United States) 159(1):86–101 Madani A, Watanabe Y, Vassiliou M, Feldman LS, Duh QY, Singer MC et al (2016) Defining competencies for safe thyroidectomy: an international Delphi consensus. Surg (United States) 159(1):86–101
26.
go back to reference Maertens H, Aggarwal R, Macdonald S, Vermassen F, Van Herzeele I, Brodmann M et al (2016) Transatlantic multispecialty consensus on fundamental endovascular skills: results of a Delphi Consensus Study. Eur J Vasc Endovasc Surg 51(1):141–149CrossRefPubMed Maertens H, Aggarwal R, Macdonald S, Vermassen F, Van Herzeele I, Brodmann M et al (2016) Transatlantic multispecialty consensus on fundamental endovascular skills: results of a Delphi Consensus Study. Eur J Vasc Endovasc Surg 51(1):141–149CrossRefPubMed
27.
go back to reference Downing S, Yudkowsky R (2009) Assessment in health professions education. Routledge, New York Downing S, Yudkowsky R (2009) Assessment in health professions education. Routledge, New York
28.
go back to reference Ilgen JS, Ma IWY, Hatala R, Cook D (2015) A systematic review of validity evidence for checklists versus global rating scales in simulation-based assessment. Med Educ 49:161–173CrossRefPubMed Ilgen JS, Ma IWY, Hatala R, Cook D (2015) A systematic review of validity evidence for checklists versus global rating scales in simulation-based assessment. Med Educ 49:161–173CrossRefPubMed
31.
go back to reference Miller GE (1990) The assessment of clinical skills/competence/performance. Acad Med 65(9):63–67CrossRef Miller GE (1990) The assessment of clinical skills/competence/performance. Acad Med 65(9):63–67CrossRef
32.
go back to reference Melchiors J, Todsen T, Nilsson P, Kohl AP, Bøttger M, Charabi B et al (2016) Self-directed simulation-based training of emergency cricothyroidotomy: a route to lifesaving skills. Eur Arch Otorhinolaryngol 273(12):4623–4628CrossRefPubMed Melchiors J, Todsen T, Nilsson P, Kohl AP, Bøttger M, Charabi B et al (2016) Self-directed simulation-based training of emergency cricothyroidotomy: a route to lifesaving skills. Eur Arch Otorhinolaryngol 273(12):4623–4628CrossRefPubMed
33.
go back to reference Mcgaghie WC (2015) Mastery learning: it is time for medical education to join the 21st Century. Acad Med 90(11):1438–1441CrossRefPubMed Mcgaghie WC (2015) Mastery learning: it is time for medical education to join the 21st Century. Acad Med 90(11):1438–1441CrossRefPubMed
34.
go back to reference Lineberry M, Soo Park Y, Cook D, Yudkowsky R (2015) Making the case for mastery learning assessments. Acad Med 90(11):1CrossRef Lineberry M, Soo Park Y, Cook D, Yudkowsky R (2015) Making the case for mastery learning assessments. Acad Med 90(11):1CrossRef
35.
go back to reference Melchiors J, Todsen T, Nilsson P, Wennervaldt K, Charabi B, Bøttger M et al (2015) Preparing for emergency: a valid, reliable assessment tool for emergency cricothyroidotomy skills. Otolaryngol Head Neck Surg 152(2):260–265CrossRefPubMed Melchiors J, Todsen T, Nilsson P, Wennervaldt K, Charabi B, Bøttger M et al (2015) Preparing for emergency: a valid, reliable assessment tool for emergency cricothyroidotomy skills. Otolaryngol Head Neck Surg 152(2):260–265CrossRefPubMed
Metadata
Title
Diagnostic flexible pharyngo-laryngoscopy: development of a procedure specific assessment tool using a Delphi methodology
Authors
Jacob Melchiors
Mikael Johannes Vuokko Henriksen
Frederik G. Dikkers
Javier Gavilán
J. Pieter Noordzij
Marvin P. Fried
Daniel Novakovic
Johannes Fagan
Birgitte W. Charabi
Lars Konge
Christian von Buchwald
Publication date
01-05-2018
Publisher
Springer Berlin Heidelberg
Published in
European Archives of Oto-Rhino-Laryngology / Issue 5/2018
Print ISSN: 0937-4477
Electronic ISSN: 1434-4726
DOI
https://doi.org/10.1007/s00405-018-4904-9

Other articles of this Issue 5/2018

European Archives of Oto-Rhino-Laryngology 5/2018 Go to the issue