Skip to main content
Top
Published in: Insights into Imaging 5/2017

Open Access 01-10-2017 | Original Article

A critical appraisal of the quality of adult musculoskeletal ultrasound guidelines using the AGREE II tool: an EuroAIM initiative

Authors: Carmelo Messina, Bianca Bignotti, Alberto Tagliafico, Davide Orlandi, Angelo Corazza, Francesco Sardanelli, Luca Maria Sconfienza

Published in: Insights into Imaging | Issue 5/2017

Login to get access

Abstract

Objectives

Our aim was to evaluate the quality of published guidelines on musculoskeletal ultrasound (MSK-US) for adults.

Methods

Between June and July 2016, we conducted an online search for MSK-US guidelines, which were evaluated by four independent readers blinded to each other using the AGREE II tool. A fifth independent reviewer calculated scores per each domain and agreement between reviewers’ scores using the intraclass correlation coefficient (ICC).

Results

Five guidelines were included in this appraisal. They were published between 2001 and 2014. Our appraisal showed intermediate results, with four out of five guidelines scoring “average” as overall quality. Domain 1 (scope and purpose) achieved the highest result (total score = 71.1% ± 18.7%). Domain 6 (editorial independence) had the lowest score (total score = 26.3% ± 19.3%). Interobserver agreement was very good for all the evaluated guidelines (ICC ranged between 0.932 and 0.956).

Conclusions

Overall, quality of MSK-US guidelines ranges from low to average when evaluated using the AGREE II tool. The editorial independence domain was the most critical, thus deserving more attention when developing future guidelines.

Main messages

• Four of five guidelines on MSK-US had an average quality level.
• Scope/purpose had the highest score (71.1% ± 18.7%).
• Editorial independence had the lowest score (26.3% ± 19.3%).
• Interobserver agreement was very good (ranges: 0.932–0.956).
Appendix
Available only for authorised users
Literature
1.
go back to reference Klauser AS, Tagliafico A, Allen GM et al (2012) Clinical indications for musculoskeletal ultrasound: a Delphi-based consensus paper of the European Society of Musculoskeletal Radiology. Eur Radiol 22:1140–1148CrossRefPubMed Klauser AS, Tagliafico A, Allen GM et al (2012) Clinical indications for musculoskeletal ultrasound: a Delphi-based consensus paper of the European Society of Musculoskeletal Radiology. Eur Radiol 22:1140–1148CrossRefPubMed
2.
go back to reference Lesniak BP, Loveland D, Jose J et al (2014) Use of ultrasonography as a diagnostic and therapeutic tool in sports medicine. Arthrosc J Arthrosc Relat Surg 30:260–270CrossRef Lesniak BP, Loveland D, Jose J et al (2014) Use of ultrasonography as a diagnostic and therapeutic tool in sports medicine. Arthrosc J Arthrosc Relat Surg 30:260–270CrossRef
3.
go back to reference Corazza A, Orlandi D, Fabbro E et al (2015) Dynamic high-resolution ultrasound of the shoulder: how we do it. Eur J Radiol 84:266–277CrossRefPubMed Corazza A, Orlandi D, Fabbro E et al (2015) Dynamic high-resolution ultrasound of the shoulder: how we do it. Eur J Radiol 84:266–277CrossRefPubMed
5.
go back to reference Tagliafico A, Bignotti B (2015) New parameters for evaluating peripheral nerve disorders on sonography and magnetic resonance imaging. J Ultrasound Med 34:1523CrossRefPubMed Tagliafico A, Bignotti B (2015) New parameters for evaluating peripheral nerve disorders on sonography and magnetic resonance imaging. J Ultrasound Med 34:1523CrossRefPubMed
6.
go back to reference Filippou G, Adinolfi A, Iagnocco A et al (2016) Ultrasound in the diagnosis of calcium pyrophosphate dihydrate deposition disease. A systematic literature review and a meta-analysis. Osteoarthr Cartil 24:973–981CrossRefPubMed Filippou G, Adinolfi A, Iagnocco A et al (2016) Ultrasound in the diagnosis of calcium pyrophosphate dihydrate deposition disease. A systematic literature review and a meta-analysis. Osteoarthr Cartil 24:973–981CrossRefPubMed
7.
go back to reference Sconfienza LM, Orlandi D, Lacelli F et al (2015) Dynamic high-resolution US of ankle and midfoot ligaments: normal anatomic structure and imaging technique. Radiographics 35:164–178CrossRefPubMed Sconfienza LM, Orlandi D, Lacelli F et al (2015) Dynamic high-resolution US of ankle and midfoot ligaments: normal anatomic structure and imaging technique. Radiographics 35:164–178CrossRefPubMed
8.
go back to reference Derchi L, Rizzato G (2007) Technical Requirements. In: Bianchi S, Martinoli C (eds) Ultrasound musculoskeletal system. Springer Verlag, Milano, pp 3–16CrossRef Derchi L, Rizzato G (2007) Technical Requirements. In: Bianchi S, Martinoli C (eds) Ultrasound musculoskeletal system. Springer Verlag, Milano, pp 3–16CrossRef
9.
go back to reference Messina C, Banfi G, Aliprandi A et al (2016) Ultrasound guidance to perform intra-articular injection of gadolinium-based contrast material for magnetic resonance arthrography as an alternative to fluoroscopy: the time is now. Eur Radiol 26:1221–1225CrossRefPubMed Messina C, Banfi G, Aliprandi A et al (2016) Ultrasound guidance to perform intra-articular injection of gadolinium-based contrast material for magnetic resonance arthrography as an alternative to fluoroscopy: the time is now. Eur Radiol 26:1221–1225CrossRefPubMed
10.
go back to reference Zappia M, Aliprandi A, Pozza S et al (2016) How is shoulder ultrasound done in Italy? A survey of clinical practice. Skelet Radiol 45:1629–1634CrossRef Zappia M, Aliprandi A, Pozza S et al (2016) How is shoulder ultrasound done in Italy? A survey of clinical practice. Skelet Radiol 45:1629–1634CrossRef
11.
go back to reference Martinoli C (2010) Musculoskeletal ultrasound: technical guidelines. Insight Imaging 1:99–141CrossRef Martinoli C (2010) Musculoskeletal ultrasound: technical guidelines. Insight Imaging 1:99–141CrossRef
15.
go back to reference Sardanelli F, Bashir H, Berzaczy D et al (2014) The role of imaging specialists as authors of systematic reviews on diagnostic and interventional imaging and its impact on scientific quality: report from the EuroAIM evidence-based radiology working group. Radiology 272:533–540CrossRefPubMed Sardanelli F, Bashir H, Berzaczy D et al (2014) The role of imaging specialists as authors of systematic reviews on diagnostic and interventional imaging and its impact on scientific quality: report from the EuroAIM evidence-based radiology working group. Radiology 272:533–540CrossRefPubMed
16.
go back to reference Egger M, Smith GD, Altman DG (2001) Systematic reviews in health care: meta-analysis in context. BMJ Books Egger M, Smith GD, Altman DG (2001) Systematic reviews in health care: meta-analysis in context. BMJ Books
17.
go back to reference Shaneyfelt TM, Mayo-Smith MF, Rothwangl J (1999) Are guidelines following guidelines? The methodological quality of clinical practice guidelines in the peer-reviewed medical literature. JAMA 281:1900–1905CrossRefPubMed Shaneyfelt TM, Mayo-Smith MF, Rothwangl J (1999) Are guidelines following guidelines? The methodological quality of clinical practice guidelines in the peer-reviewed medical literature. JAMA 281:1900–1905CrossRefPubMed
18.
go back to reference Grilli R, Magrini N, Penna A et al (2000) Practice guidelines developed by specialty societies: the need for a critical appraisal. Lancet (Lond, Engl) 355:103–106CrossRef Grilli R, Magrini N, Penna A et al (2000) Practice guidelines developed by specialty societies: the need for a critical appraisal. Lancet (Lond, Engl) 355:103–106CrossRef
19.
21.
go back to reference Messina C, Bignotti B, Bazzocchi A et al (2017) A critical appraisal of the quality of adult dual-energy X-ray absorptiometry guidelines in osteoporosis using the AGREE II tool: an EuroAIM initiative. Insights Imaging. doi:10.1007/s13244-017-0553-6 Messina C, Bignotti B, Bazzocchi A et al (2017) A critical appraisal of the quality of adult dual-energy X-ray absorptiometry guidelines in osteoporosis using the AGREE II tool: an EuroAIM initiative. Insights Imaging. doi:10.​1007/​s13244-017-0553-6
22.
go back to reference Ou Y, Goldberg I, Migdal C, Lee PP (2011) A critical appraisal and comparison of the quality and recommendations of glaucoma clinical practice guidelines. Ophthalmology 118:1017–1023CrossRefPubMed Ou Y, Goldberg I, Migdal C, Lee PP (2011) A critical appraisal and comparison of the quality and recommendations of glaucoma clinical practice guidelines. Ophthalmology 118:1017–1023CrossRefPubMed
23.
go back to reference Armstrong JJ, Rodrigues IB, Wasiuta T, MacDermid JC (2016) Quality assessment of osteoporosis clinical practice guidelines for physical activity and safe movement: an AGREE II appraisal. Arch Osteoporos 11:6CrossRefPubMed Armstrong JJ, Rodrigues IB, Wasiuta T, MacDermid JC (2016) Quality assessment of osteoporosis clinical practice guidelines for physical activity and safe movement: an AGREE II appraisal. Arch Osteoporos 11:6CrossRefPubMed
24.
go back to reference Sekercioglu N, Al-Khalifah R, Ewusie JE et al (2017) A critical appraisal of chronic kidney disease mineral and bone disorders clinical practice guidelines using the AGREE II instrument. Int Urol Nephrol 49:273–284CrossRefPubMed Sekercioglu N, Al-Khalifah R, Ewusie JE et al (2017) A critical appraisal of chronic kidney disease mineral and bone disorders clinical practice guidelines using the AGREE II instrument. Int Urol Nephrol 49:273–284CrossRefPubMed
25.
go back to reference Vasse E, Vernooij-Dassen M, Cantegreil I et al (2012) Guidelines for psychosocial interventions in dementia care: a European survey and comparison. Int J Geriatr Psychiatry 27:40–48CrossRefPubMed Vasse E, Vernooij-Dassen M, Cantegreil I et al (2012) Guidelines for psychosocial interventions in dementia care: a European survey and comparison. Int J Geriatr Psychiatry 27:40–48CrossRefPubMed
26.
go back to reference Zeng L, Zhang L, Hu Z et al (2014) Systematic review of evidence-based guidelines on medication therapy for upper respiratory tract infection in children with AGREE instrument. PLoS One 9:e87711CrossRefPubMedPubMedCentral Zeng L, Zhang L, Hu Z et al (2014) Systematic review of evidence-based guidelines on medication therapy for upper respiratory tract infection in children with AGREE instrument. PLoS One 9:e87711CrossRefPubMedPubMedCentral
27.
go back to reference Holmer HK, Ogden LA, Burda BU, Norris SL (2013) Quality of clinical practice guidelines for glycemic control in type 2 diabetes mellitus. PLoS One 8:e58625CrossRefPubMedPubMedCentral Holmer HK, Ogden LA, Burda BU, Norris SL (2013) Quality of clinical practice guidelines for glycemic control in type 2 diabetes mellitus. PLoS One 8:e58625CrossRefPubMedPubMedCentral
28.
29.
go back to reference Norris SL, Holmer HK, Ogden LA, Burda BU (2011) Conflict of interest in clinical practice guideline development: a systematic review. PLoS One 6:e25153CrossRefPubMedPubMedCentral Norris SL, Holmer HK, Ogden LA, Burda BU (2011) Conflict of interest in clinical practice guideline development: a systematic review. PLoS One 6:e25153CrossRefPubMedPubMedCentral
30.
go back to reference Norris SL, Holmer HK, Ogden LA et al (2012) Conflict of interest disclosures for clinical practice guidelines in the National Guideline Clearinghouse. PLoS One 7:e47343CrossRefPubMedPubMedCentral Norris SL, Holmer HK, Ogden LA et al (2012) Conflict of interest disclosures for clinical practice guidelines in the National Guideline Clearinghouse. PLoS One 7:e47343CrossRefPubMedPubMedCentral
31.
go back to reference Neuman J, Korenstein D, Ross JS, Keyhani S (2011) Prevalence of financial conflicts of interest among panel members producing clinical practice guidelines in Canada and United States: cross sectional study. BMJ 343:d5621–d5621CrossRefPubMedPubMedCentral Neuman J, Korenstein D, Ross JS, Keyhani S (2011) Prevalence of financial conflicts of interest among panel members producing clinical practice guidelines in Canada and United States: cross sectional study. BMJ 343:d5621–d5621CrossRefPubMedPubMedCentral
32.
go back to reference Kung J, Miller RR, Mackowiak PA (2012) Failure of clinical practice guidelines to meet institute of medicine standards: two more decades of little, if any, progress. Arch Intern Med 172:1628–1633CrossRefPubMed Kung J, Miller RR, Mackowiak PA (2012) Failure of clinical practice guidelines to meet institute of medicine standards: two more decades of little, if any, progress. Arch Intern Med 172:1628–1633CrossRefPubMed
33.
go back to reference Vlayen J, Aertgeerts B, Hannes K et al (2005) A systematic review of appraisal tools for clinical practice guidelines: multiple similarities and one common deficit. Int J Qual Health Care 17:235–242CrossRefPubMed Vlayen J, Aertgeerts B, Hannes K et al (2005) A systematic review of appraisal tools for clinical practice guidelines: multiple similarities and one common deficit. Int J Qual Health Care 17:235–242CrossRefPubMed
Metadata
Title
A critical appraisal of the quality of adult musculoskeletal ultrasound guidelines using the AGREE II tool: an EuroAIM initiative
Authors
Carmelo Messina
Bianca Bignotti
Alberto Tagliafico
Davide Orlandi
Angelo Corazza
Francesco Sardanelli
Luca Maria Sconfienza
Publication date
01-10-2017
Publisher
Springer Berlin Heidelberg
Published in
Insights into Imaging / Issue 5/2017
Electronic ISSN: 1869-4101
DOI
https://doi.org/10.1007/s13244-017-0563-4

Other articles of this Issue 5/2017

Insights into Imaging 5/2017 Go to the issue