Skip to main content
Key Specialties
Cardiology Diabetology Endocrinology Gastroenterology Geriatrics and Gerontology Gynecology and Obstetrics Hematology Infectious Disease Internal Medicine Nephrology Neurology Oncology Pediatrics Respiratory Medicine Rheumatology Surgery
Congress Coverage
2024 ACC Congress 2023 ESMO Congress 2023 EASD Congress 2023 ERS Congress 2023 ESC Congress 2023 EHA Congress 2023 ASCO Annual Meeting
Clinical Collections
Advances in Alzheimer’s

Keynote webinar | Spotlight on sleep in brain health

LIVE: Thursday 2nd May 2024, 18:00-19:30 (CEST)

Quality sleep is essential for health. But what happens to our brains when sleep patterns are disturbed? Join our experts to explore the interplay between sleep disruption and neurological diseases, and the questions that you need to be asking your patients to help you prevent the harmful effects of sleep deprivation.
ADVANCED SEARCH
Log in
Top
Implementation Science
Published in: Implementation Science 1/2018

Open Access 01-12-2018 | Research

A new scale for the evaluation of clinical practice guidelines applicability: development and appraisal

Authors: Hui Li, Runsheng Xie, Yangyang Wang, Xiuli Xie, Jingwen Deng, Chuanjian Lu

Published in: Implementation Science | Issue 1/2018

Login to get access

Abstract

Background

This study aimed to develop the clinical practice guidelines applicability evaluation (CPGAE-V1.0) scale and to evaluate its validity and reliability.

Methods

One hundred fifty assessors were invited to rate two rounds of importance scoring of the applicability indicators by using the 5-point Likert scale. Approved indicators formed the CPGAE-V1.0 scale, consisting of 19 items, arranged into 4 domains. We enrolled eligible clinicians from 8 institutions to evaluate 9 clinical practice guidelines using the CPGAE-V1.0 scale. Content validity, construct validity, internal reliability, intra-rater reliability, and responsiveness were analyzed.

Results

A total of 220 clinicians participated, and the response rate was 98.6% (217/220). The CPGAE-V1.0 scale had favorable content validity. The four-factor model produced acceptable fit indices. The scale had an excellent internal consistency and item discrimination. It could identify the degree of applicability of the different dimensions between different guidelines. In all domains, 77.8% (7/9) of CPGs in the minimum-scoring domain were concentrated in the “coordination of support” domain.

Conclusions

The CPGAE-V1.0 scale is a valid and reliable instrument for measuring the applicability of CPG.
Appendix
Available only for authorised users
Literature
1.
Brietzke SE. Individualized clinical practice guidelines: the next step in the evidence-based health care evolution? Otolaryngol Head Neck Surg. 2014;150(3):342–5.CrossRefPubMed
2.
Field MJ, Lohr KN, Committee to advise the public health service on clinical practice guidelines, Institute of Medicine. Clinical practice guidelines: directions for a new program. Washington, DC: National Academy Press; 1990.
3.
Woolf SH, Grol R, Hutchinson A, Eccles M, Grimshaw J. Clinical guidelines: potential benefits, limitations, and harms of clinical guidelines. BMJ. 1999;318:527–30.CrossRefPubMedPubMedCentral
4.
Vlayen J, Aertgeerts B, Hannes K, Sermeus W, Ramaekers D. A systematic review of appraisal tools for clinical practice guidelines: multiple similarities and one common deficit. Int J Qual Health Care. 2005;17(3):235–42.CrossRefPubMed
5.
Cluzeau FA, Littlejohns P, Grimshaw JM, Feder G, Moran SE. Development and application of a generic methodology to assess the quality of clinical guidelines. Int J Qual Health Care. 1999;11(1):21–8.CrossRefPubMed
6.
The AGREE Collaboration. Development and validation of an international appraisal instrument for assessing the quality of clinical practice guidelines: the AGREE project. Qual Saf Health Care. 2003;12(1):18–23.CrossRef
7.
Brouwers MC, Kho ME, Browman GP, Burgers JS, Cluzeau F, Feder G, Fervers B, Graham ID, Grimshaw J, Hanna SE, et al. AGREE II: advancing guideline development, reporting and evaluation in health care. CMAJ. 2010;182(18):E839–42.
8.
Yu WY, Xu JL, Shi NN, Wang LY, Han XJ, Wang YY, Lv AP. Assessing the quality of the first batch of evidence-based clinical practice guidelines in traditional Chinese medicine. J Tradit Chin Med. 2011;31(4):376–81.
9.
Choi TY, Choi J, Lee JA, Jun JH, Park B, Lee MS. The quality of clinical practice guidelines in traditional medicine in Korea: appraisal using the AGREE II instrument. Implement Sci. 2015;10:104.CrossRefPubMedPubMedCentral
10.
Hoyle RH. Structural equation modeling: concepts, issues, and applications. In: Hoyle RH, editor. The structural equation modeling approach: basic concepts and fundamental issues. Thousand Oaks: Sage Publications; 1995.
11.
Kline RB. Principles and practice of structural equation modeling (2nd ed.). New York: The Guilford Press; 2005.
12.
McDonald RP, Ho MH. Principles and practice in reporting structural equation analyses. Psychol Methods. 2002;7(1):64–82.CrossRefPubMed
13.
Hair JF, Tatham RL, Anderson RE, Black W. Multivariate data analysis (6th ed.). Upper Saddle River: Pearson Prentice Hall; 2006.
14.
Marsh HW, Balla JR, McDonald RP. Goodness-of-fit indexes in confirmatory factor analysis: the effect of sample size. Psychol Bull. 1988;103(3):391–410.CrossRef
15.
Bollen KA. Structural equations with latent variables. New York: Wiley; 1989.CrossRef
16.
Bentler PM, Bonett DG. Significance tests and goodness-of-fit in the analysis of covariance structures. Psychol Bull. 1980;88(3):588–606.CrossRef
17.
18.
McHorney CA, Tarlov AR. Individual-patient monitoring in clinical practice: are available health status surveys adequate? Qual of life res. 1995;4(4):293–307.CrossRef
19.
Burgers JS, Bailey JV, Klazinga NS, Van Der Bij AK, Grol R, Feder G. Inside guidelines: comparative analysis of recommendations and evidence in diabetes guidelines from 13 countries. Diabetes Care. 2002;25(11):1933–9.CrossRefPubMed
20.
Watine J, Friedberg B, Nagy E, Onody R, Oosterhuis W, Bunting PS, Charet JC, Horvath AR. Conflict between guideline methodologic quality and recommendation validity: a potential problem for practitioners. Clin Chem. 2006;52(1):65–72.
21.
Streiner DL, Norman GR. Health measurement scales: a practical guide to their development and use (4th ed.). Oxford: Oxford University Press; 2008.CrossRef
22.
Tøndering J, Jensen C. Perceived prominence and scale types. In: Eriksson A, Lindh J, editors. Proceedings Fonetik 2005: the XVIIIth Swedish phonetics conference. Göteborg; 2005.
23.
Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL, Bouter LM, de Vet HC. The COSMIN checklist for assessing the methodological quality of studies on measurement properties of health status measurement instruments: an international Delphi study. Qual Life Res. 2010;19(4):539–49.
Metadata
Title
A new scale for the evaluation of clinical practice guidelines applicability: development and appraisal
Authors
Hui Li
Runsheng Xie
Yangyang Wang
Xiuli Xie
Jingwen Deng
Chuanjian Lu
Publication date
01-12-2018
Publisher
BioMed Central
Published in
Implementation Science / Issue 1/2018
Electronic ISSN: 1748-5908
DOI
https://doi.org/10.1186/s13012-018-0746-5

Other articles of this Issue 1/2018

Implementation Science 1/2018 Go to the issue

Study protocol

Evaluation of a program for routine implementation of shared decision-making in cancer care: study protocol of a stepped wedge cluster randomized trial

Methodology

Training scholars in dissemination and implementation research for cancer prevention and control: a mentored approach

Research

Mechanisms of implementing public health interventions: a pooled causal mediation analysis of randomised trials

Systematic review

A systematic review of adaptations of evidence-based public health interventions globally

Research

Facilitating Implementation of Research Evidence (FIRE): an international cluster randomised controlled trial to evaluate two models of facilitation informed by the Promoting Action on Research Implementation in Health Services (PARIHS) framework

Research

The implementation of academic detailing and its effectiveness on appropriate prescribing of pain relief medication: a real-world cluster randomized trial in Belgian general practices