Skip to main content
Top
Published in: BMC Public Health 1/2009

Open Access 01-12-2009 | Research article

Evidence-based guidelines in the evaluation of work disability: an international survey and a comparison of quality of development

Authors: Wout EL de Boer, David J Bruinvels, Arie M Rijkenberg, Peter Donceel, Johannes R Anema

Published in: BMC Public Health | Issue 1/2009

Login to get access

Abstract

Background

In social insurance, the evaluation of work disability is becoming stricter as priority is given to the resumption of work, which calls for a guarantee of quality for these evaluations. Evidence-based guidelines have become a major instrument in the quality control of health care, and the quality of these guidelines' development can be assessed using the AGREE instrument. In social insurance medicine, such guidelines are relatively new. We were interested to know what guidelines have been developed to support the medical evaluation of work disability and the quality of these guidelines.

Methods

Five European countries that were reported to use guidelines were approached, using a recent inventory of evaluations of work disability in Europe. We focused on guidelines that are disease-oriented and formally prescribed in social insurance medicine. Using the AGREE instrument, these guidelines were appraised by two researchers. We asked two experts involved in guideline development to indicate if they agreed with our results and to provide explanations for insufficient scores.

Results

We found six German and sixteen Dutch sets of disease-oriented guidelines in official use. The AGREE instrument was applicable, requiring minor adaptations. The appraisers reached consensus on all items. Each guideline scored well on 'scope and purpose' and 'clarity and presentation'. The guidelines scored moderately on 'stakeholder involvement' in the Netherlands, but insufficiently in Germany, due mainly to the limited involvement of patients' representatives in this country. All guidelines had low scores on 'rigour of development', which was due partly to a lack of documentation and of existing evidence. 'Editorial independence' and 'applicability' had low scores in both countries as a result of how the production was organised.

Conclusion

Disease-oriented guidelines in social insurance medicine for the evaluation of work disability are a recent phenomenon, so far restricted to Germany and the Netherlands. The AGREE instrument is suitably applicable to assess the quality of guideline development in social insurance medicine, but some of the scoring rules need to be adapted to the context of social insurance. Existing guidelines do not meet the AGREE criteria to a sufficient level. The way patients' representatives can be involved needs further discussion. The guidelines would profit from more specific recommendations and, for providing evidence, more research is needed on the functional capacity of people with disabilities.
Appendix
Available only for authorised users
Literature
1.
go back to reference Organisation for Economic Co-operation and Development (OECD): Sickness, disability and work: keeping on track in the economic downturn. Background paper. 2009, Paris OECD Organisation for Economic Co-operation and Development (OECD): Sickness, disability and work: keeping on track in the economic downturn. Background paper. 2009, Paris OECD
2.
go back to reference Organisation for Economic Co-operation and Development (OECD): Sickness, Disability and Work: Norway, Poland and Switzerland. 2006, Paris OECD, 1: Organisation for Economic Co-operation and Development (OECD): Sickness, Disability and Work: Norway, Poland and Switzerland. 2006, Paris OECD, 1:
3.
go back to reference Organisation for Economic Co-operation and Development (OECD): Sickness, Disability and Work: Australia, Luxembourg, Spain and the United Kingdom. 2007, Paris OECD, 2: Organisation for Economic Co-operation and Development (OECD): Sickness, Disability and Work: Australia, Luxembourg, Spain and the United Kingdom. 2007, Paris OECD, 2:
4.
go back to reference Organisation for Economic Co-operation and Development (OECD): Sickness, Disability and Work: Denmark, Finland, Ireland and the Netherlands. 2008, Paris OECD, 3: Organisation for Economic Co-operation and Development (OECD): Sickness, Disability and Work: Denmark, Finland, Ireland and the Netherlands. 2008, Paris OECD, 3:
5.
go back to reference Henderson M: Transformation of the personal capability assessment. 2006, Department of Work and Pensions. London Henderson M: Transformation of the personal capability assessment. 2006, Department of Work and Pensions. London
6.
go back to reference Boer WEL, de Besseling JJM, Willems JHBM: Organisation of disability evaluation in 15 countries. Pratiques et organisation des soins. 2007, 38: 205-217. Boer WEL, de Besseling JJM, Willems JHBM: Organisation of disability evaluation in 15 countries. Pratiques et organisation des soins. 2007, 38: 205-217.
7.
go back to reference Council of Europe: Assessing disability in Europe. Council of Europe Strasbourg. 2002 Council of Europe: Assessing disability in Europe. Council of Europe Strasbourg. 2002
9.
go back to reference Wind H: Assessment of physical work ability: the utility of functional capacity evaluation for insurance physicians. PhD thesis. 2007, Amsterdam Amsterdam University Wind H: Assessment of physical work ability: the utility of functional capacity evaluation for insurance physicians. PhD thesis. 2007, Amsterdam Amsterdam University
10.
go back to reference Überschär, 2008: Quality assurance in the socio-medical assessment in the German Pension Insurance. [in German]. Gesundheitswesen. 2008, 70: 690-695. 10.1136/bmj.39472.451134.80.CrossRef Überschär, 2008: Quality assurance in the socio-medical assessment in the German Pension Insurance. [in German]. Gesundheitswesen. 2008, 70: 690-695. 10.1136/bmj.39472.451134.80.CrossRef
12.
go back to reference Burgers JS, Cluzeau FA, Hanna SE, Hunt C, Grol R: Characteristics of high-quality guidelines: evaluation of 86 clinical guidelines developed in ten European countries and Canada. Int J Technol Assess Health Care. 2003, 19: 148-57. 10.1017/S026646230300014X.CrossRefPubMed Burgers JS, Cluzeau FA, Hanna SE, Hunt C, Grol R: Characteristics of high-quality guidelines: evaluation of 86 clinical guidelines developed in ten European countries and Canada. Int J Technol Assess Health Care. 2003, 19: 148-57. 10.1017/S026646230300014X.CrossRefPubMed
14.
go back to reference Sackett DL, Rosenberg WMC, Gray JAM, Haynes RB, Richardson WS: Evidence based medicine: what it is and what it isn't. BMJ. 1996, 312: 71-72. 10.1016/j.spinee.2005.06.012.CrossRefPubMedPubMedCentral Sackett DL, Rosenberg WMC, Gray JAM, Haynes RB, Richardson WS: Evidence based medicine: what it is and what it isn't. BMJ. 1996, 312: 71-72. 10.1016/j.spinee.2005.06.012.CrossRefPubMedPubMedCentral
15.
go back to reference Lohr KN: The quality of practice guidelines and the quality of health care. Guidelines in health care: report of a WHO conference. Edited by: Selbmann HK. 1998, Baden Baden Nomos Verlaggesellschaft, 42-52. Lohr KN: The quality of practice guidelines and the quality of health care. Guidelines in health care: report of a WHO conference. Edited by: Selbmann HK. 1998, Baden Baden Nomos Verlaggesellschaft, 42-52.
16.
go back to reference Cates JR, Young DN, Bowerman DS, Porter RC: An independent AGREE evaluation of the Occupational Medicine Practice Guidelines. Spine. 2006, 6: 72-77. 10.1016/j.spinee.2005.06.012.CrossRef Cates JR, Young DN, Bowerman DS, Porter RC: An independent AGREE evaluation of the Occupational Medicine Practice Guidelines. Spine. 2006, 6: 72-77. 10.1016/j.spinee.2005.06.012.CrossRef
17.
go back to reference Schaafsma F, Hugenholtz N, de Boer A, Smits P, Hulshof C, van Dijk F: Enhancing evidence-based advice of occupational physicians. Scand J Work Environ Health. 2007, 33: 368-378. 10.1136/oem.56.7.488.CrossRefPubMed Schaafsma F, Hugenholtz N, de Boer A, Smits P, Hulshof C, van Dijk F: Enhancing evidence-based advice of occupational physicians. Scand J Work Environ Health. 2007, 33: 368-378. 10.1136/oem.56.7.488.CrossRefPubMed
18.
go back to reference Weide WE, Jos van der , Verbeek HAM, van Dijk FJH: Relation between indicators for quality of occupational rehabilitation of employees with low back pain. Occup Environ Med. 1999, 56: 488-493. 10.1136/oem.60.suppl_1.i21.CrossRefPubMedPubMedCentral Weide WE, Jos van der , Verbeek HAM, van Dijk FJH: Relation between indicators for quality of occupational rehabilitation of employees with low back pain. Occup Environ Med. 1999, 56: 488-493. 10.1136/oem.60.suppl_1.i21.CrossRefPubMedPubMedCentral
19.
go back to reference Nieuwenhuizen K, Verbeek JH, Siemerink JC, Tummers-Nijsen D: Quality of rehabilitation among workers with adjustment disorders according to practice guidelines; a retrospective cohort study. Occ Env Med. 2003, 60 (suppl 1): i21-i25. 10.1136/oem.60.suppl_1.i21.CrossRef Nieuwenhuizen K, Verbeek JH, Siemerink JC, Tummers-Nijsen D: Quality of rehabilitation among workers with adjustment disorders according to practice guidelines; a retrospective cohort study. Occ Env Med. 2003, 60 (suppl 1): i21-i25. 10.1136/oem.60.suppl_1.i21.CrossRef
21.
go back to reference AGREE Collaboration: Development and validation of an international appraisal instrument for assessing the quality of clinical practice guidelines: the AGREE project. Qual Saf Health Care. 2003, 12: 18-23. 10.1186/1472-6963-9-74.CrossRef AGREE Collaboration: Development and validation of an international appraisal instrument for assessing the quality of clinical practice guidelines: the AGREE project. Qual Saf Health Care. 2003, 12: 18-23. 10.1186/1472-6963-9-74.CrossRef
22.
go back to reference Muth C, Gensichen J, Beyer M, Hutchinson A, Gerlach FM: The systematic guideline review: method, rationale and test on chronic heart failure. BMC Health Services Research. 2009, 9: 74-10.2337/diacare.25.11.1933.CrossRefPubMedPubMedCentral Muth C, Gensichen J, Beyer M, Hutchinson A, Gerlach FM: The systematic guideline review: method, rationale and test on chronic heart failure. BMC Health Services Research. 2009, 9: 74-10.2337/diacare.25.11.1933.CrossRefPubMedPubMedCentral
23.
go back to reference Burgers JS, Baily JV', Klazinga NS, Bij Van der AK, Grol R, Feder G: Inside guidelines: Comparative analysis of recommendations and evidence in diabetes guidelines from 13 countries. Diabetes Care. 2002, 25: 1933-1939. 10.1373/clinchem.2005.059345.CrossRefPubMed Burgers JS, Baily JV', Klazinga NS, Bij Van der AK, Grol R, Feder G: Inside guidelines: Comparative analysis of recommendations and evidence in diabetes guidelines from 13 countries. Diabetes Care. 2002, 25: 1933-1939. 10.1373/clinchem.2005.059345.CrossRefPubMed
24.
go back to reference Burgers JS: Guideline quality and guideline content: are they related?. Clin Chem. 2006, 52: 3-4. 10.1111/j.1471-0528.2006.00937.x.CrossRefPubMed Burgers JS: Guideline quality and guideline content: are they related?. Clin Chem. 2006, 52: 3-4. 10.1111/j.1471-0528.2006.00937.x.CrossRefPubMed
25.
go back to reference Appleyard TL, Mann CH, Khan KS: Guidelines for the management of pelvic pain associated with endometriosis: a systematic appraisal of their quality. BJOG. 2006, 113: 749-57. 10.1373/clinchem.2008.109082.CrossRefPubMed Appleyard TL, Mann CH, Khan KS: Guidelines for the management of pelvic pain associated with endometriosis: a systematic appraisal of their quality. BJOG. 2006, 113: 749-57. 10.1373/clinchem.2008.109082.CrossRefPubMed
26.
go back to reference Nagy E, Watine J, Bunting PS, Onody R, Oosterhuis WP, Rogic D, Sandberg S, Boda K, Horvath AR, IFCC Task Force on the Global Campaign for Diabetes Mellitus: Do guidelines for the diagnosis and monitoring of diabetes mellitus fulfil the criteria of evidence-based guideline development?. Clin Chem. 2008, 54: 1872-82. 10.2486/indhealth.45.26.CrossRefPubMed Nagy E, Watine J, Bunting PS, Onody R, Oosterhuis WP, Rogic D, Sandberg S, Boda K, Horvath AR, IFCC Task Force on the Global Campaign for Diabetes Mellitus: Do guidelines for the diagnosis and monitoring of diabetes mellitus fulfil the criteria of evidence-based guideline development?. Clin Chem. 2008, 54: 1872-82. 10.2486/indhealth.45.26.CrossRefPubMed
27.
go back to reference Hulshof C, Hoenen J: Evidence based practice guidelines in OHS: are they agreeable?. Ind Health. 2007, 45: 26-31. 10.2486/indhealth.45.26.CrossRefPubMed Hulshof C, Hoenen J: Evidence based practice guidelines in OHS: are they agreeable?. Ind Health. 2007, 45: 26-31. 10.2486/indhealth.45.26.CrossRefPubMed
28.
go back to reference Manchikanti L, Singh V, Helm S, Trescot AM, Hirsch JA: A critical appraisal of 2007 American College of Occupational and Environmental Medicine (ACOEM) Practice Guidelines for Interventional Pain Management: an independent review utilizing AGREE, AMA, IOM, and other criteria. Pain Physician. 2008, 11 (3): 291-310.PubMed Manchikanti L, Singh V, Helm S, Trescot AM, Hirsch JA: A critical appraisal of 2007 American College of Occupational and Environmental Medicine (ACOEM) Practice Guidelines for Interventional Pain Management: an independent review utilizing AGREE, AMA, IOM, and other criteria. Pain Physician. 2008, 11 (3): 291-310.PubMed
29.
go back to reference Waddell G, Aylward M: The scientific and conceptual basis of incapacity benefits. 2005, Norwich: The Stationary Officer Waddell G, Aylward M: The scientific and conceptual basis of incapacity benefits. 2005, Norwich: The Stationary Officer
30.
go back to reference Aylward M: Origins, practice and limitations of disability assessment medicine. Malingering and illness deception. Edited by: Halligan PW, Bass C, Oakly DA. 2003, London: OUP, 287-299. Aylward M: Origins, practice and limitations of disability assessment medicine. Malingering and illness deception. Edited by: Halligan PW, Bass C, Oakly DA. 2003, London: OUP, 287-299.
31.
go back to reference de Boer WEL, Wind H, van Dijk FJH, Willems JHBM: Interviews for the assessment of long-term incapacity for work: a study on adherence to protocols and principles. BMC Public Health. 2009, 9: 169-10.1186/1471-2458-8-335.CrossRefPubMedPubMedCentral de Boer WEL, Wind H, van Dijk FJH, Willems JHBM: Interviews for the assessment of long-term incapacity for work: a study on adherence to protocols and principles. BMC Public Health. 2009, 9: 169-10.1186/1471-2458-8-335.CrossRefPubMedPubMedCentral
32.
go back to reference Lipsky M: Street level bureaucracy. 1980, New York: Russell Sage Lipsky M: Street level bureaucracy. 1980, New York: Russell Sage
33.
go back to reference Berendsen L: Bureaucratic dramas. PhD Thesis [In Dutch]. 2007, Tilburg University. Tilburg Berendsen L: Bureaucratic dramas. PhD Thesis [In Dutch]. 2007, Tilburg University. Tilburg
34.
go back to reference World Health Organisation (WHO): International Classification of Functioning, Disability and Health (ICF). 2001, Geneva: WHO World Health Organisation (WHO): International Classification of Functioning, Disability and Health (ICF). 2001, Geneva: WHO
35.
36.
go back to reference Tulder MW, van Tuut M, Pennick V, Bombardier C, Assendelft WJ: Quality of primary care guidelines for acute low back pain. Spine. 2004, 29: E357-62. 10.1542/peds.2004-0575.CrossRefPubMed Tulder MW, van Tuut M, Pennick V, Bombardier C, Assendelft WJ: Quality of primary care guidelines for acute low back pain. Spine. 2004, 29: E357-62. 10.1542/peds.2004-0575.CrossRefPubMed
37.
go back to reference Boluyt N, Lincke CR, Offringa M: Quality of evidence-based pediatric guidelines. Pediatrics. 2005, 115: 1378-91. 10.1542/peds.2004-0575.CrossRefPubMed Boluyt N, Lincke CR, Offringa M: Quality of evidence-based pediatric guidelines. Pediatrics. 2005, 115: 1378-91. 10.1542/peds.2004-0575.CrossRefPubMed
38.
go back to reference Poitras S, Avouac J, Rossignol M, Avouac B, Cedraschi C, Nordin M, Rousseaux C, Rozenberg S, Savarieau B, Thoumie P, Valat JP, Vignon E, Hilliquin P: A critical appraisal of guidelines for the management of knee osteoarthritis using Appraisal of Guidelines Research and Evaluation criteria. Arthritis Res Ther. 2007, 9: R126-10.1136/qshc.2006.019752.CrossRefPubMedPubMedCentral Poitras S, Avouac J, Rossignol M, Avouac B, Cedraschi C, Nordin M, Rousseaux C, Rozenberg S, Savarieau B, Thoumie P, Valat JP, Vignon E, Hilliquin P: A critical appraisal of guidelines for the management of knee osteoarthritis using Appraisal of Guidelines Research and Evaluation criteria. Arthritis Res Ther. 2007, 9: R126-10.1136/qshc.2006.019752.CrossRefPubMedPubMedCentral
40.
go back to reference Slebus FG, Kuijer P Paul, Willems J (Han), Frings-Dresen Monique, Sluiter Judith: Work ability in sick-listed patients with major depressive disorder. Occ Med. 2008, 58 (7): 475-47941. 10.1093/occmed/kqn091.CrossRef Slebus FG, Kuijer P Paul, Willems J (Han), Frings-Dresen Monique, Sluiter Judith: Work ability in sick-listed patients with major depressive disorder. Occ Med. 2008, 58 (7): 475-47941. 10.1093/occmed/kqn091.CrossRef
41.
go back to reference Dekkers-Sánchez PM, Hoving JL, Sluiter JK, Frings-Dresen MHW: Factors associated with long-term sick leave in sick-listed employees: a systematic review. Occup Environ Med. 2008, 65: 153-157. 10.1136/oem.2007.034983.CrossRefPubMed Dekkers-Sánchez PM, Hoving JL, Sluiter JK, Frings-Dresen MHW: Factors associated with long-term sick leave in sick-listed employees: a systematic review. Occup Environ Med. 2008, 65: 153-157. 10.1136/oem.2007.034983.CrossRefPubMed
42.
go back to reference Oxman AD, Schünemann HJ, Fretheim A: Improving the use of research evidence in guideline development: 16. Evaluation. Health Res Policy Syst. 2006, 8 (4): 28-10.1186/1478-4505-4-28.CrossRef Oxman AD, Schünemann HJ, Fretheim A: Improving the use of research evidence in guideline development: 16. Evaluation. Health Res Policy Syst. 2006, 8 (4): 28-10.1186/1478-4505-4-28.CrossRef
43.
go back to reference Slebus FG, Kuijer PPFM, Willems J (Han), Sluiter JK, Frings-Dresen MHW: Prognostic factors for work ability in sicklisted employees with chronic diseases. Occup Environ Med. 2007, 64: 814-819.CrossRefPubMedPubMedCentral Slebus FG, Kuijer PPFM, Willems J (Han), Sluiter JK, Frings-Dresen MHW: Prognostic factors for work ability in sicklisted employees with chronic diseases. Occup Environ Med. 2007, 64: 814-819.CrossRefPubMedPubMedCentral
Metadata
Title
Evidence-based guidelines in the evaluation of work disability: an international survey and a comparison of quality of development
Authors
Wout EL de Boer
David J Bruinvels
Arie M Rijkenberg
Peter Donceel
Johannes R Anema
Publication date
01-12-2009
Publisher
BioMed Central
Published in
BMC Public Health / Issue 1/2009
Electronic ISSN: 1471-2458
DOI
https://doi.org/10.1186/1471-2458-9-349

Other articles of this Issue 1/2009

BMC Public Health 1/2009 Go to the issue