Skip to main content
Top
Published in: BMC Primary Care 1/2011

Open Access 01-12-2011 | Research article

Prediction of persistent shoulder pain in general practice: Comparing clinical consensus from a Delphi procedure with a statistical scoring system

Authors: David Vergouw, Martijn W Heymans, Henrica CW de Vet, Daniëlle AWM van der Windt, Henriëtte E van der Horst

Published in: BMC Primary Care | Issue 1/2011

Login to get access

Abstract

Background

In prognostic research, prediction rules are generally statistically derived. However the composition and performance of these statistical models may strongly depend on the characteristics of the derivation sample. The purpose of this study was to establish consensus among clinicians and experts on key predictors for persistent shoulder pain three months after initial consultation in primary care and assess the predictive performance of a model based on clinical expertise compared to a statistically derived model.

Methods

A Delphi poll involving 3 rounds of data collection was used to reach consensus among health care professionals involved in the assessment and management of shoulder pain.

Results

Predictors selected by the expert panel were: symptom duration, pain catastrophizing, symptom history, fear-avoidance beliefs, coexisting neck pain, severity of shoulder disability, multisite pain, age, shoulder pain intensity and illness perceptions. When tested in a sample of 587 primary care patients consulting with shoulder pain the predictive performance of the two prognostic models based on clinical expertise were lower compared to that of a statistically derived model (Area Under the Curve, AUC, expert-based dichotomous predictors 0.656, expert-based continuous predictors 0.679 vs. 0.702 statistical model).

Conclusions

The three models were different in terms of composition, but all confirmed the prognostic importance of symptom duration, baseline level of shoulder disability and multisite pain. External validation in other populations of shoulder pain patients should confirm whether statistically derived models indeed perform better compared to models based on clinical expertise.
Appendix
Available only for authorised users
Literature
1.
go back to reference McGinn TG, Guyatt GH, Wyer PC, Naylor CD, Stiell IG, Richardson WS: Users' guides to the medical literature. XXII: How to use article about clinical prediction rules. J Am Med Assoc. 2000, 284: 79-84. 10.1001/jama.284.1.79.CrossRef McGinn TG, Guyatt GH, Wyer PC, Naylor CD, Stiell IG, Richardson WS: Users' guides to the medical literature. XXII: How to use article about clinical prediction rules. J Am Med Assoc. 2000, 284: 79-84. 10.1001/jama.284.1.79.CrossRef
2.
go back to reference Austin PC, Tu JV: Automated variable selection methods for logistic regression produced unstable models for predicting acute myocardial infarction mortality. J Clin Epidemiol. 2004, 57: 1138-46. 10.1016/j.jclinepi.2004.04.003.CrossRefPubMed Austin PC, Tu JV: Automated variable selection methods for logistic regression produced unstable models for predicting acute myocardial infarction mortality. J Clin Epidemiol. 2004, 57: 1138-46. 10.1016/j.jclinepi.2004.04.003.CrossRefPubMed
3.
go back to reference Stanton TR, Hancock MJ, Maher CG, Koes BW: Critical appraisal of clinical prediction rules that aim to optimize treatment selection for musculoskeletal conditions. Phys Ther. 2010, 90: 843-54. 10.2522/ptj.20090233.CrossRefPubMed Stanton TR, Hancock MJ, Maher CG, Koes BW: Critical appraisal of clinical prediction rules that aim to optimize treatment selection for musculoskeletal conditions. Phys Ther. 2010, 90: 843-54. 10.2522/ptj.20090233.CrossRefPubMed
4.
go back to reference Peduzzi P, Concato J, Kemper E, Holford TR, Feinstein AR: A simulation study of the number of events per variable in logistic regression analysis. J Clin Epidemiol. 1996, 49: 1373-9. 10.1016/S0895-4356(96)00236-3.CrossRefPubMed Peduzzi P, Concato J, Kemper E, Holford TR, Feinstein AR: A simulation study of the number of events per variable in logistic regression analysis. J Clin Epidemiol. 1996, 49: 1373-9. 10.1016/S0895-4356(96)00236-3.CrossRefPubMed
6.
go back to reference Gallagher M, Hares T, Spencer J, Bradshaw C, Webb I: The nominal group technique: a research tool for general practice. Fam Pract. 1993, 10: 76-81. 10.1093/fampra/10.1.76.CrossRefPubMed Gallagher M, Hares T, Spencer J, Bradshaw C, Webb I: The nominal group technique: a research tool for general practice. Fam Pract. 1993, 10: 76-81. 10.1093/fampra/10.1.76.CrossRefPubMed
7.
go back to reference McKenna HP: The Delphi technique- a worthwhile research approach for nursing. J Adv Nurs. 1994, 19: 1221-1225. 10.1111/j.1365-2648.1994.tb01207.x.CrossRefPubMed McKenna HP: The Delphi technique- a worthwhile research approach for nursing. J Adv Nurs. 1994, 19: 1221-1225. 10.1111/j.1365-2648.1994.tb01207.x.CrossRefPubMed
8.
go back to reference Meijer R, Ihnenfeldt D, Vermeulen M, De Haan R, Van Limbeek J: The use of a modified Delphi procedure for the determination of 26 prognostic factors in the sub-acute stage of stroke. Int J Rehabil Res. 2003, 26: 265-70. 10.1097/00004356-200312000-00003.CrossRefPubMed Meijer R, Ihnenfeldt D, Vermeulen M, De Haan R, Van Limbeek J: The use of a modified Delphi procedure for the determination of 26 prognostic factors in the sub-acute stage of stroke. Int J Rehabil Res. 2003, 26: 265-70. 10.1097/00004356-200312000-00003.CrossRefPubMed
9.
go back to reference Miró J, Huguet A, Nieto R: Predictive factors of chronic pediatric pain and disability: a Delphi poll. J Pain. 2007, 8: 774-92. 10.1016/j.jpain.2007.04.009.CrossRefPubMed Miró J, Huguet A, Nieto R: Predictive factors of chronic pediatric pain and disability: a Delphi poll. J Pain. 2007, 8: 774-92. 10.1016/j.jpain.2007.04.009.CrossRefPubMed
10.
go back to reference Delbecq AL, van de Ven AH, Gustafson DH: Group Techniques for Program planning: A Guide to Nominal Group and Delphi Processes. 1975, Glenview Illinois, Scott Foresman and Company Delbecq AL, van de Ven AH, Gustafson DH: Group Techniques for Program planning: A Guide to Nominal Group and Delphi Processes. 1975, Glenview Illinois, Scott Foresman and Company
11.
go back to reference Ludwig B: Predicting the future: Have you considered using the Delphi methodology?. J Extension. 1997, 35: 1-4. Ludwig B: Predicting the future: Have you considered using the Delphi methodology?. J Extension. 1997, 35: 1-4.
12.
go back to reference Kuijpers T, van der Windt DA, van der Heijden GJ, Bouter LM: Systematic review of prognostic cohort studies on shoulder disorders. Pain. 2004, 109: 420-31. 10.1016/j.pain.2004.02.017.CrossRefPubMed Kuijpers T, van der Windt DA, van der Heijden GJ, Bouter LM: Systematic review of prognostic cohort studies on shoulder disorders. Pain. 2004, 109: 420-31. 10.1016/j.pain.2004.02.017.CrossRefPubMed
13.
go back to reference Vergouw D, Heymans MW, Peat GM, Kuijpers T, Croft PR, de Vet HCW, van der Horst HE, van der Windt DAWM: The search for stable prognostic models in multiple imputed data sets. BMC Med Res Methodol. 2010, 10: 81-10.1186/1471-2288-10-81.CrossRefPubMedPubMedCentral Vergouw D, Heymans MW, Peat GM, Kuijpers T, Croft PR, de Vet HCW, van der Horst HE, van der Windt DAWM: The search for stable prognostic models in multiple imputed data sets. BMC Med Res Methodol. 2010, 10: 81-10.1186/1471-2288-10-81.CrossRefPubMedPubMedCentral
14.
go back to reference Kuijpers T, van der Windt DA, Boeke AJ, Twisk JWR, Vergouwe Y, Bouter LM, van der Heijden GJMG: Clinical prediction rules for the prognosis of shoulder pain in general practice. Pain. 2006, 120: 276-85. 10.1016/j.pain.2005.11.004.CrossRefPubMed Kuijpers T, van der Windt DA, Boeke AJ, Twisk JWR, Vergouwe Y, Bouter LM, van der Heijden GJMG: Clinical prediction rules for the prognosis of shoulder pain in general practice. Pain. 2006, 120: 276-85. 10.1016/j.pain.2005.11.004.CrossRefPubMed
15.
go back to reference Van der Heijden GJ, Leffers P, Bouter LM: Shoulder disability questionnaire design and responsiveness of a functional status measure. J Clin Epidemiol. 2000, 53: 29-38. 10.1016/S0895-4356(99)00078-5.CrossRefPubMed Van der Heijden GJ, Leffers P, Bouter LM: Shoulder disability questionnaire design and responsiveness of a functional status measure. J Clin Epidemiol. 2000, 53: 29-38. 10.1016/S0895-4356(99)00078-5.CrossRefPubMed
16.
go back to reference Berg SGM, Vlaeyen JWS, Ter Kuil MM, Spinhoven P, van Breukelen G, Kole-Snijders AMJ: Instruments for measuring chronic pain, part 2. Pain Coping and Cognition List. 2001, Maastricht, Pijn Kennis Centrum, [In Dutch: Meetinstrument chronische pijn, deel 2. Pijn Coping Cognitie Lijst] Berg SGM, Vlaeyen JWS, Ter Kuil MM, Spinhoven P, van Breukelen G, Kole-Snijders AMJ: Instruments for measuring chronic pain, part 2. Pain Coping and Cognition List. 2001, Maastricht, Pijn Kennis Centrum, [In Dutch: Meetinstrument chronische pijn, deel 2. Pijn Coping Cognitie Lijst]
17.
go back to reference Terluin B, van Rhenen W, Schaufeli W, de Haan M: The four-Dimensional symptom questionnaire (4DSQ): measuring distress and other mental health problems in a working population. Work Stress. 2004, 18: 187-207. 10.1080/0267837042000297535.CrossRef Terluin B, van Rhenen W, Schaufeli W, de Haan M: The four-Dimensional symptom questionnaire (4DSQ): measuring distress and other mental health problems in a working population. Work Stress. 2004, 18: 187-207. 10.1080/0267837042000297535.CrossRef
18.
go back to reference Waddell G, Newton M, Henderson I, Somerville D, Main CJ: A Fear-Avoidance Beliefs Questionnaire (FABQ) and the role of fear-avoidance beliefs in chronic low back pain and disability. Pain. 1993, 52: 157-68. 10.1016/0304-3959(93)90127-B.CrossRefPubMed Waddell G, Newton M, Henderson I, Somerville D, Main CJ: A Fear-Avoidance Beliefs Questionnaire (FABQ) and the role of fear-avoidance beliefs in chronic low back pain and disability. Pain. 1993, 52: 157-68. 10.1016/0304-3959(93)90127-B.CrossRefPubMed
19.
go back to reference Kori SH, Miller RP, Todd DD: Kinesiophobia: A new view of chronic pain behaviour. Pain Manage. 1990, 3: 35-43. Kori SH, Miller RP, Todd DD: Kinesiophobia: A new view of chronic pain behaviour. Pain Manage. 1990, 3: 35-43.
20.
go back to reference Vlaeyen JW, Seelen HA, Peters M, de Jong P, Aretz E, Beisiegel E, Weber WEJ: Fear of movement/(re)injury and muscular reactivity in chronic low back pain patients: an experimental investigation. Pain. 1999, 82: 297-304. 10.1016/S0304-3959(99)00054-8.CrossRefPubMed Vlaeyen JW, Seelen HA, Peters M, de Jong P, Aretz E, Beisiegel E, Weber WEJ: Fear of movement/(re)injury and muscular reactivity in chronic low back pain patients: an experimental investigation. Pain. 1999, 82: 297-304. 10.1016/S0304-3959(99)00054-8.CrossRefPubMed
21.
go back to reference MacCallum RC, Zhang SB, Preacher KJ, Rucker DD: On the practice of dichotomization of quantitative variables. Psychol Methods. 2002, 7: 19-40.CrossRefPubMed MacCallum RC, Zhang SB, Preacher KJ, Rucker DD: On the practice of dichotomization of quantitative variables. Psychol Methods. 2002, 7: 19-40.CrossRefPubMed
22.
go back to reference Royston P, Altman DG, Sauerbrei W: Dichotomizing continuous predictors in multiple regression: a bad idea. Stat Med. 2006, 25: 127-41. 10.1002/sim.2331.CrossRefPubMed Royston P, Altman DG, Sauerbrei W: Dichotomizing continuous predictors in multiple regression: a bad idea. Stat Med. 2006, 25: 127-41. 10.1002/sim.2331.CrossRefPubMed
23.
go back to reference Slinker BK, Glantz SA: Multiple regression for physiological data analysis: the problem of multicollinearity. Am J Physiol. 1985, 249: R1-R12.PubMed Slinker BK, Glantz SA: Multiple regression for physiological data analysis: the problem of multicollinearity. Am J Physiol. 1985, 249: R1-R12.PubMed
24.
go back to reference Hosmer DW, Lemeshow S: Logistic regression diagnostics. Applied Logistic Regression. 2000, New York: John Wiley & Sons Inc, 167-185. 2CrossRef Hosmer DW, Lemeshow S: Logistic regression diagnostics. Applied Logistic Regression. 2000, New York: John Wiley & Sons Inc, 167-185. 2CrossRef
25.
go back to reference Clark TG, Altman DG: Developing a prognostic model in the presence of missing data: an ovarian cancer case study. J Clin Epidemiol. 2003, 56: 28-37. 10.1016/S0895-4356(02)00539-5.CrossRefPubMed Clark TG, Altman DG: Developing a prognostic model in the presence of missing data: an ovarian cancer case study. J Clin Epidemiol. 2003, 56: 28-37. 10.1016/S0895-4356(02)00539-5.CrossRefPubMed
27.
go back to reference Efron B: Estimating the error rate of a prediction rule: improvements on cross-validation. J Am Stat Assoc. 1983, 78: 316-331. 10.2307/2288636.CrossRef Efron B: Estimating the error rate of a prediction rule: improvements on cross-validation. J Am Stat Assoc. 1983, 78: 316-331. 10.2307/2288636.CrossRef
28.
go back to reference Roelofsma PHMP, Bottema CW, Smeets JEM: Examine: an web survey tool for research design and analysis. 2005, Amsterdam, SLA Press Roelofsma PHMP, Bottema CW, Smeets JEM: Examine: an web survey tool for research design and analysis. 2005, Amsterdam, SLA Press
29.
go back to reference Mallen CD, Peat G, Thomas E, Dunn KM, Croft PR: Prognostic factors for musculoskeletal pain in primary care: a systematic review. Br J Gen Pract. 2007, 57: 655-61.PubMedPubMedCentral Mallen CD, Peat G, Thomas E, Dunn KM, Croft PR: Prognostic factors for musculoskeletal pain in primary care: a systematic review. Br J Gen Pract. 2007, 57: 655-61.PubMedPubMedCentral
30.
go back to reference Hasson F, Keeney S, McKenna H: Research guidelines for the Delphi survey technique. J Adv Nurs. 2000, 32: 1008-1015.PubMed Hasson F, Keeney S, McKenna H: Research guidelines for the Delphi survey technique. J Adv Nurs. 2000, 32: 1008-1015.PubMed
31.
go back to reference Williams PL, Webb C: The Delphi technique: a methodological discussion. J Adv Nurs. 1994, 19: 180-6. 10.1111/j.1365-2648.1994.tb01066.x.CrossRefPubMed Williams PL, Webb C: The Delphi technique: a methodological discussion. J Adv Nurs. 1994, 19: 180-6. 10.1111/j.1365-2648.1994.tb01066.x.CrossRefPubMed
32.
go back to reference Fink A, Kosecoff J, Chassin M, Brook RH: Consensus methods: characteristics and guidelines for use. Am J Public Health. 1984, 74: 979-983. 10.2105/AJPH.74.9.979.CrossRefPubMedPubMedCentral Fink A, Kosecoff J, Chassin M, Brook RH: Consensus methods: characteristics and guidelines for use. Am J Public Health. 1984, 74: 979-983. 10.2105/AJPH.74.9.979.CrossRefPubMedPubMedCentral
33.
go back to reference Leape LL, Park RE, Kahan JP, Brook RH: Group judgments of appropriateness: the effect of panel composition. Qual Assur Health Care. 1992, 4: 151-9.PubMed Leape LL, Park RE, Kahan JP, Brook RH: Group judgments of appropriateness: the effect of panel composition. Qual Assur Health Care. 1992, 4: 151-9.PubMed
34.
go back to reference Coulter I, Adams A, Shekelle P: Impact of varying panel membership on ratings of appropriateness in consensus panels: A comparison of a multidisciplinary and single-disciplinary panel. Health Serv Res. 1995, 30: 577-591.PubMedPubMedCentral Coulter I, Adams A, Shekelle P: Impact of varying panel membership on ratings of appropriateness in consensus panels: A comparison of a multidisciplinary and single-disciplinary panel. Health Serv Res. 1995, 30: 577-591.PubMedPubMedCentral
35.
go back to reference Wood AM, White IR, Royston P: How should variable selection be performed with multiply imputed data?. Stat Med. 2008, 27: 3227-46. 10.1002/sim.3177.CrossRefPubMed Wood AM, White IR, Royston P: How should variable selection be performed with multiply imputed data?. Stat Med. 2008, 27: 3227-46. 10.1002/sim.3177.CrossRefPubMed
36.
go back to reference Hill JC, Vohora K, Dunn KM, Main CJ, Hay EM: Comparing the STarT back screening tool's subgroup allocation of individual patients with that of independent clinical experts. Clin J Pain. 2010, 26: 783-787. 10.1097/AJP.0b013e3181f18aac.CrossRefPubMed Hill JC, Vohora K, Dunn KM, Main CJ, Hay EM: Comparing the STarT back screening tool's subgroup allocation of individual patients with that of independent clinical experts. Clin J Pain. 2010, 26: 783-787. 10.1097/AJP.0b013e3181f18aac.CrossRefPubMed
37.
go back to reference Jellema P, van der Windt DA, van der Horst HE, Stalman WA, Bouter LM: Prediction of an unfavourable course of low back pain in general practice: comparison of four instruments. Br J Gen Pract. 2007, 57: 15-22.PubMedPubMedCentral Jellema P, van der Windt DA, van der Horst HE, Stalman WA, Bouter LM: Prediction of an unfavourable course of low back pain in general practice: comparison of four instruments. Br J Gen Pract. 2007, 57: 15-22.PubMedPubMedCentral
38.
go back to reference Schiøttz-Christensen B, Nielsen GL, Hansen VK, Schødt T, Sørensen HT, Olesen F: Long-term prognosis of acute low back pain in patients seen in general practice: a 1-year prospective follow-up study. Fam Pract. 1999, 16: 223-32. 10.1093/fampra/16.3.223.CrossRefPubMed Schiøttz-Christensen B, Nielsen GL, Hansen VK, Schødt T, Sørensen HT, Olesen F: Long-term prognosis of acute low back pain in patients seen in general practice: a 1-year prospective follow-up study. Fam Pract. 1999, 16: 223-32. 10.1093/fampra/16.3.223.CrossRefPubMed
Metadata
Title
Prediction of persistent shoulder pain in general practice: Comparing clinical consensus from a Delphi procedure with a statistical scoring system
Authors
David Vergouw
Martijn W Heymans
Henrica CW de Vet
Daniëlle AWM van der Windt
Henriëtte E van der Horst
Publication date
01-12-2011
Publisher
BioMed Central
Published in
BMC Primary Care / Issue 1/2011
Electronic ISSN: 2731-4553
DOI
https://doi.org/10.1186/1471-2296-12-63

Other articles of this Issue 1/2011

BMC Primary Care 1/2011 Go to the issue