Skip to main content
Top
Published in: Health and Quality of Life Outcomes 1/2013

Open Access 01-12-2013 | Research

Reliability, validity and responsiveness of the EQ-5D in assessing and valuing health status in patients with social phobia

Authors: Michael Sonntag, Alexander Konnopka, Falk Leichsenring, Simone Salzer, Manfred E Beutel, Stephan Herpertz, Wolfgang Hiller, Jürgen Hoyer, Peter Joraschky, Björn Nolting, Karin Pöhlmann, Ulrich Stangier, Bernhard Strauss, Ulrike Willutzki, Jörg Wiltink, Eric Leibing, Hans-Helmut König

Published in: Health and Quality of Life Outcomes | Issue 1/2013

Login to get access

Abstract

Objective

The aim of the study was to analyse the psychometric properties of the EQ-5D in patients with social phobia.

Methods

We used a sample of 445 patients with social phobia with five measurement points over a 30 month period. The discriminative ability of the EQ-5D was analysed by comparing the patients’ responses with the general population and between different disease severity levels. For test-retest reliability we assessed the level of agreement in patients’ responses over time, when there was no change in the Liebowitz Social Anxiety Scale (LSAS). Construct validity was analysed by identifying correlations of the EQ-5D with more specific instruments. For responsiveness we compared the means of EQ VAS/EQ-5D index anchored on improved (deteriorated) health status and computed effect sizes as well as a receiver operating characteristic (ROC) curve.

Results

Compared to the general population, patients with social phobia reported more problems in the dimensions “usual activities”, “pain/discomfort”, and “anxiety/depression” and less problems in “mobility” and “self-care”. The EQ-5D was able to distinguish between different disease severity levels. The test-retest reliability was moderate (intraclass correlation coefficient > 0.6). Correlations between the EQ-5D and other instruments were mostly small except for correlations with Beck Depression Inventory. The EQ-5D index seemed to be more responsive than the EQ VAS, but with only medium effect sizes (0.5 < effect size < 0.8) in the British EQ-5D index and only significant in patients with improved health status. The ROC analysis revealed no significant results.

Conclusions

The EQ-5D was moderately reliable and responsive in patients with improved health status. Construct validity was limited.

Trial registration

Current controlled trials ISRCTN53517394
Appendix
Available only for authorised users
Literature
1.
go back to reference Stark RG, Reitmeir P, Leidl R, Konig HH: Validity, reliability, and responsiveness of the EQ-5D in inflammatory bowel disease in Germany. Inflamm Bowel Dis 2010, 16: 42–51. 10.1002/ibd.20989PubMedCrossRef Stark RG, Reitmeir P, Leidl R, Konig HH: Validity, reliability, and responsiveness of the EQ-5D in inflammatory bowel disease in Germany. Inflamm Bowel Dis 2010, 16: 42–51. 10.1002/ibd.20989PubMedCrossRef
2.
go back to reference Hunger M, Sabariego C, Stollenwerk B, Cieza A, Leidl R: Validity, reliability and responsiveness of the EQ-5D in German stroke patients undergoing rehabilitation. Qual Life Res 2012, 21: 1205–1216. 10.1007/s11136-011-0024-3PubMedCrossRef Hunger M, Sabariego C, Stollenwerk B, Cieza A, Leidl R: Validity, reliability and responsiveness of the EQ-5D in German stroke patients undergoing rehabilitation. Qual Life Res 2012, 21: 1205–1216. 10.1007/s11136-011-0024-3PubMedCrossRef
3.
go back to reference König HH, Roick C, Angermeyer MC: Validity of the EQ-5D in assessing and valuing health status in patients with schizophrenic, schizotypal or delusional disorders. Eur Psychiatry 2007, 22: 177–187. 10.1016/j.eurpsy.2006.08.004PubMedCrossRef König HH, Roick C, Angermeyer MC: Validity of the EQ-5D in assessing and valuing health status in patients with schizophrenic, schizotypal or delusional disorders. Eur Psychiatry 2007, 22: 177–187. 10.1016/j.eurpsy.2006.08.004PubMedCrossRef
4.
go back to reference König HH, Born A, Günther O, Matschinger H, Heinrich S, Riedel-Heller SG, Angermeyer MC, Roick C: Validity and responsiveness of the EQ-5D in assessing and valuing health status in patients with anxiety disorders. Health Qual Life Outcomes 2010, 8: 47. 10.1186/1477-7525-8-47PubMedCentralPubMedCrossRef König HH, Born A, Günther O, Matschinger H, Heinrich S, Riedel-Heller SG, Angermeyer MC, Roick C: Validity and responsiveness of the EQ-5D in assessing and valuing health status in patients with anxiety disorders. Health Qual Life Outcomes 2010, 8: 47. 10.1186/1477-7525-8-47PubMedCentralPubMedCrossRef
5.
go back to reference Hedman E, Andersson E, Ljotsson B, Andersson G, Ruck C, Lindefors N: Cost-effectiveness of Internet-based cognitive behavior therapy vs. cognitive behavioral group therapy for social anxiety disorder: results from a randomized controlled trial. Behav Res Ther 2011, 49: 729–736. 10.1016/j.brat.2011.07.009PubMedCrossRef Hedman E, Andersson E, Ljotsson B, Andersson G, Ruck C, Lindefors N: Cost-effectiveness of Internet-based cognitive behavior therapy vs. cognitive behavioral group therapy for social anxiety disorder: results from a randomized controlled trial. Behav Res Ther 2011, 49: 729–736. 10.1016/j.brat.2011.07.009PubMedCrossRef
6.
go back to reference Sherbourne CD, Sullivan G, Craske MG, Roy-Byrne P, Golinelli D, Rose RD, Chavira DA, Bystritsky A, Stein MB: Functioning and disability levels in primary care out-patients with one or more anxiety disorders. Psychol Med 2010, 40: 2059–2068. 10.1017/S0033291710000176PubMedCentralPubMedCrossRef Sherbourne CD, Sullivan G, Craske MG, Roy-Byrne P, Golinelli D, Rose RD, Chavira DA, Bystritsky A, Stein MB: Functioning and disability levels in primary care out-patients with one or more anxiety disorders. Psychol Med 2010, 40: 2059–2068. 10.1017/S0033291710000176PubMedCentralPubMedCrossRef
7.
go back to reference Saarni SI, Suvisaari J, Sintonen H, Pirkola S, Koskinen S, Aromaa A, Lonnqvist J: Impact of psychiatric disorders on health-related quality of life: general population survey. Br J Psychiatry 2007, 190: 326–332. 10.1192/bjp.bp.106.025106PubMedCrossRef Saarni SI, Suvisaari J, Sintonen H, Pirkola S, Koskinen S, Aromaa A, Lonnqvist J: Impact of psychiatric disorders on health-related quality of life: general population survey. Br J Psychiatry 2007, 190: 326–332. 10.1192/bjp.bp.106.025106PubMedCrossRef
8.
go back to reference Lamers LM, Bouwmans CA, van Straten A, Donker MC, Hakkaart L: Comparison of EQ-5D and SF-6D utilities in mental health patients. Health Econ 2006, 15: 1229–1236. 10.1002/hec.1125PubMedCrossRef Lamers LM, Bouwmans CA, van Straten A, Donker MC, Hakkaart L: Comparison of EQ-5D and SF-6D utilities in mental health patients. Health Econ 2006, 15: 1229–1236. 10.1002/hec.1125PubMedCrossRef
9.
go back to reference Olesen J, Gustavsson A, Svensson M, Wittchen HU, Jonsson B: The economic cost of brain disorders in Europe. Eur J Neurol 2012, 19: 155–162. 10.1111/j.1468-1331.2011.03590.xPubMedCrossRef Olesen J, Gustavsson A, Svensson M, Wittchen HU, Jonsson B: The economic cost of brain disorders in Europe. Eur J Neurol 2012, 19: 155–162. 10.1111/j.1468-1331.2011.03590.xPubMedCrossRef
10.
go back to reference Dimdi: ICD-10-GM 2005 - international statistical classification of diseases and related health problems- German modification 10: revision, version 2005. Köln: Deutscher Ärzte-Verlag; 2005. Dimdi: ICD-10-GM 2005 - international statistical classification of diseases and related health problems- German modification 10: revision, version 2005. Köln: Deutscher Ärzte-Verlag; 2005.
11.
go back to reference American Psychiatric Association: Diagnostic and Statistical Manual of Mental Health Disorders. 4th edition. Washington DC: American Psychiatric Association; 2000. American Psychiatric Association: Diagnostic and Statistical Manual of Mental Health Disorders. 4th edition. Washington DC: American Psychiatric Association; 2000.
12.
go back to reference Magee WJ, Eaton WW, Wittchen HU, McGonagle KA, Kessler RC: Agoraphobia, simple phobia, and social phobia in the National Comorbidity Survey. Arch Gen Psychiatry 1996, 53: 159–168. 10.1001/archpsyc.1996.01830020077009PubMedCrossRef Magee WJ, Eaton WW, Wittchen HU, McGonagle KA, Kessler RC: Agoraphobia, simple phobia, and social phobia in the National Comorbidity Survey. Arch Gen Psychiatry 1996, 53: 159–168. 10.1001/archpsyc.1996.01830020077009PubMedCrossRef
13.
go back to reference DeWit DJ, Ogborne A, Offord DR, MacDonald K: Antecedents of the risk of recovery from DSM-III-R social phobia. Psychol Med 1999, 29: 569–582. 10.1017/S0033291799008399PubMedCrossRef DeWit DJ, Ogborne A, Offord DR, MacDonald K: Antecedents of the risk of recovery from DSM-III-R social phobia. Psychol Med 1999, 29: 569–582. 10.1017/S0033291799008399PubMedCrossRef
14.
go back to reference Canton J, Scott KM, Glue P: Optimal treatment of social phobia: systematic review and meta-analysis. Neuropsychiatr Dis Treat 2012, 8: 203–215.PubMedCentralPubMed Canton J, Scott KM, Glue P: Optimal treatment of social phobia: systematic review and meta-analysis. Neuropsychiatr Dis Treat 2012, 8: 203–215.PubMedCentralPubMed
15.
go back to reference Leichsenring F, Hoyer J, Beutel M, Herpertz S, Hiller W, Irle E, Joraschky P, Konig HH, de Liz TM, Nolting B, et al.: The social phobia psychotherapy research network: the first multicenter randomized controlled trial of psychotherapy for social phobia: rationale, methods and patient characteristics. Psychother Psychosom 2009, 78: 35–41. 10.1159/000162299PubMedCrossRef Leichsenring F, Hoyer J, Beutel M, Herpertz S, Hiller W, Irle E, Joraschky P, Konig HH, de Liz TM, Nolting B, et al.: The social phobia psychotherapy research network: the first multicenter randomized controlled trial of psychotherapy for social phobia: rationale, methods and patient characteristics. Psychother Psychosom 2009, 78: 35–41. 10.1159/000162299PubMedCrossRef
16.
go back to reference Leichsenring F, Salzer S, Beutel ME, Herpertz S, Hiller W, Hoyer J, Huesing J, Joraschky P, Nolting B, Poehlmann K, et al.: Psychodynamic therapy and cognitive-behavioral therapy in social anxiety disorder: a multicenter randomized controlled trial. Am J Psychiatry 2013, 170: 759–767. 10.1176/appi.ajp.2013.12081125PubMedCrossRef Leichsenring F, Salzer S, Beutel ME, Herpertz S, Hiller W, Hoyer J, Huesing J, Joraschky P, Nolting B, Poehlmann K, et al.: Psychodynamic therapy and cognitive-behavioral therapy in social anxiety disorder: a multicenter randomized controlled trial. Am J Psychiatry 2013, 170: 759–767. 10.1176/appi.ajp.2013.12081125PubMedCrossRef
17.
go back to reference Wittchen HU, Zaudig M, Fydrich T: Structured clinical interview for DSM-IV. Goettingen: Hogrefe; 1997. Wittchen HU, Zaudig M, Fydrich T: Structured clinical interview for DSM-IV. Goettingen: Hogrefe; 1997.
18.
go back to reference Mennin DS, Fresco DM, Heimberg RG, Schneier FR, Davies SO, Liebowitz MR: Screening for social anxiety disorder in the clinical setting: using the Liebowitz social anxiety scale. J Anxiety Disord 2002, 16: 661–673. 10.1016/S0887-6185(02)00134-2PubMedCrossRef Mennin DS, Fresco DM, Heimberg RG, Schneier FR, Davies SO, Liebowitz MR: Screening for social anxiety disorder in the clinical setting: using the Liebowitz social anxiety scale. J Anxiety Disord 2002, 16: 661–673. 10.1016/S0887-6185(02)00134-2PubMedCrossRef
19.
go back to reference Brown PAD, David H: Barlow TA: Anxiety disorders interview schedule (ADIS-IV) for DSM-IV: includes clinician manual; ADIS-IV client interview schedule (lifetime version); ADIS-IV client interview schedule (adult version). Oxford: Oxford Univ. Press; 1994. Brown PAD, David H: Barlow TA: Anxiety disorders interview schedule (ADIS-IV) for DSM-IV: includes clinician manual; ADIS-IV client interview schedule (lifetime version); ADIS-IV client interview schedule (adult version). Oxford: Oxford Univ. Press; 1994.
20.
go back to reference Group EQ: EuroQol–a new facility for the measurement of health-related quality of life. The EuroQol Group. Health Policy 1990, 16: 199–208.CrossRef Group EQ: EuroQol–a new facility for the measurement of health-related quality of life. The EuroQol Group. Health Policy 1990, 16: 199–208.CrossRef
21.
go back to reference Greiner W, Claes C, Busschbach JJ, von der Schulenburg JM: Validating the EQ-5D with time trade off for the German population. Eur J Health Econ 2005, 6: 124–130. 10.1007/s10198-004-0264-zPubMedCrossRef Greiner W, Claes C, Busschbach JJ, von der Schulenburg JM: Validating the EQ-5D with time trade off for the German population. Eur J Health Econ 2005, 6: 124–130. 10.1007/s10198-004-0264-zPubMedCrossRef
22.
go back to reference Dolan P: Modeling valuations for EuroQol health states. Med Care 1997, 35: 1095–1108. 10.1097/00005650-199711000-00002PubMedCrossRef Dolan P: Modeling valuations for EuroQol health states. Med Care 1997, 35: 1095–1108. 10.1097/00005650-199711000-00002PubMedCrossRef
24.
go back to reference Turner SM, Beidel DC, Dancu CV, Stanley MA: An empirically derived inventory to measure social fears and anxiety: the social phobia and anxiety inventory. Psychological Assessment 1989, 1: 35–40.CrossRef Turner SM, Beidel DC, Dancu CV, Stanley MA: An empirically derived inventory to measure social fears and anxiety: the social phobia and anxiety inventory. Psychological Assessment 1989, 1: 35–40.CrossRef
25.
go back to reference Fydrich T: SPAI - Social phobia and anxiety inventory. In Diagnostische Verfahren in der Psychotherapie. Edited by: Brähler E, Schumacher J, Straus B. Göttingen: Hogrefe; 2002. Fydrich T: SPAI - Social phobia and anxiety inventory. In Diagnostische Verfahren in der Psychotherapie. Edited by: Brähler E, Schumacher J, Straus B. Göttingen: Hogrefe; 2002.
26.
go back to reference Beck AT, Steer RA, Ball R, Ranieri W: Comparison of beck depression inventories -IA and -II in psychiatric outpatients. J Pers Assess 1996, 67: 588–597. 10.1207/s15327752jpa6703_13PubMedCrossRef Beck AT, Steer RA, Ball R, Ranieri W: Comparison of beck depression inventories -IA and -II in psychiatric outpatients. J Pers Assess 1996, 67: 588–597. 10.1207/s15327752jpa6703_13PubMedCrossRef
27.
go back to reference Luo X, Cappelleri JC: A practical guide on incorporating and evaluating patient-reported outcomes in clinical trials. Clinical Research and Regulatory Affairs 2008, 25: 197–211. 10.1080/10601330802471162CrossRef Luo X, Cappelleri JC: A practical guide on incorporating and evaluating patient-reported outcomes in clinical trials. Clinical Research and Regulatory Affairs 2008, 25: 197–211. 10.1080/10601330802471162CrossRef
28.
go back to reference König HH, Bernert S, Angermeyer MC: Health status of the German population: results of a representative survey using the EuroQol questionnaire. Gesundheitswesen 2005, 67: 173–182. 10.1055/s-2005-857991PubMedCrossRef König HH, Bernert S, Angermeyer MC: Health status of the German population: results of a representative survey using the EuroQol questionnaire. Gesundheitswesen 2005, 67: 173–182. 10.1055/s-2005-857991PubMedCrossRef
29.
go back to reference Walters SJ: Quality of life outcomes in clinical trials and health-care evaluation: a practical guide to analysis and interpretation. Chichester: Wiley; 2009.CrossRef Walters SJ: Quality of life outcomes in clinical trials and health-care evaluation: a practical guide to analysis and interpretation. Chichester: Wiley; 2009.CrossRef
30.
go back to reference Streiner DL, Norman GR: Health measurement scales: a practical guide to their development and use. 4th edition. Oxford; New York: Oxford University Press; 2008.CrossRef Streiner DL, Norman GR: Health measurement scales: a practical guide to their development and use. 4th edition. Oxford; New York: Oxford University Press; 2008.CrossRef
31.
go back to reference Norman GR, Sloan JA, Wyrwich KW: Interpretation of changes in health-related quality of life: the remarkable universality of half a standard deviation. Med Care 2003, 41: 582–592.PubMed Norman GR, Sloan JA, Wyrwich KW: Interpretation of changes in health-related quality of life: the remarkable universality of half a standard deviation. Med Care 2003, 41: 582–592.PubMed
32.
go back to reference Sloan JA, Cella D, Hays RD: Clinical significance of patient-reported questionnaire data: another step toward consensus. J Clin Epidemiol 2005, 58: 1217–1219. 10.1016/j.jclinepi.2005.07.009PubMedCrossRef Sloan JA, Cella D, Hays RD: Clinical significance of patient-reported questionnaire data: another step toward consensus. J Clin Epidemiol 2005, 58: 1217–1219. 10.1016/j.jclinepi.2005.07.009PubMedCrossRef
33.
go back to reference Cohen J: Statistical power analysis for the behavioral sciences. 2nd edition. Hillsdale, N.J: L. Erlbaum Associates; 1988. Cohen J: Statistical power analysis for the behavioral sciences. 2nd edition. Hillsdale, N.J: L. Erlbaum Associates; 1988.
34.
go back to reference Revicki DA, Cella D, Hays RD, Sloan JA, Lenderking WR, Aaronson NK: Responsiveness and minimal important differences for patient reported outcomes. Health Qual Life Outcomes 2006, 4: 70. 10.1186/1477-7525-4-70PubMedCentralPubMedCrossRef Revicki DA, Cella D, Hays RD, Sloan JA, Lenderking WR, Aaronson NK: Responsiveness and minimal important differences for patient reported outcomes. Health Qual Life Outcomes 2006, 4: 70. 10.1186/1477-7525-4-70PubMedCentralPubMedCrossRef
35.
go back to reference Terwee CB, Dekker FW, Wiersinga WM, Prummel MF, Bossuyt PM: On assessing responsiveness of health-related quality of life instruments: guidelines for instrument evaluation. Qual Life Res 2003, 12: 349–362. 10.1023/A:1023499322593PubMedCrossRef Terwee CB, Dekker FW, Wiersinga WM, Prummel MF, Bossuyt PM: On assessing responsiveness of health-related quality of life instruments: guidelines for instrument evaluation. Qual Life Res 2003, 12: 349–362. 10.1023/A:1023499322593PubMedCrossRef
36.
go back to reference Whynes DK, McCahon RA, Ravenscroft A, Hodgkinson V, Evley R, Hardman JG: Responsiveness of the EQ-5D health-related quality-of-life instrument in assessing low back pain. Value Health 2013, 16: 124–132. 10.1016/j.jval.2012.09.003PubMedCrossRef Whynes DK, McCahon RA, Ravenscroft A, Hodgkinson V, Evley R, Hardman JG: Responsiveness of the EQ-5D health-related quality-of-life instrument in assessing low back pain. Value Health 2013, 16: 124–132. 10.1016/j.jval.2012.09.003PubMedCrossRef
37.
go back to reference Husted JA, Cook RJ, Farewell VT, Gladman DD: Methods for assessing responsiveness: a critical review and recommendations. J Clin Epidemiol 2000, 53: 459–468. 10.1016/S0895-4356(99)00206-1PubMedCrossRef Husted JA, Cook RJ, Farewell VT, Gladman DD: Methods for assessing responsiveness: a critical review and recommendations. J Clin Epidemiol 2000, 53: 459–468. 10.1016/S0895-4356(99)00206-1PubMedCrossRef
38.
go back to reference Lehman LA, Velozo CA: Ability to detect change in patient function: responsiveness designs and methods of calculation. J Hand Ther 2010, 23: 361–370. quiz 371 10.1016/j.jht.2010.05.003PubMedCrossRef Lehman LA, Velozo CA: Ability to detect change in patient function: responsiveness designs and methods of calculation. J Hand Ther 2010, 23: 361–370. quiz 371 10.1016/j.jht.2010.05.003PubMedCrossRef
39.
go back to reference Deyo RA, Centor RM: Assessing the responsiveness of functional scales to clinical change: an analogy to diagnostic test performance. J Chronic Dis 1986, 39: 897–906. 10.1016/0021-9681(86)90038-XPubMedCrossRef Deyo RA, Centor RM: Assessing the responsiveness of functional scales to clinical change: an analogy to diagnostic test performance. J Chronic Dis 1986, 39: 897–906. 10.1016/0021-9681(86)90038-XPubMedCrossRef
40.
go back to reference Fawcett T: An introduction to ROC analysis. Pattern Recognit Lett 2006, 27: 861–874. 10.1016/j.patrec.2005.10.010CrossRef Fawcett T: An introduction to ROC analysis. Pattern Recognit Lett 2006, 27: 861–874. 10.1016/j.patrec.2005.10.010CrossRef
Metadata
Title
Reliability, validity and responsiveness of the EQ-5D in assessing and valuing health status in patients with social phobia
Authors
Michael Sonntag
Alexander Konnopka
Falk Leichsenring
Simone Salzer
Manfred E Beutel
Stephan Herpertz
Wolfgang Hiller
Jürgen Hoyer
Peter Joraschky
Björn Nolting
Karin Pöhlmann
Ulrich Stangier
Bernhard Strauss
Ulrike Willutzki
Jörg Wiltink
Eric Leibing
Hans-Helmut König
Publication date
01-12-2013
Publisher
BioMed Central
Published in
Health and Quality of Life Outcomes / Issue 1/2013
Electronic ISSN: 1477-7525
DOI
https://doi.org/10.1186/1477-7525-11-215

Other articles of this Issue 1/2013

Health and Quality of Life Outcomes 1/2013 Go to the issue