Skip to main content
Top
Published in: Clinical Oral Investigations 8/2013

01-11-2013 | Original Article

Insufficient diagnostic accuracy of a single-item questionnaire to detect psychosocial distress in temporomandibular disorder patients

Authors: Daniel R. Reissmann, Mike T. John, Levente Kriston, Oliver Schierz

Published in: Clinical Oral Investigations | Issue 8/2013

Login to get access

Abstract

Objectives

Psychosocial assessment needs to be integrated into the diagnosis of chronic pain conditions; however, it is not clear how this assessment should be performed with minimal patient and health care provider burden. The aim of this study was to assess the diagnostic accuracy of a single-item questionnaire to detect psychosocial distress in temporomandibular disorder (TMD) patients.

Methods

Presence of psychosocial distress was measured in 126 TMD patients using Research Diagnostic Criteria for TMD Axis II measures (depression, somatization, dysfunctional chronic pain). A newly developed single-item questionnaire served as a test to detect psychosocial distress. The association between the presence of distress and test results was analyzed using generalized linear models (GLM). Diagnostic accuracy of the one-item test was assessed.

Results

The GLM revealed a statistically significant association between the presence of psychosocial distress and a positive test result (p < 0.001). Psychosocially distressed patients were 70 % more likely to indicate psychosocial distress in the single-item questionnaire than patients without distress. However, diagnostic test accuracy of the single-item questionnaire was low (sensitivity 73.0 %, specificity 55.7 %). The resulting positive likelihood ratio (1.65) indicated that the single-item test is an inadequate measure for detecting psychosocial distress.

Conclusions

The single-item questionnaire was not sufficiently accurate for detecting TMD patients’ psychosocial distress and may therefore not be useful as an assessment tool for the various dimensions of psychosocial distress in TMD patients.

Clinical relevance

Health care providers should not trust in TMD patients’ responses to a single question regarding psychosocial distress. Nevertheless, this questionnaire may constitute a first step into a more profound patient–provider communication on psychological issues relevant to TMD.
Literature
1.
go back to reference Westman A, Linton SJ, Ohrvik J, Wahlen P, Leppert J (2008) Do psychosocial factors predict disability and health at a 3-year follow-up for patients with non-acute musculoskeletal pain? A validation of the Orebro Musculoskeletal Pain Screening Questionnaire. Eur J Pain 12:641–649PubMedCrossRef Westman A, Linton SJ, Ohrvik J, Wahlen P, Leppert J (2008) Do psychosocial factors predict disability and health at a 3-year follow-up for patients with non-acute musculoskeletal pain? A validation of the Orebro Musculoskeletal Pain Screening Questionnaire. Eur J Pain 12:641–649PubMedCrossRef
2.
go back to reference Reissmann DR, John MT, Wassell RW, Hinz A (2008) Psychosocial profiles of diagnostic subgroups of temporomandibular disorder patients. Eur J Oral Sci 116:237–244PubMedCrossRef Reissmann DR, John MT, Wassell RW, Hinz A (2008) Psychosocial profiles of diagnostic subgroups of temporomandibular disorder patients. Eur J Oral Sci 116:237–244PubMedCrossRef
3.
go back to reference Tversky J, Reade PC, Gerschman JA, Holwill BJ, Wright J (1991) Role of depressive illness in the outcome of treatment of temporomandibular joint pain-dysfunction syndrome. Oral Surg Oral Med Oral Pathol 71:696–699PubMedCrossRef Tversky J, Reade PC, Gerschman JA, Holwill BJ, Wright J (1991) Role of depressive illness in the outcome of treatment of temporomandibular joint pain-dysfunction syndrome. Oral Surg Oral Med Oral Pathol 71:696–699PubMedCrossRef
4.
go back to reference McCreary CP, Clark GT, Oakley ME, Flack V (1992) Predicting response to treatment for temporomandibular disorders. J Craniomandib Disord 6:161–169PubMed McCreary CP, Clark GT, Oakley ME, Flack V (1992) Predicting response to treatment for temporomandibular disorders. J Craniomandib Disord 6:161–169PubMed
5.
go back to reference Yap AU, Chua EK, Tan KB, Chan YH (2004) Relationships between depression/somatization and self-reports of pain and disability. J Orofac Pain 18:220–225PubMed Yap AU, Chua EK, Tan KB, Chan YH (2004) Relationships between depression/somatization and self-reports of pain and disability. J Orofac Pain 18:220–225PubMed
6.
go back to reference Yap AU, Chua EK, Dworkin SF, Tan HH, Tan KB (2002) Multiple pains and psychosocial functioning/psychologic distress in TMD patients. Int J Prosthodont 15:461–466PubMed Yap AU, Chua EK, Dworkin SF, Tan HH, Tan KB (2002) Multiple pains and psychosocial functioning/psychologic distress in TMD patients. Int J Prosthodont 15:461–466PubMed
7.
go back to reference Scherer M, Himmel W, Stanske B et al (2007) Psychological distress in primary care patients with heart failure: a longitudinal study. Br J Gen Pract 57:801–807PubMed Scherer M, Himmel W, Stanske B et al (2007) Psychological distress in primary care patients with heart failure: a longitudinal study. Br J Gen Pract 57:801–807PubMed
9.
go back to reference Fink P, Sorensen L, Engberg M, Holm M, Munk-Jorgensen P (1999) Somatization in primary care. Prevalence, health care utilization, and general practitioner recognition. Psychosomatics 40:330–338PubMedCrossRef Fink P, Sorensen L, Engberg M, Holm M, Munk-Jorgensen P (1999) Somatization in primary care. Prevalence, health care utilization, and general practitioner recognition. Psychosomatics 40:330–338PubMedCrossRef
10.
go back to reference Nordstrom A, Bodlund O (2008) Every third patient in primary care suffers from depression, anxiety or alcohol problems. Nord J Psychiatry 62:250–255PubMedCrossRef Nordstrom A, Bodlund O (2008) Every third patient in primary care suffers from depression, anxiety or alcohol problems. Nord J Psychiatry 62:250–255PubMedCrossRef
11.
go back to reference Fink P, Jensen J, Borgquist L et al (1995) Psychiatric morbidity in primary public health care: a Nordic multicentre investigation. Part I: method and prevalence of psychiatric morbidity. Acta Psychiatr Scand 92:409–418PubMedCrossRef Fink P, Jensen J, Borgquist L et al (1995) Psychiatric morbidity in primary public health care: a Nordic multicentre investigation. Part I: method and prevalence of psychiatric morbidity. Acta Psychiatr Scand 92:409–418PubMedCrossRef
12.
go back to reference Becker SM (2004) Detection of somatization and depression in primary care in Saudi Arabia. Soc Psychiatry Psychiatr Epidemiol 39:962–966PubMedCrossRef Becker SM (2004) Detection of somatization and depression in primary care in Saudi Arabia. Soc Psychiatry Psychiatr Epidemiol 39:962–966PubMedCrossRef
13.
go back to reference Eisenberg L (1992) Treating depression and anxiety in primary care. Closing the gap between knowledge and practice. N Engl J Med 326:1080–1084PubMedCrossRef Eisenberg L (1992) Treating depression and anxiety in primary care. Closing the gap between knowledge and practice. N Engl J Med 326:1080–1084PubMedCrossRef
14.
go back to reference Higgins ES (1994) A review of unrecognized mental illness in primary care. Prevalence, natural history, and efforts to change the course. Arch Fam Med 3:908–917PubMedCrossRef Higgins ES (1994) A review of unrecognized mental illness in primary care. Prevalence, natural history, and efforts to change the course. Arch Fam Med 3:908–917PubMedCrossRef
15.
go back to reference Derogatis LR, Lipman RS, Covi L (1973) SCL-90: an outpatient psychiatric rating scale—preliminary report. Psychopharmacol Bull 9:13–28PubMed Derogatis LR, Lipman RS, Covi L (1973) SCL-90: an outpatient psychiatric rating scale—preliminary report. Psychopharmacol Bull 9:13–28PubMed
16.
go back to reference Beck AT, Steer RA (1987) Beck depression inventory—manual. The Psychological Association, San Antonio Beck AT, Steer RA (1987) Beck depression inventory—manual. The Psychological Association, San Antonio
17.
go back to reference Kroenke K, Spitzer RL, Williams JB (2001) The PHQ-9: validity of a brief depression severity measure. J Gen Intern Med 16:606–613PubMedCrossRef Kroenke K, Spitzer RL, Williams JB (2001) The PHQ-9: validity of a brief depression severity measure. J Gen Intern Med 16:606–613PubMedCrossRef
18.
go back to reference Von Korff M, Ormel J, Keefe FJ, Dworkin SF (1992) Grading the severity of chronic pain. Pain 50:133–149CrossRef Von Korff M, Ormel J, Keefe FJ, Dworkin SF (1992) Grading the severity of chronic pain. Pain 50:133–149CrossRef
19.
go back to reference Linton SJ, Hallden K (1998) Can we screen for problematic back pain? A screening questionnaire for predicting outcome in acute and subacute back pain. Clin J Pain 14:209–215PubMedCrossRef Linton SJ, Hallden K (1998) Can we screen for problematic back pain? A screening questionnaire for predicting outcome in acute and subacute back pain. Clin J Pain 14:209–215PubMedCrossRef
20.
go back to reference Hill JC, Dunn KM, Lewis M et al (2008) A primary care back pain screening tool: identifying patient subgroups for initial treatment. Arthritis Rheum 59:632–641PubMedCrossRef Hill JC, Dunn KM, Lewis M et al (2008) A primary care back pain screening tool: identifying patient subgroups for initial treatment. Arthritis Rheum 59:632–641PubMedCrossRef
21.
go back to reference Main CJ, Wood PL, Hollis S, Spanswick CC, Waddell G (1992) The Distress and Risk Assessment Method. A simple patient classification to identify distress and evaluate the risk of poor outcome. Spine (Phila Pa 1976) 17:42–52CrossRef Main CJ, Wood PL, Hollis S, Spanswick CC, Waddell G (1992) The Distress and Risk Assessment Method. A simple patient classification to identify distress and evaluate the risk of poor outcome. Spine (Phila Pa 1976) 17:42–52CrossRef
22.
go back to reference Apeldoorn AT, Bosselaar H, Ostelo RW et al (2012) Identification of patients with chronic low back pain who might benefit from additional psychological assessment. Clin J Pain 28:23–31PubMedCrossRef Apeldoorn AT, Bosselaar H, Ostelo RW et al (2012) Identification of patients with chronic low back pain who might benefit from additional psychological assessment. Clin J Pain 28:23–31PubMedCrossRef
23.
go back to reference Löwe B, Kroenke K, Grafe K (2005) Detecting and monitoring depression with a two-item questionnaire (PHQ-2). J Psychosom Res 58:163–171PubMedCrossRef Löwe B, Kroenke K, Grafe K (2005) Detecting and monitoring depression with a two-item questionnaire (PHQ-2). J Psychosom Res 58:163–171PubMedCrossRef
24.
go back to reference Kriston L, Holzel L, Weiser AK, Berner MM, Harter M (2008) Meta-analysis: are 3 questions enough to detect unhealthy alcohol use? Ann Intern Med 149:879–888PubMedCrossRef Kriston L, Holzel L, Weiser AK, Berner MM, Harter M (2008) Meta-analysis: are 3 questions enough to detect unhealthy alcohol use? Ann Intern Med 149:879–888PubMedCrossRef
25.
go back to reference Bowling A (2005) Just one question: If one question works, why ask several? J Epidemiol Community Health 59:342–345PubMedCrossRef Bowling A (2005) Just one question: If one question works, why ask several? J Epidemiol Community Health 59:342–345PubMedCrossRef
26.
go back to reference Cunny KA, Perri M 3rd (1991) Single-item vs multiple-item measures of health-related quality of life. Psychol Rep 69:127–130PubMed Cunny KA, Perri M 3rd (1991) Single-item vs multiple-item measures of health-related quality of life. Psychol Rep 69:127–130PubMed
27.
go back to reference Mitchell AJ (2007) Pooled results from 38 analyses of the accuracy of distress thermometer and other ultra-short methods of detecting cancer-related mood disorders. J Clin Oncol 25:4670–4681PubMedCrossRef Mitchell AJ (2007) Pooled results from 38 analyses of the accuracy of distress thermometer and other ultra-short methods of detecting cancer-related mood disorders. J Clin Oncol 25:4670–4681PubMedCrossRef
28.
go back to reference Milton K, Bull FC, Bauman A (2011) Reliability and validity testing of a single-item physical activity measure. Br J Sports Med 45:203–208PubMedCrossRef Milton K, Bull FC, Bauman A (2011) Reliability and validity testing of a single-item physical activity measure. Br J Sports Med 45:203–208PubMedCrossRef
29.
go back to reference Kriston L, Gunzler C, Rohde A, Berner MM (2010) Is one question enough to detect female sexual dysfunctions? A diagnostic accuracy study in 6,194 women. J Sex Med 7:1831–1841PubMedCrossRef Kriston L, Gunzler C, Rohde A, Berner MM (2010) Is one question enough to detect female sexual dysfunctions? A diagnostic accuracy study in 6,194 women. J Sex Med 7:1831–1841PubMedCrossRef
30.
go back to reference Cook C, Cleland J, Huijbregts P (2007) Creation and critique of studies of diagnostic accuracy: use of the STARD and QUADAS methodological quality assessment tools. J Man Manip Ther 15:93–102PubMedCrossRef Cook C, Cleland J, Huijbregts P (2007) Creation and critique of studies of diagnostic accuracy: use of the STARD and QUADAS methodological quality assessment tools. J Man Manip Ther 15:93–102PubMedCrossRef
31.
go back to reference John MT, Hirsch C, Reiber T, Dworkin S (2006) Translating the research diagnostic criteria for temporomandibular disorders into German: evaluation of content and process. J Orofac Pain 20:43–52PubMed John MT, Hirsch C, Reiber T, Dworkin S (2006) Translating the research diagnostic criteria for temporomandibular disorders into German: evaluation of content and process. J Orofac Pain 20:43–52PubMed
32.
go back to reference Dworkin SF, LeResche L (1992) Research diagnostic criteria for temporomandibular disorders: review, criteria, examinations and specifications, critique. J Craniomandib Disord 6:301–355PubMed Dworkin SF, LeResche L (1992) Research diagnostic criteria for temporomandibular disorders: review, criteria, examinations and specifications, critique. J Craniomandib Disord 6:301–355PubMed
33.
go back to reference Kröner-Herwig B, Denecke H, Glier B et al (1996) Qualitätssicherung in der Therapie chronischen Schmerzes. Ergebnisse einer Arbeitsgruppe der Deutschen Gesellschaft zum Studium des Schmerzes (DGSS) zur psychologischen Diagnostik. IX. Multidimensionale Verfahren zur Erfassung schmerzrelevanter Aspekte und Empfehlungen zur Standarddiagnostik. Schmerz 10:47–52PubMedCrossRef Kröner-Herwig B, Denecke H, Glier B et al (1996) Qualitätssicherung in der Therapie chronischen Schmerzes. Ergebnisse einer Arbeitsgruppe der Deutschen Gesellschaft zum Studium des Schmerzes (DGSS) zur psychologischen Diagnostik. IX. Multidimensionale Verfahren zur Erfassung schmerzrelevanter Aspekte und Empfehlungen zur Standarddiagnostik. Schmerz 10:47–52PubMedCrossRef
34.
go back to reference Hautzinger M, Bailer M (1995) Allgemeine Depressionsskala (ADS). Beltz, Weinheim Hautzinger M, Bailer M (1995) Allgemeine Depressionsskala (ADS). Beltz, Weinheim
35.
go back to reference Radloff L (1977) The CES-D scale: a self-report depression scale for research in the general population. Appl Psychol Meas 1:385–401CrossRef Radloff L (1977) The CES-D scale: a self-report depression scale for research in the general population. Appl Psychol Meas 1:385–401CrossRef
36.
go back to reference Von Zerssen D (1976) Die Beschwerden-Liste. Beltz, Weinheim Von Zerssen D (1976) Die Beschwerden-Liste. Beltz, Weinheim
37.
go back to reference Dworkin SF, Sherman J, Mancl L, Ohrbach R, LeResche L, Truelove E (2002) Reliability, validity, and clinical utility of the Research Diagnostic Criteria for Temporomandibular Disorders Axis II Scales: depression, non-specific physical symptoms, and graded chronic pain. J Orofac Pain 16:207–220PubMed Dworkin SF, Sherman J, Mancl L, Ohrbach R, LeResche L, Truelove E (2002) Reliability, validity, and clinical utility of the Research Diagnostic Criteria for Temporomandibular Disorders Axis II Scales: depression, non-specific physical symptoms, and graded chronic pain. J Orofac Pain 16:207–220PubMed
38.
go back to reference John MT, Zwijnenburg AJ (2001) Interobserver variability in assessment of signs of TMD. Int J Prosthodont 14:265–270PubMed John MT, Zwijnenburg AJ (2001) Interobserver variability in assessment of signs of TMD. Int J Prosthodont 14:265–270PubMed
39.
go back to reference Schmitter M, Ohlmann B, John MT, Hirsch C, Rammelsberg P (2005) Research Diagnostic Criteria for Temporomandibular Disorders: a calibration and reliability study. Cranio 23:212–218PubMed Schmitter M, Ohlmann B, John MT, Hirsch C, Rammelsberg P (2005) Research Diagnostic Criteria for Temporomandibular Disorders: a calibration and reliability study. Cranio 23:212–218PubMed
41.
go back to reference McGee S (2002) Simlipfying likelihood ratios. J Gen Intern Med 17:647–650CrossRef McGee S (2002) Simlipfying likelihood ratios. J Gen Intern Med 17:647–650CrossRef
42.
go back to reference Jaeschke R, Guyatt GH, Sackett DL (1994) User's guide to the medical literature. III. How to use an article about a diagnostic test. B. What are the results and will they help me in caring for my patients? J Am Med Assoc 271:703–707CrossRef Jaeschke R, Guyatt GH, Sackett DL (1994) User's guide to the medical literature. III. How to use an article about a diagnostic test. B. What are the results and will they help me in caring for my patients? J Am Med Assoc 271:703–707CrossRef
43.
go back to reference Kirmayer LJ, Robbins JM (1996) Patients who somatize in primary care: a longitudinal study of cognitive and social characteristics. Psychol Med 26:937–951PubMedCrossRef Kirmayer LJ, Robbins JM (1996) Patients who somatize in primary care: a longitudinal study of cognitive and social characteristics. Psychol Med 26:937–951PubMedCrossRef
44.
go back to reference Gatchel RJ (2004) Psychosocial factors that can influence the self-assessment of function. J Occup Rehabil 14:197–206PubMedCrossRef Gatchel RJ (2004) Psychosocial factors that can influence the self-assessment of function. J Occup Rehabil 14:197–206PubMedCrossRef
45.
go back to reference Hayward P, Bright JA (1997) Stigma and mental illness: a review and critique. J Ment Health 6:345–354CrossRef Hayward P, Bright JA (1997) Stigma and mental illness: a review and critique. J Ment Health 6:345–354CrossRef
46.
go back to reference Barney LJ, Griffiths KM, Jorm AF, Christensen H (2006) Stigma about depression and its impact on help-seeking intentions. Aust N Z J Psychiatry 40:51–54PubMedCrossRef Barney LJ, Griffiths KM, Jorm AF, Christensen H (2006) Stigma about depression and its impact on help-seeking intentions. Aust N Z J Psychiatry 40:51–54PubMedCrossRef
47.
go back to reference Lobbezoo F, van Selms MK, John MT et al (2005) Use of the Research Diagnostic Criteria for Temporomandibular Disorders for multinational research: translation efforts and reliability assessments in The Netherlands. J Orofac Pain 19:301–308PubMed Lobbezoo F, van Selms MK, John MT et al (2005) Use of the Research Diagnostic Criteria for Temporomandibular Disorders for multinational research: translation efforts and reliability assessments in The Netherlands. J Orofac Pain 19:301–308PubMed
48.
go back to reference Wolf E, Petersson K, Petersson A, Nilner M (2001) Long-lasting orofacial pain—a study of 109 consecutive patients referred to a pain group. Swed Dent J 25:129–136PubMed Wolf E, Petersson K, Petersson A, Nilner M (2001) Long-lasting orofacial pain—a study of 109 consecutive patients referred to a pain group. Swed Dent J 25:129–136PubMed
49.
go back to reference Manfredini D, Borella L, Favero L, Ferronato G, Guarda-Nardini L (2010) Chronic pain severity and depression/somatization levels in TMD patients. Int J Prosthodont 23:529–534PubMed Manfredini D, Borella L, Favero L, Ferronato G, Guarda-Nardini L (2010) Chronic pain severity and depression/somatization levels in TMD patients. Int J Prosthodont 23:529–534PubMed
50.
go back to reference Yap AU, Tan KB, Chua EK, Tan HH (2002) Depression and somatization in patients with temporomandibular disorders. J Prosthet Dent 88:479–484PubMedCrossRef Yap AU, Tan KB, Chua EK, Tan HH (2002) Depression and somatization in patients with temporomandibular disorders. J Prosthet Dent 88:479–484PubMedCrossRef
51.
go back to reference Pandey M, Devi N, Thomas BC, Kumar SV, Krishnan R, Ramdas K (2007) Distress overlaps with anxiety and depression in patients with head and neck cancer. Psychooncology 16:582–586PubMedCrossRef Pandey M, Devi N, Thomas BC, Kumar SV, Krishnan R, Ramdas K (2007) Distress overlaps with anxiety and depression in patients with head and neck cancer. Psychooncology 16:582–586PubMedCrossRef
52.
go back to reference Weissman MM, Sholomskas D, Pottenger M, Prusoff BA, Locke BZ (1977) Assessing depressive symptoms in five psychiatric populations: a validation study. Am J Epidemiol 106:203–214PubMed Weissman MM, Sholomskas D, Pottenger M, Prusoff BA, Locke BZ (1977) Assessing depressive symptoms in five psychiatric populations: a validation study. Am J Epidemiol 106:203–214PubMed
53.
go back to reference Wool CA, Barsky AJ (1994) Do women somatize more than men? Gender differences in somatization. Psychosomatics 35:445–452PubMedCrossRef Wool CA, Barsky AJ (1994) Do women somatize more than men? Gender differences in somatization. Psychosomatics 35:445–452PubMedCrossRef
54.
go back to reference John MT, Selle D (1998) Assessment of personality traits in patients with craniomandibular disorders. Dtsch Zahnarztl Z 8:547–550 John MT, Selle D (1998) Assessment of personality traits in patients with craniomandibular disorders. Dtsch Zahnarztl Z 8:547–550
55.
go back to reference Löwe B, Wahl I, Rose M et al (2010) A 4-item measure of depression and anxiety: validation and standardization of the Patient Health Questionnaire-4 (PHQ-4) in the general population. J Affect Disord 122:86–95PubMedCrossRef Löwe B, Wahl I, Rose M et al (2010) A 4-item measure of depression and anxiety: validation and standardization of the Patient Health Questionnaire-4 (PHQ-4) in the general population. J Affect Disord 122:86–95PubMedCrossRef
Metadata
Title
Insufficient diagnostic accuracy of a single-item questionnaire to detect psychosocial distress in temporomandibular disorder patients
Authors
Daniel R. Reissmann
Mike T. John
Levente Kriston
Oliver Schierz
Publication date
01-11-2013
Publisher
Springer Berlin Heidelberg
Published in
Clinical Oral Investigations / Issue 8/2013
Print ISSN: 1432-6981
Electronic ISSN: 1436-3771
DOI
https://doi.org/10.1007/s00784-012-0892-0

Other articles of this Issue 8/2013

Clinical Oral Investigations 8/2013 Go to the issue