Skip to main content
Top
Published in: BMC Psychiatry 1/2013

Open Access 01-12-2013 | Research article

The development and validation of the Questionnaire on Anticipated Discrimination (QUAD)

Authors: Jheanell Gabbidon, Elaine Brohan, Sarah Clement, R Claire Henderson, Graham Thornicroft, MIRIAD Study Group

Published in: BMC Psychiatry | Issue 1/2013

Login to get access

Abstract

Background

The anticipation of mental health-related discrimination is common amongst people with mental health problems and can have serious adverse effects. This study aimed to develop and validate a measure assessing the extent to which people with mental health problems anticipate that they will personally experience discrimination across a range of contexts.

Methods

The items and format for the Questionnaire on Anticipated Discrimination (QUAD) were developed from previous versions of the Discrimination and Stigma Scale (DISC), focus groups and cognitive debriefing interviews which were used to further refine the content and format. The resulting provisional version of the QUAD was completed by 117 service users in an online survey and reliability, validity, precision and acceptability were assessed. A final version of the scale was agreed and analyses re-run using the online survey data and data from an independent sample to report the psychometric properties of the finalised scale.

Results

The provisional version of the QUAD had 17 items, good internal consistency (alpha = 0.86) and adequate convergent validity as supported by the significant positive correlations with the Stigma Scale (SS) (r = 0.40, p < 0.001) and the Internalised Stigma of Mental Illness Scale (ISMI) (r = 0.40, p < 0.001). Three items were removed due to low endorsements, high inter-correlation or conceptual concerns. The finalised 14 item QUAD had good internal consistency (alpha = 0.86), good test re-test reliability (ρc = 0.81) and adequate convergent validity: correlations with the ISMI (r = 0.45, p < 0.001) and with the SS (r = 0.39, p < 0.001). Reading ease scores indicated good acceptability for general adult populations. Cross-replication in an independent sample further indicated good internal consistency (alpha = 0.88), adequate convergent validity and revealed two factors summarised by institutions/services and interpersonal/professional relationships.

Conclusions

The QUAD expanded upon previous versions of the DISC. It is a reliable, valid and acceptable measure which can be used to identify key life areas in which people may personally anticipate discrimination, and an overall tendency to anticipate discrimination. It may also be useful in planning interventions aimed at reducing the stigma of mental illness.
Appendix
Available only for authorised users
Literature
1.
go back to reference Goffman E: Stigma: Notes on the Management of Spoiled Identity. 1963, Harmondsworth, Middlesex: Penguin Books Goffman E: Stigma: Notes on the Management of Spoiled Identity. 1963, Harmondsworth, Middlesex: Penguin Books
2.
go back to reference Link BG, Struening E, Cullen FT, Shrout PE, Dohrenwend BP: A modified labeling theory approach to mental disorders - an empirical assessment. Am Sociol Rev. 1989, 54 (3): 400-423. 10.2307/2095613.CrossRef Link BG, Struening E, Cullen FT, Shrout PE, Dohrenwend BP: A modified labeling theory approach to mental disorders - an empirical assessment. Am Sociol Rev. 1989, 54 (3): 400-423. 10.2307/2095613.CrossRef
3.
go back to reference Link BG, Phelan JC: Conceptualizing stigma. Annu Rev Sociol. 2001, 27: 363-385. 10.1146/annurev.soc.27.1.363.CrossRef Link BG, Phelan JC: Conceptualizing stigma. Annu Rev Sociol. 2001, 27: 363-385. 10.1146/annurev.soc.27.1.363.CrossRef
4.
go back to reference Evans-Lacko S, Brohan E, Mojtabai R, Thornicroft G: Association between public views of mental illness and self-stigma among individuals with mental illness in 14 European countries. Psychol Med. 2012, 42 (8): 1741-1752. 10.1017/S0033291711002558.CrossRefPubMed Evans-Lacko S, Brohan E, Mojtabai R, Thornicroft G: Association between public views of mental illness and self-stigma among individuals with mental illness in 14 European countries. Psychol Med. 2012, 42 (8): 1741-1752. 10.1017/S0033291711002558.CrossRefPubMed
5.
go back to reference Link BG, Cullen FT, Frank J, Wozniak JF: The social rejection of former mental patients - understanding why labels matter. Am J Sociol. 1987, 92 (6): 1461-1500. 10.1086/228672.CrossRef Link BG, Cullen FT, Frank J, Wozniak JF: The social rejection of former mental patients - understanding why labels matter. Am J Sociol. 1987, 92 (6): 1461-1500. 10.1086/228672.CrossRef
6.
go back to reference Thornicroft G, Brohan E, Rose D, Sartorius N, Leese M, Grp IS: Global pattern of experienced and anticipated discrimination against people with schizophrenia: a cross-sectional survey. Lancet. 2009, 373 (9661): 408-415. 10.1016/S0140-6736(08)61817-6.CrossRefPubMed Thornicroft G, Brohan E, Rose D, Sartorius N, Leese M, Grp IS: Global pattern of experienced and anticipated discrimination against people with schizophrenia: a cross-sectional survey. Lancet. 2009, 373 (9661): 408-415. 10.1016/S0140-6736(08)61817-6.CrossRefPubMed
7.
go back to reference Corker E, Henderson C, Thornicroft G: The Viewpoint discrimination survey - the extent of discrimination faced by mental health service users in England. Psychiatr Prax. 2011, 38 ((S 01)): S09_1_RE- Corker E, Henderson C, Thornicroft G: The Viewpoint discrimination survey - the extent of discrimination faced by mental health service users in England. Psychiatr Prax. 2011, 38 ((S 01)): S09_1_RE-
8.
go back to reference Angermeyer MC, Beck M, Dietrich S, Holzinger A: The stigma of mental illness: patients’ anticipations and experiences. Int J Soc Psychiatr. 2004, 50 (2): 153-162. 10.1177/0020764004043115.CrossRef Angermeyer MC, Beck M, Dietrich S, Holzinger A: The stigma of mental illness: patients’ anticipations and experiences. Int J Soc Psychiatr. 2004, 50 (2): 153-162. 10.1177/0020764004043115.CrossRef
9.
go back to reference Ucok A, Brohan E, Rose D, Sartorius N, Leese M, Yoon CK, Plooy A, Ertekin BA, Milev R, Thornicroft G, et al: Anticipated discrimination among people with schizophrenia. Acta Psychiatr Scand. 2012, 125 (1): 77-83. 10.1111/j.1600-0447.2011.01772.x.CrossRefPubMed Ucok A, Brohan E, Rose D, Sartorius N, Leese M, Yoon CK, Plooy A, Ertekin BA, Milev R, Thornicroft G, et al: Anticipated discrimination among people with schizophrenia. Acta Psychiatr Scand. 2012, 125 (1): 77-83. 10.1111/j.1600-0447.2011.01772.x.CrossRefPubMed
10.
go back to reference Lasalvia A, Zoppei S, Van Bortel T, Bonetto C, Cristofalo D, Wahlbeck K, Bacle SV, Van Audenhove C, van Weeghel J, Reneses B: Global pattern of experienced and anticipated discrimination reported by people with major depressive disorder: a cross-sectional survey. The Lancet. 2012, 381 (9860): 55-62.CrossRef Lasalvia A, Zoppei S, Van Bortel T, Bonetto C, Cristofalo D, Wahlbeck K, Bacle SV, Van Audenhove C, van Weeghel J, Reneses B: Global pattern of experienced and anticipated discrimination reported by people with major depressive disorder: a cross-sectional survey. The Lancet. 2012, 381 (9860): 55-62.CrossRef
11.
go back to reference Schomerus G, Matschinger H, Angermeyer MC: The stigma of psychiatric treatment and help-seeking intentions for depression. Eur Arch Psychiatry Clin Neurosci. 2009, 259 (5): 298-306. 10.1007/s00406-009-0870-y.CrossRefPubMed Schomerus G, Matschinger H, Angermeyer MC: The stigma of psychiatric treatment and help-seeking intentions for depression. Eur Arch Psychiatry Clin Neurosci. 2009, 259 (5): 298-306. 10.1007/s00406-009-0870-y.CrossRefPubMed
12.
go back to reference Link BG: Understanding labeling effects in the area of mental disorders - an assessment of the effects of expectations of rejection. Am Sociol Rev. 1987, 52 (1): 96-112. 10.2307/2095395.CrossRef Link BG: Understanding labeling effects in the area of mental disorders - an assessment of the effects of expectations of rejection. Am Sociol Rev. 1987, 52 (1): 96-112. 10.2307/2095395.CrossRef
13.
go back to reference Link BG, Yang LH, Phelan JC, Collins PY: Measuring mental illness stigma. Schizophr Bull. 2004, 30 (3): 511-541. 10.1093/oxfordjournals.schbul.a007098.CrossRefPubMed Link BG, Yang LH, Phelan JC, Collins PY: Measuring mental illness stigma. Schizophr Bull. 2004, 30 (3): 511-541. 10.1093/oxfordjournals.schbul.a007098.CrossRefPubMed
14.
go back to reference King M, Dinos S, Shaw J, Watson R, Stevens S, Passetti F, Weich S, Serfaty M: The stigma scale: development of a standardised measure of the stigma of mental illness. Brit J Psychiat. 2007, 190: 248-254. 10.1192/bjp.bp.106.024638.CrossRefPubMed King M, Dinos S, Shaw J, Watson R, Stevens S, Passetti F, Weich S, Serfaty M: The stigma scale: development of a standardised measure of the stigma of mental illness. Brit J Psychiat. 2007, 190: 248-254. 10.1192/bjp.bp.106.024638.CrossRefPubMed
15.
go back to reference Ritsher JB, Otilingam PG, Grajales M: Internalized stigma of mental illness: psychometric properties of a new measure. Psychiatry Res. 2003, 121 (1): 31-49. 10.1016/j.psychres.2003.08.008.CrossRefPubMed Ritsher JB, Otilingam PG, Grajales M: Internalized stigma of mental illness: psychometric properties of a new measure. Psychiatry Res. 2003, 121 (1): 31-49. 10.1016/j.psychres.2003.08.008.CrossRefPubMed
16.
go back to reference Walter SD, Eliasziw M, Donner A: Sample size and optimal designs for reliability studies. Stat Med. 1998, 17 (1): 101-110. 10.1002/(SICI)1097-0258(19980115)17:1<101::AID-SIM727>3.0.CO;2-E.CrossRefPubMed Walter SD, Eliasziw M, Donner A: Sample size and optimal designs for reliability studies. Stat Med. 1998, 17 (1): 101-110. 10.1002/(SICI)1097-0258(19980115)17:1<101::AID-SIM727>3.0.CO;2-E.CrossRefPubMed
18.
go back to reference Brohan E, Clement S, Rose D, Sartorius N, Slade M, Thornicroft G: Development and psychometric evaluation of the Discrimination and Stigma Scale (DISC). Psychiatry Res. 2013, 208: 33-40. 10.1016/j.psychres.2013.03.007.CrossRefPubMed Brohan E, Clement S, Rose D, Sartorius N, Slade M, Thornicroft G: Development and psychometric evaluation of the Discrimination and Stigma Scale (DISC). Psychiatry Res. 2013, 208: 33-40. 10.1016/j.psychres.2013.03.007.CrossRefPubMed
19.
go back to reference Jeffery D, Clement S, Corker E, Howard LM, Murray J, Thornicroft G: Discrimination in relation to parenthood reported by community psychiatric service users in the UK: a framework analysis. Bmc Psychiat. 2013, 13 (1): 120-10.1186/1471-244X-13-120.CrossRef Jeffery D, Clement S, Corker E, Howard LM, Murray J, Thornicroft G: Discrimination in relation to parenthood reported by community psychiatric service users in the UK: a framework analysis. Bmc Psychiat. 2013, 13 (1): 120-10.1186/1471-244X-13-120.CrossRef
20.
go back to reference Clement S, Brohan E, Sayce L, Pool J, Thornicroft G: Disability hate crime and targeted violence and hostility: a mental health and discrimination perspective. J Ment Health. 2011, 20 (3): 219-225. 10.3109/09638237.2011.579645.CrossRefPubMed Clement S, Brohan E, Sayce L, Pool J, Thornicroft G: Disability hate crime and targeted violence and hostility: a mental health and discrimination perspective. J Ment Health. 2011, 20 (3): 219-225. 10.3109/09638237.2011.579645.CrossRefPubMed
21.
go back to reference Ojanen V, Gogates G: A briefing on cognitive debriefing good. Clin Pract J. 2006, 13 (12): 25-29. Ojanen V, Gogates G: A briefing on cognitive debriefing good. Clin Pract J. 2006, 13 (12): 25-29.
22.
go back to reference Clement S, Brohan E, Jeffery D, Henderson C, Hatch SL, Thornicroft G: Development and psychometric properties the Barriers to Access to Care Evaluation scale (BACE) related to people with mental ill health. Bmc Psychiat. 2012, 12 (1): 36-10.1186/1471-244X-12-36.CrossRef Clement S, Brohan E, Jeffery D, Henderson C, Hatch SL, Thornicroft G: Development and psychometric properties the Barriers to Access to Care Evaluation scale (BACE) related to people with mental ill health. Bmc Psychiat. 2012, 12 (1): 36-10.1186/1471-244X-12-36.CrossRef
23.
go back to reference Cronbach LJ: Coefficient alpha and the internal structure of tests. Psychometrika. 1951, 16 (3): 297-334. 10.1007/BF02310555.CrossRef Cronbach LJ: Coefficient alpha and the internal structure of tests. Psychometrika. 1951, 16 (3): 297-334. 10.1007/BF02310555.CrossRef
24.
go back to reference Landis JR, Koch GG: Measurement of observer agreement for categorical data. Biometrics. 1977, 33 (1): 159-174. 10.2307/2529310.CrossRefPubMed Landis JR, Koch GG: Measurement of observer agreement for categorical data. Biometrics. 1977, 33 (1): 159-174. 10.2307/2529310.CrossRefPubMed
25.
go back to reference Cohen J: A coefficient of agreement for nominal scales. Educ Psychol Meas. 1960, 20 (1): 37-46. 10.1177/001316446002000104.CrossRef Cohen J: A coefficient of agreement for nominal scales. Educ Psychol Meas. 1960, 20 (1): 37-46. 10.1177/001316446002000104.CrossRef
26.
go back to reference Lin LI: A concordance correlation-coefficient to evaluate reproducibility. Biometrics. 1989, 45 (1): 255-268. 10.2307/2532051.CrossRefPubMed Lin LI: A concordance correlation-coefficient to evaluate reproducibility. Biometrics. 1989, 45 (1): 255-268. 10.2307/2532051.CrossRefPubMed
27.
go back to reference Chassany O, Sagnier P, Marquis P, Fullerton S, Aaronson N: European issues quality life a: patient-reported outcomes: the example of health-related quality of life - A European guidance document for the improved integration of health-related quality of life assessment in the drug regulatory process. Drug Inf J. 2002, 36 (1): 209-238. 10.1177/009286150203600127.CrossRef Chassany O, Sagnier P, Marquis P, Fullerton S, Aaronson N: European issues quality life a: patient-reported outcomes: the example of health-related quality of life - A European guidance document for the improved integration of health-related quality of life assessment in the drug regulatory process. Drug Inf J. 2002, 36 (1): 209-238. 10.1177/009286150203600127.CrossRef
28.
go back to reference Everitt B: Multivariate analysis: the need for data, and other problems. Br J Psychiatry. 1975, 126 (3): 237-240. 10.1192/bjp.126.3.237.CrossRefPubMed Everitt B: Multivariate analysis: the need for data, and other problems. Br J Psychiatry. 1975, 126 (3): 237-240. 10.1192/bjp.126.3.237.CrossRefPubMed
29.
go back to reference Nunnally JC: Psychometric theory. 1978, New York: McGraw-Hill, 2 Nunnally JC: Psychometric theory. 1978, New York: McGraw-Hill, 2
30.
go back to reference Velicer WF, Jackson DN: Component analysis versus common factor analysis: some further observations. Multivar Behav Res. 1990, 25 (1): 97-114. 10.1207/s15327906mbr2501_12.CrossRef Velicer WF, Jackson DN: Component analysis versus common factor analysis: some further observations. Multivar Behav Res. 1990, 25 (1): 97-114. 10.1207/s15327906mbr2501_12.CrossRef
31.
go back to reference Costello A, Osborne J: Best practices in exploratory factor analysis: four recommendations for getting the most from your analysis. Pract Assess Res Eval 2005. 2011, 10: 7-pareonline net/getvn asp 2011, 10:7 Costello A, Osborne J: Best practices in exploratory factor analysis: four recommendations for getting the most from your analysis. Pract Assess Res Eval 2005. 2011, 10: 7-pareonline net/getvn asp 2011, 10:7
32.
go back to reference Ledesma RD, Valero-Mora P: Determining the number of factors to retain in EFA: an easy-to-use computer program for carrying out parallel analysis. Pract Assessment Res Eval. 2007, 12 (2): 1-11. Ledesma RD, Valero-Mora P: Determining the number of factors to retain in EFA: an easy-to-use computer program for carrying out parallel analysis. Pract Assessment Res Eval. 2007, 12 (2): 1-11.
33.
go back to reference Lamping DL, Schroter S, Marquis P, Marrel A, Duprat-Lomon I, Sagnier P-P: The community-acquired pneumonia symptom questionnaire a new, patient-based outcome measure to evaluate symptoms in patients with community-acquired pneumonia. CHEST J. 2002, 122 (3): 920-929. 10.1378/chest.122.3.920.CrossRef Lamping DL, Schroter S, Marquis P, Marrel A, Duprat-Lomon I, Sagnier P-P: The community-acquired pneumonia symptom questionnaire a new, patient-based outcome measure to evaluate symptoms in patients with community-acquired pneumonia. CHEST J. 2002, 122 (3): 920-929. 10.1378/chest.122.3.920.CrossRef
34.
go back to reference Nunnally JC, Bernstein IH: Psychometric theory. 1994, New York: McGraw-Hill, 3 Nunnally JC, Bernstein IH: Psychometric theory. 1994, New York: McGraw-Hill, 3
35.
go back to reference Smith SC, Lamping DL, Banerjee S, Harwood R, Foley B, Smith P, Cook JC, Murray J, Prince M, Levin E, et al: Measurement of health-related quality of life for people with dementia: development of a new instrument (DEMQOL) and an evaluation of current methodology. Health Technol Assess. 2005, 9 (10): 1-93.CrossRef Smith SC, Lamping DL, Banerjee S, Harwood R, Foley B, Smith P, Cook JC, Murray J, Prince M, Levin E, et al: Measurement of health-related quality of life for people with dementia: development of a new instrument (DEMQOL) and an evaluation of current methodology. Health Technol Assess. 2005, 9 (10): 1-93.CrossRef
36.
go back to reference Flesch R: The Art of Readable Writing. 1974, New York: Harper & Row Flesch R: The Art of Readable Writing. 1974, New York: Harper & Row
37.
go back to reference McBride G: A Proposal for Strength-of-Agreement Criteria for Lin’s Concordance Correlation Coefficient. 2005, Hamilton, New Zealand: National Institute of Water & Atmospheric Research Ltd McBride G: A Proposal for Strength-of-Agreement Criteria for Lin’s Concordance Correlation Coefficient. 2005, Hamilton, New Zealand: National Institute of Water & Atmospheric Research Ltd
38.
go back to reference Henderson C, Corker E, Lewis-Holmes E, Hamilton S, Flach C, Rose D, Williams P, Pinfold V, Thornicroft G: England’s time to change antistigma campaign: one-year outcomes of service user-rated experiences of discrimination. Psychiatr Serv. 2012, 63 (5): 451-457. 10.1176/appi.ps.201100422.CrossRefPubMed Henderson C, Corker E, Lewis-Holmes E, Hamilton S, Flach C, Rose D, Williams P, Pinfold V, Thornicroft G: England’s time to change antistigma campaign: one-year outcomes of service user-rated experiences of discrimination. Psychiatr Serv. 2012, 63 (5): 451-457. 10.1176/appi.ps.201100422.CrossRefPubMed
39.
go back to reference Brohan E, Slade M, Clement S, Thornicroft G: Experiences of mental illness stigma, prejudice and discrimination: a review of measures. Bmc Health Services Res. 2010, 10 (1): 80-10.1186/1472-6963-10-80.CrossRef Brohan E, Slade M, Clement S, Thornicroft G: Experiences of mental illness stigma, prejudice and discrimination: a review of measures. Bmc Health Services Res. 2010, 10 (1): 80-10.1186/1472-6963-10-80.CrossRef
40.
go back to reference Wyllie A, Brown R: Discrimination reported by users of mental health services: 2010 Survey. 2011, Auckland: Phoenix Research Wyllie A, Brown R: Discrimination reported by users of mental health services: 2010 Survey. 2011, Auckland: Phoenix Research
41.
go back to reference Henderson C, Brohan E, Clement S, Williams P, Lassman F, Schauman O, Murray J, Murphy C, Slade M, Thornicroft G: A decision aid to assist decisions on disclosure of mental health status to an employer: protocol for the CORAL exploratory randomised controlled trial. Bmc Psychiatry. 2012, 12 (1): 133-10.1186/1471-244X-12-133.CrossRefPubMedPubMedCentral Henderson C, Brohan E, Clement S, Williams P, Lassman F, Schauman O, Murray J, Murphy C, Slade M, Thornicroft G: A decision aid to assist decisions on disclosure of mental health status to an employer: protocol for the CORAL exploratory randomised controlled trial. Bmc Psychiatry. 2012, 12 (1): 133-10.1186/1471-244X-12-133.CrossRefPubMedPubMedCentral
42.
go back to reference Brohan E, Henderson C, Wheat K, Malcolm E, Clement S, Barley EA, Slade M, Thornicroft G: Systematic review of beliefs, behaviours and influencing factors associated with disclosure of a mental health problem in the workplace. Bmc Psychiatry. 2012, 12: 11-10.1186/1471-244X-12-11.CrossRefPubMedPubMedCentral Brohan E, Henderson C, Wheat K, Malcolm E, Clement S, Barley EA, Slade M, Thornicroft G: Systematic review of beliefs, behaviours and influencing factors associated with disclosure of a mental health problem in the workplace. Bmc Psychiatry. 2012, 12: 11-10.1186/1471-244X-12-11.CrossRefPubMedPubMedCentral
43.
go back to reference Peterson D, Currey N, Collings S: “You don’t look like one of them”: disclosure of mental illness in the workplace as an ongoing dilemma. Psychiatr Rehabil J. 2011, 35 (2): 145-147.CrossRefPubMed Peterson D, Currey N, Collings S: “You don’t look like one of them”: disclosure of mental illness in the workplace as an ongoing dilemma. Psychiatr Rehabil J. 2011, 35 (2): 145-147.CrossRefPubMed
44.
go back to reference Henderson C, Thornicroft G: Stigma and discrimination in mental illness: time to change. The Lancet. 2009, 373 (9679): 1928-10.1016/S0140-6736(09)61046-1.CrossRef Henderson C, Thornicroft G: Stigma and discrimination in mental illness: time to change. The Lancet. 2009, 373 (9679): 1928-10.1016/S0140-6736(09)61046-1.CrossRef
Metadata
Title
The development and validation of the Questionnaire on Anticipated Discrimination (QUAD)
Authors
Jheanell Gabbidon
Elaine Brohan
Sarah Clement
R Claire Henderson
Graham Thornicroft
MIRIAD Study Group
Publication date
01-12-2013
Publisher
BioMed Central
Published in
BMC Psychiatry / Issue 1/2013
Electronic ISSN: 1471-244X
DOI
https://doi.org/10.1186/1471-244X-13-297

Other articles of this Issue 1/2013

BMC Psychiatry 1/2013 Go to the issue