Skip to main content
Top
Published in:

Open Access 22-05-2023 | Review

A review of excluded groups and non-response in population-based mental health surveys from high-income countries

Authors: Eryn Wright, Claudia Pagliaro, Imogen S. Page, Sandra Diminic

Published in: Social Psychiatry and Psychiatric Epidemiology | Issue 9/2023

Login to get access

Abstract

National mental health surveys play a critical role in determining the prevalence of mental disorders in a population and informing service planning. However, current surveys have important limitations, including the exclusion of key vulnerable groups and increasing rates of non-response. This review aims to synthesise information on excluded and undersampled groups in national mental health surveys. We conducted a targeted review of nationally representative adult mental health surveys performed between 2005 and 2019 in high-income OECD countries. Sixteen surveys met our inclusion criteria. The response rate for included surveys ranged between 36.3% and 80.0%. The most frequently excluded groups included people who were homeless, people in hospitals or health facilities and people in correctional facilities. Males and young people were the most commonly underrepresented groups among respondents. Attempts to collect data from non-responders and excluded populations were limited, but suggest that mental health status differs among some of these cohorts. The exclusion of key vulnerable groups and high rates of non-response have important implications for interpreting and using the results of national mental health surveys. Targeted supplementary surveys of excluded or hard-to-reach populations, more inclusive sampling methodologies, and strategies aimed at improving response rates should be considered to strengthen the accuracy and usefulness of survey findings.
Literature
1.
go back to reference Kessler RC, Aguilar-Gaxiola S, Alonso J, Chatterji S, Lee S, Ustün TB (2009) The WHO world mental health (WMH) surveys. Psychiatrie (Stuttg) 6(1):5–9PubMed Kessler RC, Aguilar-Gaxiola S, Alonso J, Chatterji S, Lee S, Ustün TB (2009) The WHO world mental health (WMH) surveys. Psychiatrie (Stuttg) 6(1):5–9PubMed
2.
go back to reference Weinberg L, Whiteford H, de Almeida JC, Aguilar-Gaxiola S, Levinson D, O’Neill S, Kovess-Masfety V (2012) Translation of the world mental health survey data to policies: an exploratory study of Stakeholders’ perceptions of how epidemiologic data can be utilized for policy in the field of mental health. Public Health Rev 34(2):4. https://doi.org/10.1007/BF03391672CrossRef Weinberg L, Whiteford H, de Almeida JC, Aguilar-Gaxiola S, Levinson D, O’Neill S, Kovess-Masfety V (2012) Translation of the world mental health survey data to policies: an exploratory study of Stakeholders’ perceptions of how epidemiologic data can be utilized for policy in the field of mental health. Public Health Rev 34(2):4. https://​doi.​org/​10.​1007/​BF03391672CrossRef
3.
go back to reference Chisholm D, Heslin M, Docrat S, Nanda S, Shidhaye R, Upadhaya N, Jordans M, Abdulmalik J, Olayiwola S, Gureje O, Kizza D, Mugisha J, Kigozi F, Hanlon C, Adugna M, Sanders R, Pretorius C, Thornicroft G, Lund C (2017) Scaling-up services for psychosis, depression and epilepsy in sub-Saharan Africa and South Asia: development and application of a mental health systems planning tool (OneHealth). Epidemiol Psychiatr Sci 26(3):234–244. https://doi.org/10.1017/S2045796016000408CrossRefPubMed Chisholm D, Heslin M, Docrat S, Nanda S, Shidhaye R, Upadhaya N, Jordans M, Abdulmalik J, Olayiwola S, Gureje O, Kizza D, Mugisha J, Kigozi F, Hanlon C, Adugna M, Sanders R, Pretorius C, Thornicroft G, Lund C (2017) Scaling-up services for psychosis, depression and epilepsy in sub-Saharan Africa and South Asia: development and application of a mental health systems planning tool (OneHealth). Epidemiol Psychiatr Sci 26(3):234–244. https://​doi.​org/​10.​1017/​S204579601600040​8CrossRefPubMed
4.
go back to reference Diminic S, Page I, Gossip K, Comben C, Wright E, Pagliaro C, John J (2022) Technical Appendices for the Introduction to the National Mental Health Service Planning Framework – Commissioned by the Australian Government Department of Health. Version AUS V4.1. The University of Queensland, Brisbane Diminic S, Page I, Gossip K, Comben C, Wright E, Pagliaro C, John J (2022) Technical Appendices for the Introduction to the National Mental Health Service Planning Framework – Commissioned by the Australian Government Department of Health. Version AUS V4.1. The University of Queensland, Brisbane
5.
go back to reference Wright E, Leitch E, Fjeldsoe K, Diminic S, Gossip K, Hudson P, Whiteford H (2021) Using the national mental health service planning framework to support an integrated approach to regional mental health planning in Queensland. Australia Aust J Primary Health 27(2):109–115CrossRef Wright E, Leitch E, Fjeldsoe K, Diminic S, Gossip K, Hudson P, Whiteford H (2021) Using the national mental health service planning framework to support an integrated approach to regional mental health planning in Queensland. Australia Aust J Primary Health 27(2):109–115CrossRef
8.
12.
go back to reference McManus S, Bebbington P, Jenkins R, Brugha T (eds) (2016) Mental health and wellbeing in England: Adult Psychiatric Morbidity Survey 2014. NHS Digital, Leeds McManus S, Bebbington P, Jenkins R, Brugha T (eds) (2016) Mental health and wellbeing in England: Adult Psychiatric Morbidity Survey 2014. NHS Digital, Leeds
13.
go back to reference Australian Bureau of Statistics (2009) 2007 National Survey of Mental Health and Wellbeing: users’ guide. Australian Bureau of Statistics, Canberra Australian Bureau of Statistics (2009) 2007 National Survey of Mental Health and Wellbeing: users’ guide. Australian Bureau of Statistics, Canberra
17.
go back to reference Barry M, Van Lente E, Molcho M, Morgan K, McGee H, Conroy R, Watson D, Shelley E, Perry I (2009) SLAN 2007: Survey of lifestyle. Attitudes and nutrition in Ireland mental health and social well-being report, Department of Health and Children, Dublin Barry M, Van Lente E, Molcho M, Morgan K, McGee H, Conroy R, Watson D, Shelley E, Perry I (2009) SLAN 2007: Survey of lifestyle. Attitudes and nutrition in Ireland mental health and social well-being report, Department of Health and Children, Dublin
18.
go back to reference Ishikawa H, Tachimori H, Takeshima T, Umeda M, Miyamoto K, Shimoda H, Baba T, Kawakami N (2018) Prevalence, treatment, and the correlates of common mental disorders in the mid 2010’s in Japan: the results of the world mental health Japan 2nd survey. J Affect Disord 241:554–562CrossRefPubMed Ishikawa H, Tachimori H, Takeshima T, Umeda M, Miyamoto K, Shimoda H, Baba T, Kawakami N (2018) Prevalence, treatment, and the correlates of common mental disorders in the mid 2010’s in Japan: the results of the world mental health Japan 2nd survey. J Affect Disord 241:554–562CrossRefPubMed
20.
go back to reference Grant BF, Chu A, Sigman R, Amsbary M, Kali J, Sugawara Y, Jiao R, Ren W, Goldstein R (2014) Source and accuracy statement: national epidemiologic Survey on alcohol and related conditions-III (NESARC-III). National Institute on Alcohol Abuse and Alcoholism, Rockville, MD Grant BF, Chu A, Sigman R, Amsbary M, Kali J, Sugawara Y, Jiao R, Ren W, Goldstein R (2014) Source and accuracy statement: national epidemiologic Survey on alcohol and related conditions-III (NESARC-III). National Institute on Alcohol Abuse and Alcoholism, Rockville, MD
24.
go back to reference Kiejna A, Adamowski T, Piotrowski P, Moskalewicz J, Wojtyniak B, Świątkiewicz G, Stokwiszewski J, Kantorska-Janiec M, Zagdańska M, Kessler R (2015) “Epidemiology of mental disorders and access to mental health care EZOP – Poland” - research methodology. Psychiatr Pol 49(1):5–13. https://doi.org/10.1240/pp/30810CrossRefPubMed Kiejna A, Adamowski T, Piotrowski P, Moskalewicz J, Wojtyniak B, Świątkiewicz G, Stokwiszewski J, Kantorska-Janiec M, Zagdańska M, Kessler R (2015) “Epidemiology of mental disorders and access to mental health care EZOP – Poland” - research methodology. Psychiatr Pol 49(1):5–13. https://​doi.​org/​10.​1240/​pp/​30810CrossRefPubMed
27.
go back to reference Ministry of Health (2017) Methodology Report 2016/17: New Zealand Health Survey. Ministry of Health, Wellington Ministry of Health (2017) Methodology Report 2016/17: New Zealand Health Survey. Ministry of Health, Wellington
28.
go back to reference Center for Behavioural Health Statistics and Quality (2015) Behavioural health trends in the United States: Results from the 2014 National Survey on Drug Use and Health. (HHS Publication No. SMA 15–4927, NSDUH Series H-50). Center for Behavioral Health Statistics and Quality, Substance Abuse and Mental Health Services Administration, Rockville, MD Center for Behavioural Health Statistics and Quality (2015) Behavioural health trends in the United States: Results from the 2014 National Survey on Drug Use and Health. (HHS Publication No. SMA 15–4927, NSDUH Series H-50). Center for Behavioral Health Statistics and Quality, Substance Abuse and Mental Health Services Administration, Rockville, MD
29.
go back to reference Ministry of Health (2017) Content Guide 2016/17: New Zealand Health Survey. Ministry of Health, Wellington Ministry of Health (2017) Content Guide 2016/17: New Zealand Health Survey. Ministry of Health, Wellington
30.
go back to reference McManus S (sally.mcmanus@natcen.ac.uk). Mental Health Survey Queries. Email to: Wright E (e.wright1@uq.edu.au). 9 September 2021. McManus S (sally.mcmanus@natcen.ac.uk). Mental Health Survey Queries. Email to: Wright E (e.wright1@uq.edu.au). 9 September 2021.
31.
go back to reference Kiejna A (andrzej.kiejna46@gmail.com). EZOP survey query. Email to: Wright E (e.wright1@uq.edu.au). 10 December 2021. Kiejna A (andrzej.kiejna46@gmail.com). EZOP survey query. Email to: Wright E (e.wright1@uq.edu.au). 10 December 2021.
34.
go back to reference Patten S (patten@ucalgary.ca). Community mental health survey questions. Email to: Wright E (e.wright1@uq.edu.au). 1 November 2021 - 5 May 2022. Patten S (patten@ucalgary.ca). Community mental health survey questions. Email to: Wright E (e.wright1@uq.edu.au). 1 November 2021 - 5 May 2022.
35.
go back to reference The CBHSQ Request Team (cbhsqrequest@samhsa.hhs.gov). Query about the 2014 NSDUH. Email to: Wright E (e.wright1@uq.edu.au). 25 March 2022. The CBHSQ Request Team (cbhsqrequest@samhsa.hhs.gov). Query about the 2014 NSDUH. Email to: Wright E (e.wright1@uq.edu.au). 25 March 2022.
38.
go back to reference Hisateru T (tachi@ncnp.go.jp). Query about the WMHJ2. Email to: Wright E (e.wright1@uq.edu.au). 9–28 April 2022. Hisateru T (tachi@ncnp.go.jp). Query about the WMHJ2. Email to: Wright E (e.wright1@uq.edu.au). 9–28 April 2022.
39.
go back to reference Umeda M, Shimoda H, Miyamoto K, Ishikawa H, Tachimori H, Takeshima T, Kawakami N (2021) Comorbidity and sociodemographic characteristics of adult autism spectrum disorder and attention deficit hyperactivity disorder: epidemiological investigation in the world mental health Japan 2nd survey. Internat J Develop Disabilities 67(1):58–66. https://doi.org/10.1080/20473869.2019.1576409CrossRef Umeda M, Shimoda H, Miyamoto K, Ishikawa H, Tachimori H, Takeshima T, Kawakami N (2021) Comorbidity and sociodemographic characteristics of adult autism spectrum disorder and attention deficit hyperactivity disorder: epidemiological investigation in the world mental health Japan 2nd survey. Internat J Develop Disabilities 67(1):58–66. https://​doi.​org/​10.​1080/​20473869.​2019.​1576409CrossRef
40.
go back to reference Xavier M (migxavier@gmail.com). Query about the Portuguese National Mental Health Study. Email to: Wright E (e.wright1@uq.edu.au). 19 April 2022. Xavier M (migxavier@gmail.com). Query about the Portuguese National Mental Health Study. Email to: Wright E (e.wright1@uq.edu.au). 19 April 2022.
48.
go back to reference Fikretoglu D, Liu A, Zamorski MA, Rusu C, Jetly R (2018) Do investments in mental health systems result in greater use of mental health services? national trends in mental health service use (MHSU) in the Canadian military and comparable Canadian civilians, 2002–2013. Canadian J psychiatry Revue canadienne de psychiatrie 63(9):602–609. https://doi.org/10.1177/0706743718760291CrossRef Fikretoglu D, Liu A, Zamorski MA, Rusu C, Jetly R (2018) Do investments in mental health systems result in greater use of mental health services? national trends in mental health service use (MHSU) in the Canadian military and comparable Canadian civilians, 2002–2013. Canadian J psychiatry Revue canadienne de psychiatrie 63(9):602–609. https://​doi.​org/​10.​1177/​0706743718760291​CrossRef
49.
go back to reference Taillieu TL, Afifi TO, Turner S, Cheung K, Fortier J, Zamorski M, Sareen J (2018) Risk factors, clinical presentations, and functional impairments for generalized anxiety disorder in military personnel and the general population in Canada. Canadian J Psychiatry 63(9):610–619. https://doi.org/10.1177/0706743717752878CrossRef Taillieu TL, Afifi TO, Turner S, Cheung K, Fortier J, Zamorski M, Sareen J (2018) Risk factors, clinical presentations, and functional impairments for generalized anxiety disorder in military personnel and the general population in Canada. Canadian J Psychiatry 63(9):610–619. https://​doi.​org/​10.​1177/​0706743717752878​CrossRef
55.
go back to reference Barlas F, Higgins W, Pflieger J, Diecker K (2013) 2011 Health Related Behaviors Survey of Active Duty Military Personnel ICF international, Fairfax Barlas F, Higgins W, Pflieger J, Diecker K (2013) 2011 Health Related Behaviors Survey of Active Duty Military Personnel ICF international, Fairfax
56.
go back to reference Bray RM, Pemberton MR, Hourani LL, Witt M, Olmsted KLR, Brown JM, Weimer B, Lane ME, Marsden ME, Scheffler S, Vandermaas-Peeler R, Aspinwall KR, Anderson E, Spagnola K, Close K, Gratton JL, Calvin S, Bradshaw M (2009) 2008 Department of Defense Survey of Health Related Behaviors Among Active Duty Military Personnel Bray RM, Pemberton MR, Hourani LL, Witt M, Olmsted KLR, Brown JM, Weimer B, Lane ME, Marsden ME, Scheffler S, Vandermaas-Peeler R, Aspinwall KR, Anderson E, Spagnola K, Close K, Gratton JL, Calvin S, Bradshaw M (2009) 2008 Department of Defense Survey of Health Related Behaviors Among Active Duty Military Personnel
57.
go back to reference Rosellini AJ, Heeringa SG, Stein MB, Ursano RJ, Chiu WT, Colpe LJ, Fullerton CS, Gilman SE, Hwang I, Naifeh JA, Nock MK, Petukhova M, Sampson NA, Schoenbaum M, Zaslavsky AM, Kessler RC (2015) Lifetime prevalence of DSM-IV mental disorders among new soldiers in the U.S army: results from the army study to assess risk and resilience in servicemembers (army STARRS). Depression Anxiety 32(1):13–24. https://doi.org/10.1002/da.22316CrossRefPubMed Rosellini AJ, Heeringa SG, Stein MB, Ursano RJ, Chiu WT, Colpe LJ, Fullerton CS, Gilman SE, Hwang I, Naifeh JA, Nock MK, Petukhova M, Sampson NA, Schoenbaum M, Zaslavsky AM, Kessler RC (2015) Lifetime prevalence of DSM-IV mental disorders among new soldiers in the U.S army: results from the army study to assess risk and resilience in servicemembers (army STARRS). Depression Anxiety 32(1):13–24. https://​doi.​org/​10.​1002/​da.​22316CrossRefPubMed
58.
go back to reference Bronson J, Berzofsky M (2017) Indicators of Mental Health Problems Reported by Prisoners and Jail Inmates, 2011–12. Bureau of Justice Statistics, Bronson J, Berzofsky M (2017) Indicators of Mental Health Problems Reported by Prisoners and Jail Inmates, 2011–12. Bureau of Justice Statistics,
59.
go back to reference Beck AJ, Berzofsky M, Caspar R, Krebs C (2013) Sexual victimization in prisons and jails reported by inmates, 2011–12: National Inmate Survey, 2011–12 (NCJ 241399). US Department of Justice, Office of Justice Programs, Bureau of Justice Statistics, Washington, DC Beck AJ, Berzofsky M, Caspar R, Krebs C (2013) Sexual victimization in prisons and jails reported by inmates, 2011–12: National Inmate Survey, 2011–12 (NCJ 241399). US Department of Justice, Office of Justice Programs, Bureau of Justice Statistics, Washington, DC
61.
go back to reference James DJ, Glaze LE (2006) Mental Health Problems of Prison and Jail Inmates. Bureau of Justice Statistics, Washington, DCCrossRef James DJ, Glaze LE (2006) Mental Health Problems of Prison and Jail Inmates. Bureau of Justice Statistics, Washington, DCCrossRef
62.
go back to reference Smith J (2005) Housing, homelessness, and mental health in great Britain. Int J Ment Health 34(2):22–46CrossRef Smith J (2005) Housing, homelessness, and mental health in great Britain. Int J Ment Health 34(2):22–46CrossRef
64.
go back to reference Palay J, Taillieu TL, Afifi TO, Turner S, Bolton JM, Enns MW, Smith M, Lesage A, Bakal JA, Rush B, Adair CE, Vigod SN, Clelland S, Rittenbach K, Kurdyak P, Sareen J (2019) Prevalence of mental disorders and suicidality in Canadian provinces. The Canadian J Psychiatry 64(11):761–769. https://doi.org/10.1177/0706743719878987CrossRef Palay J, Taillieu TL, Afifi TO, Turner S, Bolton JM, Enns MW, Smith M, Lesage A, Bakal JA, Rush B, Adair CE, Vigod SN, Clelland S, Rittenbach K, Kurdyak P, Sareen J (2019) Prevalence of mental disorders and suicidality in Canadian provinces. The Canadian J Psychiatry 64(11):761–769. https://​doi.​org/​10.​1177/​0706743719878987​CrossRef
65.
go back to reference OECD (Organisation for Economic Co-operation and Development) (2021) Long-Term Care Resources and Utilisation: Long-term care recipients. Organisation for Economic Co-operation and Development. https://stats.oecd.org/. Accessed 5 May 2022 OECD (Organisation for Economic Co-operation and Development) (2021) Long-Term Care Resources and Utilisation: Long-term care recipients. Organisation for Economic Co-operation and Development. https://​stats.​oecd.​org/​. Accessed 5 May 2022
66.
go back to reference Amare AT, Caughey GE, Whitehead CH, Lang CE, Bray SCE, Corlis M, Visvanathan R, Wesselingh SL, Inacio MC (2020) The prevalence, trends and determinants of mental health disorders in older Australians living in permanent residential aged care: implications for policy and quality of aged care services. Aust N Z J Psychiatry 54:1200–1211. https://doi.org/10.1177/0004867420945367CrossRefPubMed Amare AT, Caughey GE, Whitehead CH, Lang CE, Bray SCE, Corlis M, Visvanathan R, Wesselingh SL, Inacio MC (2020) The prevalence, trends and determinants of mental health disorders in older Australians living in permanent residential aged care: implications for policy and quality of aged care services. Aust N Z J Psychiatry 54:1200–1211. https://​doi.​org/​10.​1177/​0004867420945367​CrossRefPubMed
68.
go back to reference World Health Organisation (2015) World report on ageing and health. World Health Organization, Geneva, Switzerland World Health Organisation (2015) World report on ageing and health. World Health Organization, Geneva, Switzerland
70.
go back to reference Hospital Episode Statistics, Admitted Patient Care, England - 2013–14 (2015). NHS Digital, Hospital Episode Statistics, Admitted Patient Care, England - 2013–14 (2015). NHS Digital,
71.
go back to reference Morgan VA, Waterreus A, Jablensky A, Mackinnon A, McGrath JJ, Carr V, Bush R, Castle D, Cohen M, Harvey C, Galletly C, Stain HJ, Neil AL, McGorry P, Hocking B, Shah S, Saw S (2012) People living with psychotic illness in 2010: the second Australian national survey of psychosis. Aust N Z J Psychiatry 46(8):735–752. https://doi.org/10.1177/0004867412449877CrossRefPubMed Morgan VA, Waterreus A, Jablensky A, Mackinnon A, McGrath JJ, Carr V, Bush R, Castle D, Cohen M, Harvey C, Galletly C, Stain HJ, Neil AL, McGorry P, Hocking B, Shah S, Saw S (2012) People living with psychotic illness in 2010: the second Australian national survey of psychosis. Aust N Z J Psychiatry 46(8):735–752. https://​doi.​org/​10.​1177/​0004867412449877​CrossRefPubMed
96.
go back to reference Holmen J, Midthjell K, Krüger Ø, Langhammer A, Holmen T, Bratberg G, Vatten L, Lund-Larsen P (2002) The NordTrøndelag Health Study 1995–97 (HUNT 2): Objectives, contents, methods and participation. Norsk Epidemiologi 13 Holmen J, Midthjell K, Krüger Ø, Langhammer A, Holmen T, Bratberg G, Vatten L, Lund-Larsen P (2002) The NordTrøndelag Health Study 1995–97 (HUNT 2): Objectives, contents, methods and participation. Norsk Epidemiologi 13
97.
go back to reference Remington PL, Smith MY, Williamson DF, Anda RF, Gentry EM, Hogelin GC (1988) Design, characteristics, and usefulness of state-based behavioral risk factor surveillance: 1981–87. Public Health Rep 103(4):366–375PubMedPubMedCentral Remington PL, Smith MY, Williamson DF, Anda RF, Gentry EM, Hogelin GC (1988) Design, characteristics, and usefulness of state-based behavioral risk factor surveillance: 1981–87. Public Health Rep 103(4):366–375PubMedPubMedCentral
107.
go back to reference First Nations Information Governance Centre (FNIGC) (2012) First Nations Regional Health Survey (RHS) 2008/10: National report on adults, youth and children living in First Nations communities. FNIGC, Ottawa First Nations Information Governance Centre (FNIGC) (2012) First Nations Regional Health Survey (RHS) 2008/10: National report on adults, youth and children living in First Nations communities. FNIGC, Ottawa
Metadata
Title
A review of excluded groups and non-response in population-based mental health surveys from high-income countries
Authors
Eryn Wright
Claudia Pagliaro
Imogen S. Page
Sandra Diminic
Publication date
22-05-2023
Publisher
Springer Berlin Heidelberg
Published in
Social Psychiatry and Psychiatric Epidemiology / Issue 9/2023
Print ISSN: 0933-7954
Electronic ISSN: 1433-9285
DOI
https://doi.org/10.1007/s00127-023-02488-y