Skip to main content
Top
Published in: BMC Public Health 1/2020

Open Access 01-12-2020 | Research article

Development and validation of the Rapid Positive Mental Health Instrument (R-PMHI) for measuring mental health outcomes in the population

Authors: Janhavi Ajit Vaingankar, Edimansyah Abdin, Robertus Martinus van Dam, Siow Ann Chong, Linda Wei Lin Tan, Rajeswari Sambasivam, Esmond Seow, Boon Yiang Chua, Hwee Lin Wee, Wei Yen Lim, Mythily Subramaniam

Published in: BMC Public Health | Issue 1/2020

Login to get access

Abstract

Background

The multidimensional Positive Mental Health Instrument (PMHI) has 47 items and six subscales. This study aimed to develop and validate a short unidimensional version of the PMHI among Singapore’s adult resident population.

Methods

Using pooled data from three earlier studies (n = 1050), PMHI items were reduced by Partial Credit Rasch Model (PCRM) runs in a random split-half sample, while psychometric properties of the resulting measure were tested through confirmatory factor analysis (CFA), item response theory-graded response model and internal consistency reliability in the other half. Its reliability, construct and concurrent validity, agreement with the original scale, floor and ceiling effect, and scale estimates were further investigated in an external representative general population sample (n = 1925).

Results

The average age of the participants was around 41 years. Four PCRM re-runs for item selection resulted in a 6-item unidimensional Rapid PMHI (R-PMHI). CFA confirmed the unidimensional structure of the R-PMHI in the internal (RMSEA = 0.075, CFI = 0.985, TLI = 0.974) and external (RMSEA = 0.051, CFI = 0.992, TLI = 0.987) validation samples. In the external validation sample, the R-PMHI met concurrent validity criteria, showing high agreement with the 47-item version with intra-class correlation coefficient of 0.872 (95% CI: 0.861 to 0.882) and low floor and ceiling effects. Weight-adjusted mean (SE, 95% CI) R-PMHI score in the population was 4.86 (0.2, 4.82–4.90).

Conclusion

The unidimensional 6-item R-PMHI offers brevity over the original multidimensional measure while appropriately representing the positive mental health construct. Prospective studies are needed to assess its responsiveness and test-retest reliability.
Appendix
Available only for authorised users
Literature
2.
go back to reference Watson D, Clark LA, Tellegen A. Development and validation of brief measures of positive and negative affect: the PANAS scales. J Pers Soc Psychol. 1988;54:1063–70.PubMedCrossRef Watson D, Clark LA, Tellegen A. Development and validation of brief measures of positive and negative affect: the PANAS scales. J Pers Soc Psychol. 1988;54:1063–70.PubMedCrossRef
3.
go back to reference Diener E, Emmons RA, Larsen RJ, Griffin S. The satisfaction with life scale. J Pers Assess. 1985;49:71–5.PubMedCrossRef Diener E, Emmons RA, Larsen RJ, Griffin S. The satisfaction with life scale. J Pers Assess. 1985;49:71–5.PubMedCrossRef
4.
go back to reference Ryff CD, Singer B. Psychological well-being: meaning, measurement, and implications for psychotherapy research. Psychother Psychosom. 1996;65:14–23.PubMedCrossRef Ryff CD, Singer B. Psychological well-being: meaning, measurement, and implications for psychotherapy research. Psychother Psychosom. 1996;65:14–23.PubMedCrossRef
5.
go back to reference Kammann R, Flett R. Source book for measuring well-being with Affectometer 2, Dunedin, New Zealand: why not? Foundation Psychologist. 1983;35:259–65. Kammann R, Flett R. Source book for measuring well-being with Affectometer 2, Dunedin, New Zealand: why not? Foundation Psychologist. 1983;35:259–65.
6.
go back to reference McHorney CA, Ware JE Jr, Raczek AE. The MOS 36-item short-form health survey (SF-36): II. Psychometric and clinical tests of validity in measuring physical and mental health constructs. Med Care. 1993;31:247–63.PubMedCrossRef McHorney CA, Ware JE Jr, Raczek AE. The MOS 36-item short-form health survey (SF-36): II. Psychometric and clinical tests of validity in measuring physical and mental health constructs. Med Care. 1993;31:247–63.PubMedCrossRef
7.
go back to reference Topp CW, Østergaard SD, Søndergaard S, Bech P. The WHO-5 well-being index: a systematic review of the literature. Psychother Psychosom. 2015;84:167–76.PubMedCrossRef Topp CW, Østergaard SD, Søndergaard S, Bech P. The WHO-5 well-being index: a systematic review of the literature. Psychother Psychosom. 2015;84:167–76.PubMedCrossRef
8.
go back to reference Tennant R, Hiller L, Fishwick R, Platt S, Joseph S, Weich S, Parkinson J, Secker J, Stewart-Brown S. The Warwick-Edinburgh mental well-being scale (WEMWBS): development and UK validation. Health Qual Life Outcomes. 2007;5:63.PubMedPubMedCentralCrossRef Tennant R, Hiller L, Fishwick R, Platt S, Joseph S, Weich S, Parkinson J, Secker J, Stewart-Brown S. The Warwick-Edinburgh mental well-being scale (WEMWBS): development and UK validation. Health Qual Life Outcomes. 2007;5:63.PubMedPubMedCentralCrossRef
9.
go back to reference Vaingankar JA, Subramaniam M, Chong SA, Abdin E, Orlando Edelen M, Picco L, et al. The positive mental health instrument: development and validation of a culturally relevant scale in a multi-ethnic Asian population. Health Qual Life Outcomes. 2011;9:92.PubMedPubMedCentralCrossRef Vaingankar JA, Subramaniam M, Chong SA, Abdin E, Orlando Edelen M, Picco L, et al. The positive mental health instrument: development and validation of a culturally relevant scale in a multi-ethnic Asian population. Health Qual Life Outcomes. 2011;9:92.PubMedPubMedCentralCrossRef
10.
go back to reference Roldán-Merino J, Lluch-Canut MT, Casas I, Sanromà-Ortíz M, Ferré-Grau C, Sequeira C, et al. Reliability and validity of the positive mental health questionnaire in a sample of Spanish university students. J Psychiat Ment Health Nurs. 2017;24:123–33.CrossRef Roldán-Merino J, Lluch-Canut MT, Casas I, Sanromà-Ortíz M, Ferré-Grau C, Sequeira C, et al. Reliability and validity of the positive mental health questionnaire in a sample of Spanish university students. J Psychiat Ment Health Nurs. 2017;24:123–33.CrossRef
11.
go back to reference Vaingankar JA, Abdin E, Chong SA, Sambasivam R, Jeyagurunathan A, Seow E, et al. Psychometric properties of the positive mental health instrument among people with mental disorders: a cross-sectional study. Health Qual Life Outcomes. 2016;14:19.PubMedPubMedCentralCrossRef Vaingankar JA, Abdin E, Chong SA, Sambasivam R, Jeyagurunathan A, Seow E, et al. Psychometric properties of the positive mental health instrument among people with mental disorders: a cross-sectional study. Health Qual Life Outcomes. 2016;14:19.PubMedPubMedCentralCrossRef
12.
go back to reference Vaingankar JA, Subramaniam M, Tan LWL, Abdin E, Lim WY, Wee HL, et al. Psychometric properties and population norms of the positive mental health instrument in a representative multi-ethnic Asian population. BMC Med Res Methodol. 2018;18:29.PubMedPubMedCentralCrossRef Vaingankar JA, Subramaniam M, Tan LWL, Abdin E, Lim WY, Wee HL, et al. Psychometric properties and population norms of the positive mental health instrument in a representative multi-ethnic Asian population. BMC Med Res Methodol. 2018;18:29.PubMedPubMedCentralCrossRef
13.
go back to reference Vaingankar JA, Subramaniam M, Abdin E, Picco L, Phua A, Chua BY, et al. Socio-demographic correlates of positive mental health and differences by depression and anxiety in an Asian community sample. Ann Acad Med Singap. 2013;42:514–23.PubMed Vaingankar JA, Subramaniam M, Abdin E, Picco L, Phua A, Chua BY, et al. Socio-demographic correlates of positive mental health and differences by depression and anxiety in an Asian community sample. Ann Acad Med Singap. 2013;42:514–23.PubMed
14.
go back to reference Jeyagurunathan A, Vaingankar JA, Abdin E, Sambasivam R, Seow E, Pang S, Picco L, Chong SA, Subramaniam M. Gender differences in positive mental health among individuals with schizophrenia. Compr Psychiatry. 2017;74:88–95.PubMedCrossRef Jeyagurunathan A, Vaingankar JA, Abdin E, Sambasivam R, Seow E, Pang S, Picco L, Chong SA, Subramaniam M. Gender differences in positive mental health among individuals with schizophrenia. Compr Psychiatry. 2017;74:88–95.PubMedCrossRef
15.
go back to reference Seow LS, Vaingankar JA, Abdin E, Sambasivam R, Jeyagurunathan A, Pang S, et al. Positive mental health in outpatients with affective disorders: associations with life satisfaction and general functioning. J Affect Disord. 2015;190:499–507.PubMedCrossRef Seow LS, Vaingankar JA, Abdin E, Sambasivam R, Jeyagurunathan A, Pang S, et al. Positive mental health in outpatients with affective disorders: associations with life satisfaction and general functioning. J Affect Disord. 2015;190:499–507.PubMedCrossRef
16.
go back to reference Picco L, Yuan Q, Vaingankar JA, Chang S, Abdin E, Chua HC, Chong SA, Subramaniam M. Positive mental health among health professionals working at a psychiatric hospital. PLoS One. 2017;7:12. Picco L, Yuan Q, Vaingankar JA, Chang S, Abdin E, Chua HC, Chong SA, Subramaniam M. Positive mental health among health professionals working at a psychiatric hospital. PLoS One. 2017;7:12.
17.
go back to reference Vaingankar JA, Subramaniam M, Abdin E, Picco L, Chua BY, Eng GK, et al. Development, validity and reliability of the short multidimensional positive mental health instrument. Qual Life Res. 2014;23:1459–77.PubMedCrossRef Vaingankar JA, Subramaniam M, Abdin E, Picco L, Chua BY, Eng GK, et al. Development, validity and reliability of the short multidimensional positive mental health instrument. Qual Life Res. 2014;23:1459–77.PubMedCrossRef
18.
go back to reference Ong HL, Vaingankar JA, Abdin E, Sambasivam R, Fauziana R, Tan ME, Chong SA, Goveas RR, Chiam PC, Subramaniam M. Resilience and burden in caregivers of older adults: moderating and mediating effects of perceived social support. BMC Psychiatry. 2018;18:27.PubMedPubMedCentralCrossRef Ong HL, Vaingankar JA, Abdin E, Sambasivam R, Fauziana R, Tan ME, Chong SA, Goveas RR, Chiam PC, Subramaniam M. Resilience and burden in caregivers of older adults: moderating and mediating effects of perceived social support. BMC Psychiatry. 2018;18:27.PubMedPubMedCentralCrossRef
19.
go back to reference Vaingankar JA, Subramaniam M, Lim YW, Sherbourne C, Luo N, Ryan G, et al. From well-being to positive mental health: conceptualization and qualitative development of an instrument in Singapore. Qual Life Res. 2012;21:1785–94.PubMedCrossRef Vaingankar JA, Subramaniam M, Lim YW, Sherbourne C, Luo N, Ryan G, et al. From well-being to positive mental health: conceptualization and qualitative development of an instrument in Singapore. Qual Life Res. 2012;21:1785–94.PubMedCrossRef
20.
go back to reference Herdman M, Gudex C, Lloyd A, Janssen MF, Kind P, Parkin D, et al. Development and preliminary testing of the new five-level version of EQ-5D (EQ-5D-5L). Qual Life Res. 2011;20:1727–36.PubMedPubMedCentralCrossRef Herdman M, Gudex C, Lloyd A, Janssen MF, Kind P, Parkin D, et al. Development and preliminary testing of the new five-level version of EQ-5D (EQ-5D-5L). Qual Life Res. 2011;20:1727–36.PubMedPubMedCentralCrossRef
21.
go back to reference Kessler RC, Andrews G, Colpe LJ, Hiripi E, Mroczek DK, Normand SL, Walters EE, Zaslavsky AM. Short screening scales to monitor population prevalences and trends in non-specific psychological distress. Psychol Med. 2002;32:959–76.PubMedCrossRef Kessler RC, Andrews G, Colpe LJ, Hiripi E, Mroczek DK, Normand SL, Walters EE, Zaslavsky AM. Short screening scales to monitor population prevalences and trends in non-specific psychological distress. Psychol Med. 2002;32:959–76.PubMedCrossRef
22.
go back to reference Masters GN. A rasch model for partial credit scoring. Psychometrika. 1982;47:149–74.CrossRef Masters GN. A rasch model for partial credit scoring. Psychometrika. 1982;47:149–74.CrossRef
23.
go back to reference Beaton DE, Wright JG, Katz JN, Upper Extremit South African Journal of Psychology y Collaborative Group. Development of the QuickDASH: comparison of three item-reduction approaches. J Bone Joint Surg Am. 2005;87:1038–46.PubMed Beaton DE, Wright JG, Katz JN, Upper Extremit South African Journal of Psychology y Collaborative Group. Development of the QuickDASH: comparison of three item-reduction approaches. J Bone Joint Surg Am. 2005;87:1038–46.PubMed
24.
go back to reference Linacre JM. Size vs. Significance: Infit and Outfit Mean-Square and Standardized Chi-Square Fit Statistic. Rasch Meas Trans. 2003;17:918. Linacre JM. Size vs. Significance: Infit and Outfit Mean-Square and Standardized Chi-Square Fit Statistic. Rasch Meas Trans. 2003;17:918.
25.
go back to reference Linacre JM. What do Infit and outfit, mean-square and standardized mean? Rasch Meas Trans. 2002;16:878. Linacre JM. What do Infit and outfit, mean-square and standardized mean? Rasch Meas Trans. 2002;16:878.
26.
go back to reference Hu L, Bentler PM. Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Struct Equ Model. 1999;6:1–55.CrossRef Hu L, Bentler PM. Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Struct Equ Model. 1999;6:1–55.CrossRef
27.
go back to reference Browne MW, Cudeck R. Alternative ways of assessing model fit. In: Bollen KA, Long JS, editors. Testing Structural Equation Models. NewBury Park: Sage; 1993. Browne MW, Cudeck R. Alternative ways of assessing model fit. In: Bollen KA, Long JS, editors. Testing Structural Equation Models. NewBury Park: Sage; 1993.
28.
go back to reference Tennant A, McKenna SP, Hagell P. Application of Rasch analysis in the development and application of quality of life instruments. Value Health. 2004;7:S22–6.PubMedCrossRef Tennant A, McKenna SP, Hagell P. Application of Rasch analysis in the development and application of quality of life instruments. Value Health. 2004;7:S22–6.PubMedCrossRef
30.
go back to reference Snell DL, Siegert RJ, Surgenor LJ, Dunn JA, Hooper GJ. Evaluating quality of life outcomes following joint replacement: psychometric evaluation of a short form of the WHOQOL-Bref. Qual Life Res. 2016;25:51–61.PubMedCrossRef Snell DL, Siegert RJ, Surgenor LJ, Dunn JA, Hooper GJ. Evaluating quality of life outcomes following joint replacement: psychometric evaluation of a short form of the WHOQOL-Bref. Qual Life Res. 2016;25:51–61.PubMedCrossRef
31.
go back to reference Rosato R, Testa S, Bertolotto A, Confalonieri P, Patti F, Lugaresi A, et al. Development of a Short Version of MSQOL-54 Using Factor Analysis and Item Response Theory. PLoS One. 2016;11(4):e0153466.PubMedPubMedCentralCrossRef Rosato R, Testa S, Bertolotto A, Confalonieri P, Patti F, Lugaresi A, et al. Development of a Short Version of MSQOL-54 Using Factor Analysis and Item Response Theory. PLoS One. 2016;11(4):e0153466.PubMedPubMedCentralCrossRef
32.
go back to reference Huang IC, Frangakis C, Atkinson MJ, Willke RJ, Leite WL, Vogel WB, et al. Addressing ceiling effects in health status measures: a comparison of techniques applied to measures for people with HIV disease. Health Serv Res. 2008;43:327–39.PubMedPubMedCentralCrossRef Huang IC, Frangakis C, Atkinson MJ, Willke RJ, Leite WL, Vogel WB, et al. Addressing ceiling effects in health status measures: a comparison of techniques applied to measures for people with HIV disease. Health Serv Res. 2008;43:327–39.PubMedPubMedCentralCrossRef
33.
go back to reference Abdin E, Subramaniam M, Picco L, Pang S, Vaingankar JA, Shahwan S, Sagayadevan V, Zhang Y, Chong SA. The importance of considering differential item functioning in investigating the impact of chronic conditions on health-related quality of life in a multi-ethnic Asian population. Qual Life Res. 2017;26:823–34.PubMedCrossRef Abdin E, Subramaniam M, Picco L, Pang S, Vaingankar JA, Shahwan S, Sagayadevan V, Zhang Y, Chong SA. The importance of considering differential item functioning in investigating the impact of chronic conditions on health-related quality of life in a multi-ethnic Asian population. Qual Life Res. 2017;26:823–34.PubMedCrossRef
34.
go back to reference Scott NW, Fayers PM, Aaronson NK, Bottomley A, de Graeff A, Groenvold M, et al. Differential item functioning (DIF) analyses of health-related quality of life instruments using logistic regression. Health Qual Life Outcomes. 2010;4:81.CrossRef Scott NW, Fayers PM, Aaronson NK, Bottomley A, de Graeff A, Groenvold M, et al. Differential item functioning (DIF) analyses of health-related quality of life instruments using logistic regression. Health Qual Life Outcomes. 2010;4:81.CrossRef
35.
go back to reference Bond TG, Fox CM. Applying the Rasch model: fundamental measurement in the human sciences Lawrence Erlbaum Baum associates: Hillsdale, New Jersey; 2001.CrossRef Bond TG, Fox CM. Applying the Rasch model: fundamental measurement in the human sciences Lawrence Erlbaum Baum associates: Hillsdale, New Jersey; 2001.CrossRef
36.
go back to reference Smith AB, Wright EP, Rush R, Stark DP, Velikova G, Selby PJ. Rasch analysis of the dimensional structure of the hospital anxiety and depression scale. Psycho-oncology. 2006;15:817–27.PubMedCrossRef Smith AB, Wright EP, Rush R, Stark DP, Velikova G, Selby PJ. Rasch analysis of the dimensional structure of the hospital anxiety and depression scale. Psycho-oncology. 2006;15:817–27.PubMedCrossRef
38.
go back to reference Sambasivam R, Vaingankar JA, Chong SA, Abdin E, Jeyagurunathan A, Seow LS, et al. Positive mental health in outpatients: comparison within diagnostic groups. BMC Psychiatry. 2016;16:412.PubMedPubMedCentralCrossRef Sambasivam R, Vaingankar JA, Chong SA, Abdin E, Jeyagurunathan A, Seow LS, et al. Positive mental health in outpatients: comparison within diagnostic groups. BMC Psychiatry. 2016;16:412.PubMedPubMedCentralCrossRef
39.
go back to reference Preston CC, Colman AM. Optimal number of response categories in rating scales: reliability, validity, discriminating power, and respondent preferences. Acta Psychol. 2000;104:1–15.CrossRef Preston CC, Colman AM. Optimal number of response categories in rating scales: reliability, validity, discriminating power, and respondent preferences. Acta Psychol. 2000;104:1–15.CrossRef
40.
go back to reference Ng FL, Scholes S, Boniface S, Mindell J, Stewart-Brown S. Evaluating and establishing national norms for mental wellbeing using the short Warwick-Edinburgh mental well-being scale (SWEMWBS): findings from the health survey for England. Qual Life Res. 2017;26:1129–44.CrossRef Ng FL, Scholes S, Boniface S, Mindell J, Stewart-Brown S. Evaluating and establishing national norms for mental wellbeing using the short Warwick-Edinburgh mental well-being scale (SWEMWBS): findings from the health survey for England. Qual Life Res. 2017;26:1129–44.CrossRef
41.
go back to reference Diehl M, Hay EL, Berg KM. The ratio between positive and negative affect and flourishing mental health across adulthood. Aging Ment Health. 2011;15:882–93.PubMedPubMedCentralCrossRef Diehl M, Hay EL, Berg KM. The ratio between positive and negative affect and flourishing mental health across adulthood. Aging Ment Health. 2011;15:882–93.PubMedPubMedCentralCrossRef
43.
go back to reference Brenninkmeijer V, VanYperen N. How to conduct research on burnout: advantages and disadvantages of a unidimensional approach in burnout research. Occup Environ Med. 2003;60:i16–20.PubMedPubMedCentralCrossRef Brenninkmeijer V, VanYperen N. How to conduct research on burnout: advantages and disadvantages of a unidimensional approach in burnout research. Occup Environ Med. 2003;60:i16–20.PubMedPubMedCentralCrossRef
44.
go back to reference Fernández-Abascal EG, Martín-Díaz MD. Dimensions of emotional intelligence related to physical and mental health and to health behaviors. Front Psychol. 2015;25:317. Fernández-Abascal EG, Martín-Díaz MD. Dimensions of emotional intelligence related to physical and mental health and to health behaviors. Front Psychol. 2015;25:317.
45.
go back to reference Goleman D. Emotional Intelligence. New York: Bantam Books; 1995. Goleman D. Emotional Intelligence. New York: Bantam Books; 1995.
46.
go back to reference Bar-On R. Emotional intelligence: an integral part of positive psychology. S Afr J Psychol. 2010;40:54–62.CrossRef Bar-On R. Emotional intelligence: an integral part of positive psychology. S Afr J Psychol. 2010;40:54–62.CrossRef
47.
go back to reference Martins A, Ramalho N, Morin E. A comprehensive meta-analysis of the relationship between emotional intelligence and health. Pers Individ Dif. 2010;49:554–64.CrossRef Martins A, Ramalho N, Morin E. A comprehensive meta-analysis of the relationship between emotional intelligence and health. Pers Individ Dif. 2010;49:554–64.CrossRef
48.
go back to reference Ryan RM, Deci EL. On happiness and human potentials: a review of research on hedonic and eudaimonic well-being. Annu Rev Psychol. 2001;52:141–66.PubMedCrossRef Ryan RM, Deci EL. On happiness and human potentials: a review of research on hedonic and eudaimonic well-being. Annu Rev Psychol. 2001;52:141–66.PubMedCrossRef
Metadata
Title
Development and validation of the Rapid Positive Mental Health Instrument (R-PMHI) for measuring mental health outcomes in the population
Authors
Janhavi Ajit Vaingankar
Edimansyah Abdin
Robertus Martinus van Dam
Siow Ann Chong
Linda Wei Lin Tan
Rajeswari Sambasivam
Esmond Seow
Boon Yiang Chua
Hwee Lin Wee
Wei Yen Lim
Mythily Subramaniam
Publication date
01-12-2020
Publisher
BioMed Central
Published in
BMC Public Health / Issue 1/2020
Electronic ISSN: 1471-2458
DOI
https://doi.org/10.1186/s12889-020-08569-w

Other articles of this Issue 1/2020

BMC Public Health 1/2020 Go to the issue