Skip to main content
Top
Published in: Quality of Life Research 10/2020

Open Access 01-10-2020

Proposal to extend the PROMIS® item bank v2.0 ‘Ability to Participate in Social Roles and Activities’: item generation and content validity

Authors: Lisette M. van Leeuwen, Sietske J. Tamminga, Margarita Ravinskaya, Astrid de Wind, Elisabeth A. Hahn, Caroline B. Terwee, Heleen Beckerman, Edwin J. Boezeman, Jan L. Hoving, Maaike A. Huysmans, Karen Nieuwenhuijsen, Angela G. E. M. de Boer, Allard J. van der Beek

Published in: Quality of Life Research | Issue 10/2020

Login to get access

Abstract

Purpose

Previous research indicated that the Patient-Reported Outcomes Measurement Information System (PROMIS®) item bank v2.0 ‘Ability to Participate in Social Roles and Activities’ may miss subdomains of social participation. The purpose of this study was to generate items for these missing subdomains and to evaluate their content validity.

Methods

A three-step approach was followed: (1) Item generation for 16 International Classification of Functioning Disability and Health subdomains currently not covered by the item bank; (2) Evaluation of content validity of generated items through expert review (n = 20) and think-aloud interviews with a purposeful sample of people with and without (chronic) health conditions (n = 10), to assess item comprehensibility, relevance, and comprehensiveness; and 3) Item revision based on the results of step 2, in a consensus procedure.

Results

First, 48 items were generated. Second, overall, content experts indicated that the generated items were relevant. Furthermore, based on experts’ responses, items were simplified and ‘participation in social media’ was identified as an important additional subdomain of social participation. Additionally, ‘participating in various social roles simultaneously’ was identified as a missing item. Based on the responses of the interviewed adults items were simplified. Third, in total 17 items, covering 17 subdomains, were proposed to be added to the original item bank.

Discussion

The relevance, comprehensibility and comprehensiveness of the 17 proposed items were supported. Whether the proposed extension of the item bank leads to better psychometric properties of the item bank should be tested in a large-scale field study.
Appendix
Available only for authorised users
Literature
1.
go back to reference Schuring, M., Mackenbach, J., Voorham, T., & Burdorf, A. (2011). The effect of re-employment on perceived health. Journal of Epidemiology and Community Health, 65(7), 639–644.CrossRef Schuring, M., Mackenbach, J., Voorham, T., & Burdorf, A. (2011). The effect of re-employment on perceived health. Journal of Epidemiology and Community Health, 65(7), 639–644.CrossRef
2.
go back to reference Deeg, D. J., & Bath, P. A. (2003). Self-rated health, gender, and mortality in older persons: Introduction to a special section. The Gerontologist, 43(3), 369–371.CrossRef Deeg, D. J., & Bath, P. A. (2003). Self-rated health, gender, and mortality in older persons: Introduction to a special section. The Gerontologist, 43(3), 369–371.CrossRef
3.
go back to reference Douglas, H., Georgiou, A., & Westbrook, J. (2017). Social participation as an indicator of successful aging: An overview of concepts and their associations with health. Australian Health Review, 41(4), 455–462.CrossRef Douglas, H., Georgiou, A., & Westbrook, J. (2017). Social participation as an indicator of successful aging: An overview of concepts and their associations with health. Australian Health Review, 41(4), 455–462.CrossRef
4.
go back to reference van der Holst, M., Groot, J., Steenbeek, D., Pondaag, W., Nelissen, R. G., & Vliet Vlieland, T. P. (2018). Participation restrictions among adolescents and adults with neonatal brachial plexus palsy: The patient perspective. Disability and Rehabilitation, 40(26), 3147–3155.CrossRef van der Holst, M., Groot, J., Steenbeek, D., Pondaag, W., Nelissen, R. G., & Vliet Vlieland, T. P. (2018). Participation restrictions among adolescents and adults with neonatal brachial plexus palsy: The patient perspective. Disability and Rehabilitation, 40(26), 3147–3155.CrossRef
5.
go back to reference Weinstein, M., Goldman, N., Hedley, A., Yu-Hsuan, L., & Seeman, T. (2003). Social linkages to biological markers of health among the elderly. Journal of Biosocial Science, 35(3), 433–453.CrossRef Weinstein, M., Goldman, N., Hedley, A., Yu-Hsuan, L., & Seeman, T. (2003). Social linkages to biological markers of health among the elderly. Journal of Biosocial Science, 35(3), 433–453.CrossRef
6.
go back to reference World Health Organization (WHO). (2001). International classification of functioning, disability and health: ICF. Geneva: World Health Organization. World Health Organization (WHO). (2001). International classification of functioning, disability and health: ICF. Geneva: World Health Organization.
7.
go back to reference Powell, J. M., Rich, T. J., & Wise, E. K. (2016). Effectiveness of occupation- and activity-based interventions to improve everyday activities and social participation for people with traumatic brain injury: A systematic review. The American Journal of Occupational Therapy, 70(3), 1–9. Powell, J. M., Rich, T. J., & Wise, E. K. (2016). Effectiveness of occupation- and activity-based interventions to improve everyday activities and social participation for people with traumatic brain injury: A systematic review. The American Journal of Occupational Therapy, 70(3), 1–9.
8.
go back to reference de Wind, A., van der Beek, A. J., Boezeman, E. J., Swenneker, R., Anema, J. R., de Boer, A., et al. (2019). A qualitative study investigating the meaning of participation to improve the measurement of this construct. Quality of Life Research, 28(8), 2233–2246.CrossRef de Wind, A., van der Beek, A. J., Boezeman, E. J., Swenneker, R., Anema, J. R., de Boer, A., et al. (2019). A qualitative study investigating the meaning of participation to improve the measurement of this construct. Quality of Life Research, 28(8), 2233–2246.CrossRef
9.
go back to reference Hahn, E. A., DeVellis, R. F., Bode, R. K., Garcia, S. F., Castel, L. D., Eisen, S. V., et al. (2010). Measuring social health in the patient-reported outcomes measurement information system (PROMIS): Item bank development and testing. Quality of Life Research, 19(7), 1035–1044.CrossRef Hahn, E. A., DeVellis, R. F., Bode, R. K., Garcia, S. F., Castel, L. D., Eisen, S. V., et al. (2010). Measuring social health in the patient-reported outcomes measurement information system (PROMIS): Item bank development and testing. Quality of Life Research, 19(7), 1035–1044.CrossRef
10.
go back to reference Eyssen, I. C., Steultjens, M. P., Dekker, J., & Terwee, C. B. (2011). A systematic review of instruments assessing participation: Challenges in defining participation. Archives of Physical Medicine and Rehabilitation, 92(6), 983–997.CrossRef Eyssen, I. C., Steultjens, M. P., Dekker, J., & Terwee, C. B. (2011). A systematic review of instruments assessing participation: Challenges in defining participation. Archives of Physical Medicine and Rehabilitation, 92(6), 983–997.CrossRef
11.
go back to reference Hahn, E. A., DeWalt, D. A., Bode, R. K., Garcia, S. F., DeVellis, R. F., Correia, H., et al. (2014). New English and Spanish social health measures will facilitate evaluating health determinants. Health Psychology, 33(5), 490.CrossRef Hahn, E. A., DeWalt, D. A., Bode, R. K., Garcia, S. F., DeVellis, R. F., Correia, H., et al. (2014). New English and Spanish social health measures will facilitate evaluating health determinants. Health Psychology, 33(5), 490.CrossRef
12.
go back to reference Embretson, S. E., & Reise, S. P. (2013). Item response theory. Oxford: Psychology Press.CrossRef Embretson, S. E., & Reise, S. P. (2013). Item response theory. Oxford: Psychology Press.CrossRef
13.
go back to reference Nunnally, J. C. (1994). Psychometric theory 3E. New York: Tata McGraw-Hill Education. Nunnally, J. C. (1994). Psychometric theory 3E. New York: Tata McGraw-Hill Education.
14.
go back to reference Wright, K. B. (2016). Communication in health-related online social support groups/communities: A review of research on predictors of participation, applications of social support theory, and health outcomes. Review of Communication Research, 4, 65–87. Wright, K. B. (2016). Communication in health-related online social support groups/communities: A review of research on predictors of participation, applications of social support theory, and health outcomes. Review of Communication Research, 4, 65–87.
15.
go back to reference Castel, L. D., Williams, K. A., Bosworth, H. B., Eisen, S. V., Hahn, E. A., Irwin, D. E., et al. (2008). Content validity in the PROMIS social-health domain: A qualitative analysis of focus-group data. Quality of Life Research, 17(5), 737–749.CrossRef Castel, L. D., Williams, K. A., Bosworth, H. B., Eisen, S. V., Hahn, E. A., Irwin, D. E., et al. (2008). Content validity in the PROMIS social-health domain: A qualitative analysis of focus-group data. Quality of Life Research, 17(5), 737–749.CrossRef
16.
go back to reference Bartlett, S. J., Orbai, A. M., Duncan, T., DeLeon, E., Ruffing, V., Clegg-Smith, K., et al. (2015). Reliability and validity of selected PROMIS measures in people with rheumatoid arthritis. PLoS ONE, 10(9), e0138543.CrossRef Bartlett, S. J., Orbai, A. M., Duncan, T., DeLeon, E., Ruffing, V., Clegg-Smith, K., et al. (2015). Reliability and validity of selected PROMIS measures in people with rheumatoid arthritis. PLoS ONE, 10(9), e0138543.CrossRef
17.
go back to reference Ahmad, F. S., Kallen, M. A., Schifferdecker, K. E., Carluzzo, K. L., Yount, S. E., Gelow, J. M., et al. (2019). Development and initial validation of the PROMIS(R)-Plus-HF profile measure. Circulation Heart failure, 12(6), e005751.CrossRef Ahmad, F. S., Kallen, M. A., Schifferdecker, K. E., Carluzzo, K. L., Yount, S. E., Gelow, J. M., et al. (2019). Development and initial validation of the PROMIS(R)-Plus-HF profile measure. Circulation Heart failure, 12(6), e005751.CrossRef
18.
go back to reference van der Meij, E., Anema, J. R., Huirne, J. A. F., & Terwee, C. B. (2018). Using PROMIS for measuring recovery after abdominal surgery: A pilot study. BMC Health Services Research, 18(1), 128.CrossRef van der Meij, E., Anema, J. R., Huirne, J. A. F., & Terwee, C. B. (2018). Using PROMIS for measuring recovery after abdominal surgery: A pilot study. BMC Health Services Research, 18(1), 128.CrossRef
19.
go back to reference Terwee, C. B., Roorda, L. D., de Vet, H. C., Dekker, J., Westhovens, R., van Leeuwen, J., et al. (2014). Dutch-Flemish translation of 17 item banks from the patient-reported outcomes measurement information system (PROMIS). Quality of Life Research, 23(6), 1733–1741.PubMed Terwee, C. B., Roorda, L. D., de Vet, H. C., Dekker, J., Westhovens, R., van Leeuwen, J., et al. (2014). Dutch-Flemish translation of 17 item banks from the patient-reported outcomes measurement information system (PROMIS). Quality of Life Research, 23(6), 1733–1741.PubMed
20.
go back to reference Terwee, C. B., Crins, M. H. P., Boers, M., de Vet, H. C. W., & Roorda, L. D. (2019). Validation of two PROMIS item banks for measuring social participation in the Dutch general population. Quality of Life Research, 28(1), 211–220.CrossRef Terwee, C. B., Crins, M. H. P., Boers, M., de Vet, H. C. W., & Roorda, L. D. (2019). Validation of two PROMIS item banks for measuring social participation in the Dutch general population. Quality of Life Research, 28(1), 211–220.CrossRef
21.
go back to reference Hammel, J., Magasi, S., Heinemann, A., Whiteneck, G., Bogner, J., & Rodriguez, E. (2008). What does participation mean? An insider perspective from people with disabilities. Disability and Rehabilitation, 30(19), 1445–1460.CrossRef Hammel, J., Magasi, S., Heinemann, A., Whiteneck, G., Bogner, J., & Rodriguez, E. (2008). What does participation mean? An insider perspective from people with disabilities. Disability and Rehabilitation, 30(19), 1445–1460.CrossRef
22.
go back to reference Chang, F. H., & Coster, W. J. (2014). Conceptualizing the construct of participation in adults with disabilities. Archives of Physical Medicine and Rehabilitation, 95(9), 1791–1798.CrossRef Chang, F. H., & Coster, W. J. (2014). Conceptualizing the construct of participation in adults with disabilities. Archives of Physical Medicine and Rehabilitation, 95(9), 1791–1798.CrossRef
23.
go back to reference Norlander, A., Iwarsson, S., Jonsson, A. C., Lindgren, A., & Mansson Lexell, E. (2018). Living and ageing with stroke: An exploration of conditions influencing participation in social and leisure activities over 15 years. Brain Injury, 32(7), 858–866.CrossRef Norlander, A., Iwarsson, S., Jonsson, A. C., Lindgren, A., & Mansson Lexell, E. (2018). Living and ageing with stroke: An exploration of conditions influencing participation in social and leisure activities over 15 years. Brain Injury, 32(7), 858–866.CrossRef
24.
go back to reference Tucker, C. A., Cieza, A., Riley, A. W., Stucki, G., Lai, J. S., Bedirhan Ustun, T., et al. (2014). Concept analysis of the patient reported outcomes measurement information system (PROMIS((R))) and the international classification of functioning, disability and health (ICF). Quality of Life Research, 23(6), 1677–1686.CrossRef Tucker, C. A., Cieza, A., Riley, A. W., Stucki, G., Lai, J. S., Bedirhan Ustun, T., et al. (2014). Concept analysis of the patient reported outcomes measurement information system (PROMIS((R))) and the international classification of functioning, disability and health (ICF). Quality of Life Research, 23(6), 1677–1686.CrossRef
26.
go back to reference DeWalt, D. A., Rothrock, N., Yount, S., & Stone, A. A. (2007). Evaluation of item candidates: The PROMIS qualitative item review. Medical Care, 45(5 Suppl 1), S12.CrossRef DeWalt, D. A., Rothrock, N., Yount, S., & Stone, A. A. (2007). Evaluation of item candidates: The PROMIS qualitative item review. Medical Care, 45(5 Suppl 1), S12.CrossRef
27.
go back to reference Terwee, C. B., Prinsen, C. A. C., Chiarotto, A., Westerman, M. J., Patrick, D. L., Alonso, J., et al. (2018). COSMIN methodology for evaluating the content validity of patient-reported outcome measures: A Delphi study. Quality of Life Research, 27(5), 1159–1170.CrossRef Terwee, C. B., Prinsen, C. A. C., Chiarotto, A., Westerman, M. J., Patrick, D. L., Alonso, J., et al. (2018). COSMIN methodology for evaluating the content validity of patient-reported outcome measures: A Delphi study. Quality of Life Research, 27(5), 1159–1170.CrossRef
29.
go back to reference Corbin, J. M., & Strauss, A. (1990). Grounded theory research: Procedures, canons, and evaluative criteria. Qualitative Sociology, 13(1), 3–21.CrossRef Corbin, J. M., & Strauss, A. (1990). Grounded theory research: Procedures, canons, and evaluative criteria. Qualitative Sociology, 13(1), 3–21.CrossRef
30.
go back to reference Van Someren, M., Barnard, Y., & Sandberg, J. (1994). The think aloud method: A practical approach to modelling cognitive processes. London: Academic Press. Van Someren, M., Barnard, Y., & Sandberg, J. (1994). The think aloud method: A practical approach to modelling cognitive processes. London: Academic Press.
32.
go back to reference Bruijning, J. E., van Rens, G. H. M. B., Knol, D., & van Nispen, R. M. A. (2013). Psychometric analyses to improve the Dutch ICF Activity Inventory. Optometry and Vision Science, 90(8), 806–819.CrossRef Bruijning, J. E., van Rens, G. H. M. B., Knol, D., & van Nispen, R. M. A. (2013). Psychometric analyses to improve the Dutch ICF Activity Inventory. Optometry and Vision Science, 90(8), 806–819.CrossRef
33.
go back to reference Elsman, E. B. M., van Rens, G. H. M. B., & Nispen, R. M. A. (2018). Psychometric properties of a new intake questionnaire for visually impaired young adults: The participation and activity inventory for young adults (PAI-YA). PLoS ONE, 13(8), e0201701.CrossRef Elsman, E. B. M., van Rens, G. H. M. B., & Nispen, R. M. A. (2018). Psychometric properties of a new intake questionnaire for visually impaired young adults: The participation and activity inventory for young adults (PAI-YA). PLoS ONE, 13(8), e0201701.CrossRef
34.
go back to reference Kostanjsek, N. (2011). Use of The International Classification of Functioning, Disability and Health (ICF) as a conceptual framework and common language for disability statistics and health information systems. BMC Public Health, 11, S3.CrossRef Kostanjsek, N. (2011). Use of The International Classification of Functioning, Disability and Health (ICF) as a conceptual framework and common language for disability statistics and health information systems. BMC Public Health, 11, S3.CrossRef
35.
go back to reference Gershon, R. C. (2005). Computer adaptive testing. Journal of Applied Measurement, 6(1), 109–127.PubMed Gershon, R. C. (2005). Computer adaptive testing. Journal of Applied Measurement, 6(1), 109–127.PubMed
36.
go back to reference Flynn, K. E., Lin, L., Cyranowski, J. M., Reeve, B. B., Reese, J. B., Jeffery, D. D., et al. (2013). Development of the NIH PROMIS (R) sexual function and satisfaction measures in patients with cancer. The Journal of Sexual Medicine, 10(Suppl 1), 43–52.CrossRef Flynn, K. E., Lin, L., Cyranowski, J. M., Reeve, B. B., Reese, J. B., Jeffery, D. D., et al. (2013). Development of the NIH PROMIS (R) sexual function and satisfaction measures in patients with cancer. The Journal of Sexual Medicine, 10(Suppl 1), 43–52.CrossRef
Metadata
Title
Proposal to extend the PROMIS® item bank v2.0 ‘Ability to Participate in Social Roles and Activities’: item generation and content validity
Authors
Lisette M. van Leeuwen
Sietske J. Tamminga
Margarita Ravinskaya
Astrid de Wind
Elisabeth A. Hahn
Caroline B. Terwee
Heleen Beckerman
Edwin J. Boezeman
Jan L. Hoving
Maaike A. Huysmans
Karen Nieuwenhuijsen
Angela G. E. M. de Boer
Allard J. van der Beek
Publication date
01-10-2020
Publisher
Springer International Publishing
Published in
Quality of Life Research / Issue 10/2020
Print ISSN: 0962-9343
Electronic ISSN: 1573-2649
DOI
https://doi.org/10.1007/s11136-020-02540-3

Other articles of this Issue 10/2020

Quality of Life Research 10/2020 Go to the issue