Skip to main content
Top
Published in: Health and Quality of Life Outcomes 1/2019

Open Access 01-12-2019 | Research

Validity and reliability of the (adjusted) Impact on Participation and Autonomy questionnaire for social-support populations

Authors: Lucienne Berenschot, Yolanda Grift

Published in: Health and Quality of Life Outcomes | Issue 1/2019

Login to get access

Abstract

Background

Decentralisation of social support and budget cuts spurred interest in outcome-oriented payment systems in the Netherlands. Hence, measurement of relevant outcomes, such as self-reliance and participation, is needed. The Impact on Participation and Autonomy (IPA) questionnaire for rehabilitation clients was adapted for social support, called IPA-MO, and its validity and reliability were tested among social support clients in eight municipalities in 2014 and 2016.

Methods

The total research sample comprised of 4120 persons. Homogeneous subgroups were distinguished based on 1) disability and 2) age. Exploratory factor analysis (PCF) was used to identify domains for IPA-MO. Model fit was assessed with Confirmatory Factor Analysis (CFA) using structural equation modelling.

Results

PCF revealed that the IPA-MO model consists of all five original IPA domains: Autonomy indoors, Family role, Autonomy outdoors, Social life and relations, and Work and education. As a result of new items added, a new, sixth domain was developed: Financial autonomy. Due to high non-response on Work & education, construct validity was first tested for a five-domain IPA-MO model. The composition of the IPA-MO domains showed slight differences: the item on ‘mobility indoor’ shifted from Autonomy indoors (IPA) to Family Role in IPA-MO. The item on reciprocity shifted from Social Life and relations (IPA) to Autonomy outdoors (IPA-MO). Internal reliability was confirmed for all domains (Cronbach’s alpha >.80). CFA showed acceptable construct validity of the five-domain IPA-MO model for the social support population (CFI .936, TLI .925, SRMR .051), all age groups and most disability-based groups. Construct validity including Work & education was tested for 234 participants. Then, PCF revealed six domains and the model fit was acceptable (CFI .915, TLI .903, SRMR .067).

Conclusions

IPA-MO is a valid and reliable instrument to assess outcomes of social support. Further research on the domain Financial autonomy is needed. Social-support clients are numerous and dispersed and, in spite of the best intentions, hard to involve widely in policy processes. A valid outcome measure offers municipalities possibilities to gain insight in social costs and benefits of new policies. Outcome measurement also allows to contract bundled-services of providers, thereby changing the incentives for providers from increasing production to much needed innovation. Taking the perceptions of autonomy and participation of social-support clients as the acid test for the effectiveness of social support policies, may prove a serious game-changer in politics.
Appendix
Available only for authorised users
Footnotes
1
Following the instruction manual, sections of the questionnaire are invalid when less than 75% of the items have been answered
 
2
Up to the age of 95 years old, the majority of Dutch inhabitants live independently. Under the Social Support Act (Wmo), local governments have the responsibility to assist them with technical aids and ambulant support if needed. Given the ageing Dutch population and the fact that government policies have restricted entrance to intramural care, the number of elderly Wmo clients is likely to increase [37]
 
3
E.g. 6a is “Getting washed and dressed the way I want” and 6b is “getting washed and dressed when I want”
 
4
MO refers to Maatschappelijke Ondersteuning (Social Support)
 
Literature
1.
go back to reference Government Gazette of the Netherlands. Uitvoeringsbesluit Wmo 2015. Staatsblad van het Koninkrijk der Nederlanden, 2014, nr 420. 2014. Government Gazette of the Netherlands. Uitvoeringsbesluit Wmo 2015. Staatsblad van het Koninkrijk der Nederlanden, 2014, nr 420. 2014.
2.
go back to reference Government Gazette of the Netherlands. Invoeringswet Participatiewet.: Staatsblad van het Koninkrijk der Nederlanden, 2014, nr 270. 2014. Government Gazette of the Netherlands. Invoeringswet Participatiewet.: Staatsblad van het Koninkrijk der Nederlanden, 2014, nr 270. 2014.
3.
go back to reference Government Gazette of the Netherlands. Jeugdwet Staatsblad van het Koninkrijk der Nederlanden, 2014, nr 105. 2014. Government Gazette of the Netherlands. Jeugdwet Staatsblad van het Koninkrijk der Nederlanden, 2014, nr 105. 2014.
4.
go back to reference Raad voor Maatschappelijke Ontwikkeling. Terugtreden is vooruitzien. The Hague: Advies 54; 2014. Raad voor Maatschappelijke Ontwikkeling. Terugtreden is vooruitzien. The Hague: Advies 54; 2014.
5.
go back to reference WHO. Towards a common language for functioning, disability and health: ICF – the International Classification of Functioning, Disability and Health. Geneva: World Health Organisation; 2002. WHO. Towards a common language for functioning, disability and health: ICF – the International Classification of Functioning, Disability and Health. Geneva: World Health Organisation; 2002.
7.
go back to reference Berenschot L, van der Geest L. Handreiking ‘Sturen op uitkomsten in de Wmo – investeren in maatschappelijke participatie’. Utrecht: Nyfer. Berenschot L, van der Geest L. Handreiking ‘Sturen op uitkomsten in de Wmo – investeren in maatschappelijke participatie’. Utrecht: Nyfer.
8.
go back to reference Brickley JA, Smith CW, Zimmerman JL. Managerial economics and organizational architecture. Boston: McGraw-Hill; 2014. Brickley JA, Smith CW, Zimmerman JL. Managerial economics and organizational architecture. Boston: McGraw-Hill; 2014.
9.
go back to reference Cardol M. Beyond disability. Assessing participation and autonomy in medical rehabilitation. PhD dissertation: University of Amsterdam, Faculty of Medicine; 2001. Cardol M. Beyond disability. Assessing participation and autonomy in medical rehabilitation. PhD dissertation: University of Amsterdam, Faculty of Medicine; 2001.
11.
go back to reference Costanza R, Fisher B, Ali S, Beer C, Bond L, Boumans R, Danigelis NL, Dickinson J, Elliott C, Farley J, Elliott Gayer D, MacDonald Glenn L, Hudspeth T, Mahoney D, McCahill L, McIntosh B, Reed B, Abu Turab S, Rizvi DM, Rizzo T, Simpatico RS. Quality of life: an approach integrating opportunities, human needs and subjective well-being. Ecol Econ. 2007;61:267–76.CrossRef Costanza R, Fisher B, Ali S, Beer C, Bond L, Boumans R, Danigelis NL, Dickinson J, Elliott C, Farley J, Elliott Gayer D, MacDonald Glenn L, Hudspeth T, Mahoney D, McCahill L, McIntosh B, Reed B, Abu Turab S, Rizvi DM, Rizzo T, Simpatico RS. Quality of life: an approach integrating opportunities, human needs and subjective well-being. Ecol Econ. 2007;61:267–76.CrossRef
12.
go back to reference Häggström A, Larsson M. The complexity of participation in daily life: a qualitative study of the experiences of persons with acquired brain injury. J Rehabil Med. 2008;40:89–95.CrossRef Häggström A, Larsson M. The complexity of participation in daily life: a qualitative study of the experiences of persons with acquired brain injury. J Rehabil Med. 2008;40:89–95.CrossRef
13.
go back to reference Whiteneck G, Dijkers MP. Difficult to measure constructs: conceptual and methodological issues concerning participation and environmental factors. Arch Phys Med Rehabil. 2009;90(11):S22–35.CrossRef Whiteneck G, Dijkers MP. Difficult to measure constructs: conceptual and methodological issues concerning participation and environmental factors. Arch Phys Med Rehabil. 2009;90(11):S22–35.CrossRef
14.
go back to reference Cardol MM, de Haan RJ, de Jong BA, van den Bos GAM, de Groot IJM. Psychometric properties of the ‘Impact on Participation and Autonomy’ (IPA) questionnaire. Arch Phys Med Rehabil. 2001;82:210–6.CrossRef Cardol MM, de Haan RJ, de Jong BA, van den Bos GAM, de Groot IJM. Psychometric properties of the ‘Impact on Participation and Autonomy’ (IPA) questionnaire. Arch Phys Med Rehabil. 2001;82:210–6.CrossRef
15.
go back to reference Sibley A, Kersten P, White WB, Mehta R, George S. Measuring autonomy in disabled people: validation of a new domain in a UK population. Clin Rehabil. 2006;20:793–803.CrossRef Sibley A, Kersten P, White WB, Mehta R, George S. Measuring autonomy in disabled people: validation of a new domain in a UK population. Clin Rehabil. 2006;20:793–803.CrossRef
16.
go back to reference Lund L, Maria AGF, Lexell J, Bernspång B. Impact on Participation and Autonomy questionnaire: internal domain validity of the Swedish version for use in people with spinal cord injury. J Rehabil Med. 2007;39:156–62.CrossRef Lund L, Maria AGF, Lexell J, Bernspång B. Impact on Participation and Autonomy questionnaire: internal domain validity of the Swedish version for use in people with spinal cord injury. J Rehabil Med. 2007;39:156–62.CrossRef
17.
go back to reference Franchignoni F, Ferriero G, Giordano A, Guglielmi V, Picco D. Rasch psychometric validation of the Impact on Participation and Autonomy questionnaire in people with Parkinson’s disease. Eura Medicophys. 2007;43(4):451–61.PubMed Franchignoni F, Ferriero G, Giordano A, Guglielmi V, Picco D. Rasch psychometric validation of the Impact on Participation and Autonomy questionnaire in people with Parkinson’s disease. Eura Medicophys. 2007;43(4):451–61.PubMed
18.
go back to reference Poulin V, Desrosiers J. Validation française de questionnaires de participation sociale auprès d’aînés en situation d’incapacités. Can J Occup Ther. 2010;77(3):159–66.CrossRef Poulin V, Desrosiers J. Validation française de questionnaires de participation sociale auprès d’aînés en situation d’incapacités. Can J Occup Ther. 2010;77(3):159–66.CrossRef
19.
go back to reference Fallahpour M, Tham K, Joghataei MT, Jonsson H. Perceived participation and autonomy: aspects of functioning and contextual factors predicting participation after stroke. J Rehabil Med. 2011;43:388–97.CrossRef Fallahpour M, Tham K, Joghataei MT, Jonsson H. Perceived participation and autonomy: aspects of functioning and contextual factors predicting participation after stroke. J Rehabil Med. 2011;43:388–97.CrossRef
20.
go back to reference Fallahpour M, Jonsson H, Taghi Joghata M, Kottorp A. Impact on Participation and Autonomy (IPA): psychometric evaluation of the Persian version to use for persons with stroke. Scand J Occup Ther. 2011;18:59–71.CrossRef Fallahpour M, Jonsson H, Taghi Joghata M, Kottorp A. Impact on Participation and Autonomy (IPA): psychometric evaluation of the Persian version to use for persons with stroke. Scand J Occup Ther. 2011;18:59–71.CrossRef
21.
go back to reference Sutiwong J, Vongsirinavarat M, Vachalathiti R, Chaiyawat P. Impact on Participation and Autonomy questionnaire: psychometric properties of the Thai version. J Phys Ther Sci. 2013;25:769–74.CrossRef Sutiwong J, Vongsirinavarat M, Vachalathiti R, Chaiyawat P. Impact on Participation and Autonomy questionnaire: psychometric properties of the Thai version. J Phys Ther Sci. 2013;25:769–74.CrossRef
22.
go back to reference Mueller M, Strobl R, Jahn K, Linkohr B, Ladwig KH, Mielck A, Grill E. Impact of vertigo and dizziness on self-perceived participation and autonomy in older adults: results from the KORA-age study. Qual Life Res. 2014;23:2301–8.CrossRef Mueller M, Strobl R, Jahn K, Linkohr B, Ladwig KH, Mielck A, Grill E. Impact of vertigo and dizziness on self-perceived participation and autonomy in older adults: results from the KORA-age study. Qual Life Res. 2014;23:2301–8.CrossRef
23.
go back to reference Wilkie R, Jordan JL, Muller S, Nicholls E, Healey EL, van der Windt DA. Measures of social function and participation in musculoskeletal populations. Arthritis Care Res. 2011;63(S11):S325–36.CrossRef Wilkie R, Jordan JL, Muller S, Nicholls E, Healey EL, van der Windt DA. Measures of social function and participation in musculoskeletal populations. Arthritis Care Res. 2011;63(S11):S325–36.CrossRef
24.
go back to reference Divosa/Regioplan. Mesis – methodisch screeningsinstrument schulddienst-verlening. Utrecht; 2012. Divosa/Regioplan. Mesis – methodisch screeningsinstrument schulddienst-verlening. Utrecht; 2012.
25.
go back to reference Oomens S, T de Jong, RWB Blonk. Gezondheid en functioneren van moeilijk bemiddelbare bijstandsgerechtigden in een gesubsidieerde baan. Gedrag & Organisatie, 2016, Jrg 22. 2009. Nr 4. Oomens S, T de Jong, RWB Blonk. Gezondheid en functioneren van moeilijk bemiddelbare bijstandsgerechtigden in een gesubsidieerde baan. Gedrag & Organisatie, 2016, Jrg 22. 2009. Nr 4.
26.
go back to reference HHM. Cliëntgroepen extramurale begeleiding. Transitiebureau Invoering Wmo. The Hague; 2014. HHM. Cliëntgroepen extramurale begeleiding. Transitiebureau Invoering Wmo. The Hague; 2014.
28.
go back to reference Ottenvall Hammar I, Ekelund C, Wilhelmson K, Eklund K. Impact on Participation and Autonomy: test of validity and reliability for older persons. Health Psychol Res. 2014;2:1825.CrossRef Ottenvall Hammar I, Ekelund C, Wilhelmson K, Eklund K. Impact on Participation and Autonomy: test of validity and reliability for older persons. Health Psychol Res. 2014;2:1825.CrossRef
29.
go back to reference Mönks FJ. Ontwikkelingspsychologie. Inleiding tot de verschillende deelgebieden: Van Gorcum; 2015. Mönks FJ. Ontwikkelingspsychologie. Inleiding tot de verschillende deelgebieden: Van Gorcum; 2015.
30.
go back to reference van Houtum L, Cardol M, de Jong JD. Ondanks ‘keuzebiografie’ blijft de keuze beperkt: participatie naar levensfase. Netherlands: TSG: Tijdschrift voor Gezondheidswetenschappen. 2012;90(4):245–52. van Houtum L, Cardol M, de Jong JD. Ondanks ‘keuzebiografie’ blijft de keuze beperkt: participatie naar levensfase. Netherlands: TSG: Tijdschrift voor Gezondheidswetenschappen. 2012;90(4):245–52.
31.
go back to reference Hu L, Bentler PM. Cut off criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Struct Equ Model Multidiscip J. 1999;6(1):1–55.CrossRef Hu L, Bentler PM. Cut off criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Struct Equ Model Multidiscip J. 1999;6(1):1–55.CrossRef
33.
go back to reference Shen J, Gao S. A solution to separation and multicollinearity in multiple logistic regression. J Data Sci. 2008;6(4):515–31.PubMedPubMedCentral Shen J, Gao S. A solution to separation and multicollinearity in multiple logistic regression. J Data Sci. 2008;6(4):515–31.PubMedPubMedCentral
34.
go back to reference Haak M, Dahlin Ivanoff S, Fänge A, Sixsmith J, Iwarsson S. Home as the locus and origin for participation: experiences among very old Swedish people. OJTR: Occupation, Participation and Health. Summer. 2007;27(3):95–103. Haak M, Dahlin Ivanoff S, Fänge A, Sixsmith J, Iwarsson S. Home as the locus and origin for participation: experiences among very old Swedish people. OJTR: Occupation, Participation and Health. Summer. 2007;27(3):95–103.
35.
go back to reference Sixsmith J, Boneham M. Older men’s participation in community life: notions of social capital, health and empowerment. Ageing Int. 2003;28(4):372–88.CrossRef Sixsmith J, Boneham M. Older men’s participation in community life: notions of social capital, health and empowerment. Ageing Int. 2003;28(4):372–88.CrossRef
36.
go back to reference SEO. Werkwijzer voor kosten-batenanalyse in het sociale domein. (Guide for cost-benefit analysis in social policies). Rotterdam; 2016. SEO. Werkwijzer voor kosten-batenanalyse in het sociale domein. (Guide for cost-benefit analysis in social policies). Rotterdam; 2016.
37.
go back to reference van Campen C, Iedema J, van Groenou MB, Deeg D. Langer zelfstandig – ouder worden met hulpbronnen, ondersteuning en zorg. SCP. Den Haag; 2017. van Campen C, Iedema J, van Groenou MB, Deeg D. Langer zelfstandig – ouder worden met hulpbronnen, ondersteuning en zorg. SCP. Den Haag; 2017.
38.
go back to reference Pommer E, Boelhouwer J, van den Berg E, den Draak M. Rondom de transitie - Overall rapportage sociaal domein 2015. Sociaal Cultureel Planbureau. The Hage; 2016. Pommer E, Boelhouwer J, van den Berg E, den Draak M. Rondom de transitie - Overall rapportage sociaal domein 2015. Sociaal Cultureel Planbureau. The Hage; 2016.
40.
go back to reference Costello AB, Osborne JW. Best practices in exploratory factor analysis: four recommendations for getting the most from our analysis. Pract Assess Res Eval. 2005;10(7):1. Costello AB, Osborne JW. Best practices in exploratory factor analysis: four recommendations for getting the most from our analysis. Pract Assess Res Eval. 2005;10(7):1.
Metadata
Title
Validity and reliability of the (adjusted) Impact on Participation and Autonomy questionnaire for social-support populations
Authors
Lucienne Berenschot
Yolanda Grift
Publication date
01-12-2019
Publisher
BioMed Central
Published in
Health and Quality of Life Outcomes / Issue 1/2019
Electronic ISSN: 1477-7525
DOI
https://doi.org/10.1186/s12955-019-1106-0

Other articles of this Issue 1/2019

Health and Quality of Life Outcomes 1/2019 Go to the issue