Skip to main content
Top
Published in: BMC Medical Informatics and Decision Making 1/2011

Open Access 01-12-2011 | Research article

Process evaluation of a web-based intervention aimed at empowerment of disability benefit claimants

Authors: David Samoocha, Ingrid AK Snels, David J Bruinvels, Johannes R Anema, Wojtek Kowalczyk, Allard J van der Beek

Published in: BMC Medical Informatics and Decision Making | Issue 1/2011

Login to get access

Abstract

Background

The objective of this process evaluation study was to gain insight into the reach, compliance, appreciation, usage barriers, and users' perceived effectiveness of a web-based intervention http://​www.​wiagesprek.​nl. This intervention was aimed at empowerment of disability claimants, prior to the assessment of disability by an insurance physician.

Methods

Reach was determined by registering claimants exposed to the study's invitation brochures, and by comparing trial participant characteristics with non-participants and nationwide claimant data. Compliance was registered by analyzing weblogs, which were automatically collected during the period of the trial. This made it possible to analyze individual use of the intervention. Appreciation, usage barriers, and users' perceived effectiveness were assessed using an online questionnaire that was sent to participants from the intervention group, 6 weeks after enrolment.

Results

Only 9% of the target population enrolled in the internet program. Because of selective enrolment, more females, higher educated claimants, and less ethnical minorities were reached. Compliance was ambiguous: out of the 123 participants randomized into the intervention group, a significant proportion (33%) did not use the intervention at all, while, at the same time, many participants (32%) used the intervention for more than two hours (i.e. in approximately two weeks). Overall satisfaction with the intervention was good. Claimants perceived the intervention most effective in increasing knowledge, while also a fair amount of users perceived the intervention effective in gaining right expectations or being able to communicate better with their physician.

Conclusions

The uptake of the intervention http://​www.​wiagesprek.​nl was disappointing. Specifically, the poor reach and compliance of the intervention resulted in a small proportion of the target population using the intervention as intended. Improvements in the implementation process are desirable to increase the reach and compliance and, thereby possibly, the impact of the intervention.

Trial registration

Appendix
Available only for authorised users
Literature
1.
go back to reference Bensing J: Doctor-patient communication and the quality of care. Soc Sci Med. 1991, 32: 1301-10. 10.1016/0277-9536(91)90047-G.CrossRefPubMed Bensing J: Doctor-patient communication and the quality of care. Soc Sci Med. 1991, 32: 1301-10. 10.1016/0277-9536(91)90047-G.CrossRefPubMed
2.
3.
go back to reference Wensing M, Grol R: What can patients do to improve health care?. Health Expect. 1998, 1: 37-49. 10.1046/j.1369-6513.1998.00005.x.CrossRefPubMed Wensing M, Grol R: What can patients do to improve health care?. Health Expect. 1998, 1: 37-49. 10.1046/j.1369-6513.1998.00005.x.CrossRefPubMed
4.
go back to reference Kaplan SH, Greenfield S, Ware JE: Assessing the effects of physician-patient interactions on the outcomes of chronic disease. Med Care. 1989, 27: S110-S127. 10.1097/00005650-198903001-00010.CrossRefPubMed Kaplan SH, Greenfield S, Ware JE: Assessing the effects of physician-patient interactions on the outcomes of chronic disease. Med Care. 1989, 27: S110-S127. 10.1097/00005650-198903001-00010.CrossRefPubMed
5.
go back to reference Kidd J, Marteau TM, Robinson S, Ukoumunne OC, Tydeman C: Promoting patient participation in consultations: a randomised controlled trial to evaluate the effectiveness of three patient-focused interventions. Patient Educ Couns. 2004, 52: 107-12. 10.1016/S0738-3991(03)00018-1.CrossRefPubMed Kidd J, Marteau TM, Robinson S, Ukoumunne OC, Tydeman C: Promoting patient participation in consultations: a randomised controlled trial to evaluate the effectiveness of three patient-focused interventions. Patient Educ Couns. 2004, 52: 107-12. 10.1016/S0738-3991(03)00018-1.CrossRefPubMed
6.
go back to reference Haywood K, Marshall S, Fitzpatrick R: Patient participation in the consultation process: a structured review of intervention strategies. Patient Educ Couns. 2006, 63: 12-23. 10.1016/j.pec.2005.10.005.CrossRefPubMed Haywood K, Marshall S, Fitzpatrick R: Patient participation in the consultation process: a structured review of intervention strategies. Patient Educ Couns. 2006, 63: 12-23. 10.1016/j.pec.2005.10.005.CrossRefPubMed
7.
go back to reference Kinnersley P, Edwards A, Hood K, Ryan R, Prout H, Cadbury N: Interventions before consultations to help patients address their information needs by encouraging question asking: systematic review. BMJ. 2008, 337: a485-10.1136/bmj.a485.CrossRefPubMedPubMedCentral Kinnersley P, Edwards A, Hood K, Ryan R, Prout H, Cadbury N: Interventions before consultations to help patients address their information needs by encouraging question asking: systematic review. BMJ. 2008, 337: a485-10.1136/bmj.a485.CrossRefPubMedPubMedCentral
8.
go back to reference Spanjer J, Krol B, Popping R, Groothoff JW, Brouwer S: Disability assessment interview: the role of detailed information on functioning in addition to medical history-taking. J Rehabil Med. 2009, 41: 267-72. 10.2340/16501977-0323.CrossRefPubMed Spanjer J, Krol B, Popping R, Groothoff JW, Brouwer S: Disability assessment interview: the role of detailed information on functioning in addition to medical history-taking. J Rehabil Med. 2009, 41: 267-72. 10.2340/16501977-0323.CrossRefPubMed
9.
go back to reference Samoocha D, Bruinvels DJ, Anema JR, Steenbeek R, van der Beek AJ: Empowerment of disability benefit claimants through an interactive website: design of a randomized controlled trial. BMC Med Inform Decis Mak. 2009, 9: 23-10.1186/1472-6947-9-23.CrossRefPubMedPubMedCentral Samoocha D, Bruinvels DJ, Anema JR, Steenbeek R, van der Beek AJ: Empowerment of disability benefit claimants through an interactive website: design of a randomized controlled trial. BMC Med Inform Decis Mak. 2009, 9: 23-10.1186/1472-6947-9-23.CrossRefPubMedPubMedCentral
10.
go back to reference van Rijssen HJ, Schellart AJ, Anema JR, van der Beek AJ: A theoretical framework to describe communication processes during medical disability assessment interviews. BMC Public Health. 2009, 9: 375-10.1186/1471-2458-9-375.CrossRefPubMedPubMedCentral van Rijssen HJ, Schellart AJ, Anema JR, van der Beek AJ: A theoretical framework to describe communication processes during medical disability assessment interviews. BMC Public Health. 2009, 9: 375-10.1186/1471-2458-9-375.CrossRefPubMedPubMedCentral
11.
go back to reference Griffiths F, Lindenmeyer A, Powell J, Lowe P, Thorogood M: Why are health care interventions delivered over the internet? A systematic review of the published literature. J Med Internet Res. 2006, 8: e10-10.2196/jmir.8.2.e10.CrossRefPubMedPubMedCentral Griffiths F, Lindenmeyer A, Powell J, Lowe P, Thorogood M: Why are health care interventions delivered over the internet? A systematic review of the published literature. J Med Internet Res. 2006, 8: e10-10.2196/jmir.8.2.e10.CrossRefPubMedPubMedCentral
13.
go back to reference Saunders RP, Evans MH, Joshi P: Developing a process-evaluation plan for assessing health promotion program implementation: a how-to guide. Health Promot Pract. 2005, 6: 134-47. 10.1177/1524839904273387.CrossRefPubMed Saunders RP, Evans MH, Joshi P: Developing a process-evaluation plan for assessing health promotion program implementation: a how-to guide. Health Promot Pract. 2005, 6: 134-47. 10.1177/1524839904273387.CrossRefPubMed
14.
go back to reference Hawe P, Shiell A, Riley T: Complex interventions: how "out of control" can a randomised controlled trial be?. BMJ. 2004, 26: 1561-3. 10.1136/bmj.328.7455.1561.CrossRef Hawe P, Shiell A, Riley T: Complex interventions: how "out of control" can a randomised controlled trial be?. BMJ. 2004, 26: 1561-3. 10.1136/bmj.328.7455.1561.CrossRef
15.
16.
go back to reference Oakley A, Strange V, Bonell C, Allen E, Stephenson J: Process evaluation in randomised controlled trials of complex interventions. BMJ. 2006, 18: 413-6. 10.1136/bmj.332.7538.413.CrossRef Oakley A, Strange V, Bonell C, Allen E, Stephenson J: Process evaluation in randomised controlled trials of complex interventions. BMJ. 2006, 18: 413-6. 10.1136/bmj.332.7538.413.CrossRef
17.
go back to reference Grol R, Grimshaw J: From best evidence to best practice: effective implementation of change in patients' care. Lancet. 2003, 11: 1225-30. 10.1016/S0140-6736(03)14546-1.CrossRef Grol R, Grimshaw J: From best evidence to best practice: effective implementation of change in patients' care. Lancet. 2003, 11: 1225-30. 10.1016/S0140-6736(03)14546-1.CrossRef
18.
go back to reference Bartholomew LK, Parcel GS, Kok G: Intervention mapping: a process for developing theory- and evidence-based health education programs. Health Educ Behav. 1998, 25: 545-63. 10.1177/109019819802500502.CrossRefPubMed Bartholomew LK, Parcel GS, Kok G: Intervention mapping: a process for developing theory- and evidence-based health education programs. Health Educ Behav. 1998, 25: 545-63. 10.1177/109019819802500502.CrossRefPubMed
20.
21.
go back to reference Murray E, Khadjesari Z, White IR, Kalaitzaki E, Godfrey C, McCambridge J: Methodological challenges in online trials. J Med Internet Res. 2009, 11: e9-10.2196/jmir.1052.CrossRefPubMedPubMedCentral Murray E, Khadjesari Z, White IR, Kalaitzaki E, Godfrey C, McCambridge J: Methodological challenges in online trials. J Med Internet Res. 2009, 11: e9-10.2196/jmir.1052.CrossRefPubMedPubMedCentral
22.
go back to reference Stopponi MA, Alexander GL, McClure JB, Carroll NM, Divine GW, Calvi JH: Recruitment to a randomized web-based nutritional intervention trial: characteristics of participants compared to non-participants. J Med Internet Res. 2009, 11: e38-10.2196/jmir.1086.CrossRefPubMedPubMedCentral Stopponi MA, Alexander GL, McClure JB, Carroll NM, Divine GW, Calvi JH: Recruitment to a randomized web-based nutritional intervention trial: characteristics of participants compared to non-participants. J Med Internet Res. 2009, 11: e38-10.2196/jmir.1086.CrossRefPubMedPubMedCentral
24.
go back to reference de Jong P, Schrijvershof C, Veerman T: AStri: Vangnetters en Profil, Vergelijking tussen negen maanden zieke vangnetters en werknemers [Dutch]. 2008 de Jong P, Schrijvershof C, Veerman T: AStri: Vangnetters en Profil, Vergelijking tussen negen maanden zieke vangnetters en werknemers [Dutch]. 2008
25.
go back to reference van der Burg CL, Molenaar-Cox PGM: AStri: monitoring WGA-instromers van 2006 [Dutch]. 2009 van der Burg CL, Molenaar-Cox PGM: AStri: monitoring WGA-instromers van 2006 [Dutch]. 2009
26.
go back to reference Buis LR, Janney AW, Hess ML, Culver SA, Richardson CR: Barriers encountered during enrollment in an internet-mediated randomized controlled trial. Trials. 2009, 10: 76-10.1186/1745-6215-10-76.CrossRefPubMedPubMedCentral Buis LR, Janney AW, Hess ML, Culver SA, Richardson CR: Barriers encountered during enrollment in an internet-mediated randomized controlled trial. Trials. 2009, 10: 76-10.1186/1745-6215-10-76.CrossRefPubMedPubMedCentral
28.
go back to reference van Wier MF, Ariens GA, Dekkers JC, Hendriksen IJ, Smid T, van MW: Phone and e-mail counselling are effective for weight management in an overweight working population: a randomized controlled trial. BMC Public Health. 2009, 9: 6-10.1186/1471-2458-9-6.CrossRefPubMedPubMedCentral van Wier MF, Ariens GA, Dekkers JC, Hendriksen IJ, Smid T, van MW: Phone and e-mail counselling are effective for weight management in an overweight working population: a randomized controlled trial. BMC Public Health. 2009, 9: 6-10.1186/1471-2458-9-6.CrossRefPubMedPubMedCentral
29.
go back to reference van Zutphen M, Milder IE, Bemelmans WJ: Usage of an online healthy lifestyle program by pregnant women attending midwifery practices in Amsterdam. Prev Med. 2008, 46: 552-7. 10.1016/j.ypmed.2008.01.003.CrossRefPubMed van Zutphen M, Milder IE, Bemelmans WJ: Usage of an online healthy lifestyle program by pregnant women attending midwifery practices in Amsterdam. Prev Med. 2008, 46: 552-7. 10.1016/j.ypmed.2008.01.003.CrossRefPubMed
30.
go back to reference Danaher BG, Boles SM, Akers L, Gordon JS, Severson HH: Defining participant exposure measures in Web-based health behavior change programs. J Med Internet Res. 2006, 8: e15-10.2196/jmir.8.3.e15.CrossRefPubMedPubMedCentral Danaher BG, Boles SM, Akers L, Gordon JS, Severson HH: Defining participant exposure measures in Web-based health behavior change programs. J Med Internet Res. 2006, 8: e15-10.2196/jmir.8.3.e15.CrossRefPubMedPubMedCentral
31.
go back to reference Resnicow K, Strecher V, Couper M, Chua H, Little R, Nair V: Methodologic and design issues in patient-centered e-health research. Am J Prev Med. 2010, 38: 98-102. 10.1016/j.amepre.2009.09.034.CrossRefPubMed Resnicow K, Strecher V, Couper M, Chua H, Little R, Nair V: Methodologic and design issues in patient-centered e-health research. Am J Prev Med. 2010, 38: 98-102. 10.1016/j.amepre.2009.09.034.CrossRefPubMed
32.
go back to reference Grol R, Wensing M: What drives change? Barriers to and incentives for achieving evidence-based practice. Med J Aust. 2004, 180: S57-S60.PubMed Grol R, Wensing M: What drives change? Barriers to and incentives for achieving evidence-based practice. Med J Aust. 2004, 180: S57-S60.PubMed
Metadata
Title
Process evaluation of a web-based intervention aimed at empowerment of disability benefit claimants
Authors
David Samoocha
Ingrid AK Snels
David J Bruinvels
Johannes R Anema
Wojtek Kowalczyk
Allard J van der Beek
Publication date
01-12-2011
Publisher
BioMed Central
Published in
BMC Medical Informatics and Decision Making / Issue 1/2011
Electronic ISSN: 1472-6947
DOI
https://doi.org/10.1186/1472-6947-11-10

Other articles of this Issue 1/2011

BMC Medical Informatics and Decision Making 1/2011 Go to the issue