Skip to main content
Top
Published in: Health and Quality of Life Outcomes 1/2009

Open Access 01-12-2009 | Research

Reduction in patient burdens with graphical computerized adaptive testing on the ADL scale: tool development and simulation

Authors: Tsair-Wei Chien, Hing-Man Wu, Weng-Chung Wang, Roberto Vasquez Castillo, Willy Chou

Published in: Health and Quality of Life Outcomes | Issue 1/2009

Login to get access

Abstract

Background

The aim of this study was to verify the effectiveness and efficacy of saving time and reducing burden for patients, nurses, and even occupational therapists through computer adaptive testing (CAT).

Methods

Based on an item bank of the Barthel Index (BI) and the Frenchay Activities Index (FAI) for assessing comprehensive activities of daily living (ADL) function in stroke patients, we developed a visual basic application (VBA)-Excel CAT module, and (1) investigated whether the averaged test length via CAT is shorter than that of the traditional all-item-answered non-adaptive testing (NAT) approach through simulation, (2) illustrated the CAT multimedia on a tablet PC showing data collection and response errors of ADL clinical functional measures in stroke patients, and (3) demonstrated the quality control of endorsing scale with fit statistics to detect responding errors, which will be further immediately reconfirmed by technicians once patient ends the CAT assessment.

Results

The results show that endorsed items could be shorter on CAT (M = 13.42) than on NAT (M = 23) at 41.64% efficiency in test length. However, averaged ability estimations reveal insignificant differences between CAT and NAT.

Conclusion

This study found that mobile nursing services, placed at the bedsides of patients could, through the programmed VBA-Excel CAT module, reduce the burden to patients and save time, more so than the traditional NAT paper-and-pencil testing appraisals.
Appendix
Available only for authorised users
Literature
1.
go back to reference Motion C5: Improving Quality of Care and Nursing Workflow: A Clinician Usability Pilot of the Motion Mobile Clinical Assistant. 2007. Motion C5: Improving Quality of Care and Nursing Workflow: A Clinician Usability Pilot of the Motion Mobile Clinical Assistant. 2007.
2.
go back to reference Krogh PR, Rough S, Thomley S: Comparison of two personal-computer-based mobile devices to support pharmacists' clinical documentation. Am J Health Syst Pharm 2008,15, 65(2):154–7. 10.2146/ajhp070177CrossRef Krogh PR, Rough S, Thomley S: Comparison of two personal-computer-based mobile devices to support pharmacists' clinical documentation. Am J Health Syst Pharm 2008,15, 65(2):154–7. 10.2146/ajhp070177CrossRef
3.
go back to reference Wu M, Rhyner PM, Thao C, Kraniak L, Cronk C, Cruise K: A tablet-PC application for the individual family service plan (IFSP). J Med Syst 2007,31(6):537–41. 10.1007/s10916-007-9095-7CrossRef Wu M, Rhyner PM, Thao C, Kraniak L, Cronk C, Cruise K: A tablet-PC application for the individual family service plan (IFSP). J Med Syst 2007,31(6):537–41. 10.1007/s10916-007-9095-7CrossRef
4.
go back to reference Lord FM: Applications of item response theory to practical testing problems. Hillsdale, NJ: Lawrence Erlbaum; 1980. Lord FM: Applications of item response theory to practical testing problems. Hillsdale, NJ: Lawrence Erlbaum; 1980.
5.
go back to reference Pedersen PM, Jorgensen HS, Nakayama H, Raaschou HO, Olsen TS: Comprehensive assessment of activities of daily living in stroke: the Copenhagen Stroke Study. Arch Phys Med Rehabil 1997, 78: 161–165. 10.1016/S0003-9993(97)90258-6CrossRef Pedersen PM, Jorgensen HS, Nakayama H, Raaschou HO, Olsen TS: Comprehensive assessment of activities of daily living in stroke: the Copenhagen Stroke Study. Arch Phys Med Rehabil 1997, 78: 161–165. 10.1016/S0003-9993(97)90258-6CrossRef
6.
go back to reference Wainer HW, Dorans NJ, Flaugher R, Green BF, Mislevy RJ, Steinberg L, Thissen D: Computerized adaptive testing: A primer. Hillsdale, NJ: Erlbaum; 1990. Wainer HW, Dorans NJ, Flaugher R, Green BF, Mislevy RJ, Steinberg L, Thissen D: Computerized adaptive testing: A primer. Hillsdale, NJ: Erlbaum; 1990.
7.
go back to reference Weiss DJ, Mcbride JR: Bias and information of Bayesian adaptive testing. Applied Psychological Measurement 1984,8(3):273–285. 10.1177/014662168400800303CrossRef Weiss DJ, Mcbride JR: Bias and information of Bayesian adaptive testing. Applied Psychological Measurement 1984,8(3):273–285. 10.1177/014662168400800303CrossRef
8.
go back to reference Rasch G: Probabilistic models for some Intelligence and attainment tests. Chicago: University of Chicago Press; 1960. Rasch G: Probabilistic models for some Intelligence and attainment tests. Chicago: University of Chicago Press; 1960.
9.
go back to reference Hsueh IP, Wang WC, Sheu CF, Hsieh CL: Rasch analysis of combining two indices to assess comprehensive ADL function in stroke patients. Stroke 2004, 35: 721–726. 10.1161/01.STR.0000117569.34232.76CrossRef Hsueh IP, Wang WC, Sheu CF, Hsieh CL: Rasch analysis of combining two indices to assess comprehensive ADL function in stroke patients. Stroke 2004, 35: 721–726. 10.1161/01.STR.0000117569.34232.76CrossRef
10.
go back to reference Kelly-Hayes M, Robertson JT, Broderick JP, Duncan PW, Hershey LA, Roth EJ, Thies WH, Trombly CA: The American Heart Association stroke outcome classification. Stroke 1998, 29: 1274–1280.CrossRef Kelly-Hayes M, Robertson JT, Broderick JP, Duncan PW, Hershey LA, Roth EJ, Thies WH, Trombly CA: The American Heart Association stroke outcome classification. Stroke 1998, 29: 1274–1280.CrossRef
11.
go back to reference Hsieh CL, Hsueh IP: A cross-validation of the comprehensive assessment of activities of daily living after stroke. cand J Rehabil Med 1999, 31: 83–88. 10.1080/003655099444588CrossRef Hsieh CL, Hsueh IP: A cross-validation of the comprehensive assessment of activities of daily living after stroke. cand J Rehabil Med 1999, 31: 83–88. 10.1080/003655099444588CrossRef
12.
go back to reference Duncan PW, Lai SM, Bode RK, Perera S, DeRosa J: Stroke Impact Scale-16: a brief assessment of physical function. Neurology 2003, 60: 291–296. 10.1001/archneur.60.2.291CrossRef Duncan PW, Lai SM, Bode RK, Perera S, DeRosa J: Stroke Impact Scale-16: a brief assessment of physical function. Neurology 2003, 60: 291–296. 10.1001/archneur.60.2.291CrossRef
13.
go back to reference Lai SM, Perera S, Duncan PW, Bode R: Physical and social functioning after stroke: comparison of the Stroke Impact Scale and Short Form-36. Stroke 2003, 34: 488–493. 10.1161/01.STR.0000054162.94998.C0CrossRef Lai SM, Perera S, Duncan PW, Bode R: Physical and social functioning after stroke: comparison of the Stroke Impact Scale and Short Form-36. Stroke 2003, 34: 488–493. 10.1161/01.STR.0000054162.94998.C0CrossRef
15.
go back to reference Wang W-C, Chen C-T: Item parameter recovery, standard error estimate and fit statistics of the WINSTEPS program for the family of Rasch models. Educational and Psychological Measurement 65: 376–404. 10.1177/0013164404268673 Wang W-C, Chen C-T: Item parameter recovery, standard error estimate and fit statistics of the WINSTEPS program for the family of Rasch models. Educational and Psychological Measurement 65: 376–404. 10.1177/0013164404268673
16.
go back to reference Wright BD, Masters GN: Rating acale analysis. Chicago, Ill: MESA Press; 1982. Wright BD, Masters GN: Rating acale analysis. Chicago, Ill: MESA Press; 1982.
17.
go back to reference Embretson S, Reise S: Item Response Theory for Psychologists. Volume Chapter 7. L. NJ: Erlbaum Mahwah; 2000. Embretson S, Reise S: Item Response Theory for Psychologists. Volume Chapter 7. L. NJ: Erlbaum Mahwah; 2000.
18.
go back to reference Linacre JM: Comparing "Partial Credit" and "Rating Scale" Models. Rasch Measurement Transactions 2000,14(3):768. Linacre JM: Comparing "Partial Credit" and "Rating Scale" Models. Rasch Measurement Transactions 2000,14(3):768.
19.
go back to reference Linacre JM: Optimizing rating scale category effectiveness. J Appl Meas 2002,3(1):85–106. Linacre JM: Optimizing rating scale category effectiveness. J Appl Meas 2002,3(1):85–106.
20.
go back to reference Wright BD, Linacre M: Reasonable Mean-square Fit Values. Rasch Measurement Transactions 1994, 8: 3. Wright BD, Linacre M: Reasonable Mean-square Fit Values. Rasch Measurement Transactions 1994, 8: 3.
21.
go back to reference Wright BD, Mok M: Rasch models overview. J Appl Meas 2000, 1: 83–106. Wright BD, Mok M: Rasch models overview. J Appl Meas 2000, 1: 83–106.
22.
go back to reference Weiss DJ: Improvement measurement quality and efficiency with adaptive testing. Applied Psychological Measurement 1982, 6: 473–492. 10.1177/014662168200600408CrossRef Weiss DJ: Improvement measurement quality and efficiency with adaptive testing. Applied Psychological Measurement 1982, 6: 473–492. 10.1177/014662168200600408CrossRef
23.
go back to reference Weiss DJ: Adaptive testing by computer. Journal of Consulting and Clinical Psychology 1985, 3: 774–789. 10.1037/0022-006X.53.6.774CrossRef Weiss DJ: Adaptive testing by computer. Journal of Consulting and Clinical Psychology 1985, 3: 774–789. 10.1037/0022-006X.53.6.774CrossRef
Metadata
Title
Reduction in patient burdens with graphical computerized adaptive testing on the ADL scale: tool development and simulation
Authors
Tsair-Wei Chien
Hing-Man Wu
Weng-Chung Wang
Roberto Vasquez Castillo
Willy Chou
Publication date
01-12-2009
Publisher
BioMed Central
Published in
Health and Quality of Life Outcomes / Issue 1/2009
Electronic ISSN: 1477-7525
DOI
https://doi.org/10.1186/1477-7525-7-39

Other articles of this Issue 1/2009

Health and Quality of Life Outcomes 1/2009 Go to the issue