Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2011

Open Access 01-12-2011 | Research article

Telephone and face to face methods of assessment of veteran's community reintegration yield equivalent results

Authors: Linda J Resnik, Melissa A Clark, Matthew Borgia

Published in: BMC Medical Research Methodology | Issue 1/2011

Login to get access

Abstract

Background

The Community Reintegration of Service Members (CRIS) is a new measure of community reintegration developed to measure veteran's participation in life roles. It consists of three sub-scales: Extent of Participation (Extent), Perceived Limitations with Participation (Perceived), and Satisfaction with Participation (Satisfaction). Testing of the CRIS measure to date has utilized in-person administration. Administration of the CRIS measure by telephone, if equivalent to in-person administration, would be desirable to lower cost and decrease administrative burden. The purpose of this study was to test the equivalence of telephone and in-person mode of CRIS administration.

Methods

A convenience sample of 102 subjects (76% male, 24% female, age mean = 49 years, standard deviation = 8.3) were randomly assigned to received either telephone interview at Visit 1 and in-person interview at Visit 2, or in-person interview at Visit 1 and telephone interview a Visit 2. Both Visits were conducted within one week. Intraclass correlation coefficients, ICC (2,1), were used to evaluate correspondence between modes for both item scores and summary scores. ANOVAs with mode order as a covariate were used to test for presence of an ordering effect.

Results

ICCs (95%CI) for the subscales were 0.92 (0.88-0.94) for Extent, 0.85 (0.80-0.90) for Perceived, and 0.89 (0.84-0.93) for Satisfaction. No ordering effect was observed.

Conclusion

Telephone administration of the CRIS measure yielded equivalent results to in-person administration. Telephone administration of the CRIS may enable lower costs of administration and greater adoption.
Appendix
Available only for authorised users
Literature
2.
go back to reference Institute of Medicine: Returning Home from Iraq and Afghanistam: Preliminary Assessment of Readjustment Needs of Veterans, Service Members, and Their Families. 2010, Washington, DC: National Academies Press Institute of Medicine: Returning Home from Iraq and Afghanistam: Preliminary Assessment of Readjustment Needs of Veterans, Service Members, and Their Families. 2010, Washington, DC: National Academies Press
3.
go back to reference Hoge CW, Auchterlonie JL, Milliken CS: Mental health problems, use of mental health services, and attrition from military service after returning from deployment to Iraq or Afghanistan. Jama. 2006, 295 (9): 1023-1032. 10.1001/jama.295.9.1023.CrossRefPubMed Hoge CW, Auchterlonie JL, Milliken CS: Mental health problems, use of mental health services, and attrition from military service after returning from deployment to Iraq or Afghanistan. Jama. 2006, 295 (9): 1023-1032. 10.1001/jama.295.9.1023.CrossRefPubMed
4.
go back to reference Milliken C, Auchterlonie J, Hoge C: Longitudinal assessment of mental health problems among active and reserve component soldiers returning from the Iraq war. JAMA. 2007, 298: 2141-2148. 10.1001/jama.298.18.2141.CrossRefPubMed Milliken C, Auchterlonie J, Hoge C: Longitudinal assessment of mental health problems among active and reserve component soldiers returning from the Iraq war. JAMA. 2007, 298: 2141-2148. 10.1001/jama.298.18.2141.CrossRefPubMed
5.
go back to reference Sayer NA, Chiros CE, Sigford B, Scott S, Clothier B, Pickett T, Lew HL: Characteristics and rehabilitation outcomes among patients with blast and other injuries sustained during the Global War on Terror. Arch Phys Med Rehabil. 2008, 89 (1): 163-170. 10.1016/j.apmr.2007.05.025.CrossRefPubMed Sayer NA, Chiros CE, Sigford B, Scott S, Clothier B, Pickett T, Lew HL: Characteristics and rehabilitation outcomes among patients with blast and other injuries sustained during the Global War on Terror. Arch Phys Med Rehabil. 2008, 89 (1): 163-170. 10.1016/j.apmr.2007.05.025.CrossRefPubMed
6.
go back to reference Sayer N, Noorbaloochi S, Frazier P, Carlson K, Gravely A, Murdoch M: Reintegration problems and treatment interests among Iraq and Afghanistan combat veterans receiving VA medical care. Psychiatr Serv. 2010, 61 (6): 589-597. 10.1176/appi.ps.61.6.589.CrossRefPubMed Sayer N, Noorbaloochi S, Frazier P, Carlson K, Gravely A, Murdoch M: Reintegration problems and treatment interests among Iraq and Afghanistan combat veterans receiving VA medical care. Psychiatr Serv. 2010, 61 (6): 589-597. 10.1176/appi.ps.61.6.589.CrossRefPubMed
7.
go back to reference Resnik L, Plow M, Jette A: Development of the CRIS: A Measure of Community Reintegration of Injured Services Members. Journal of Rehabilitation Research and Development. 2009, 46 (4): 469-480. 10.1682/JRRD.2008.07.0082.CrossRefPubMedPubMedCentral Resnik L, Plow M, Jette A: Development of the CRIS: A Measure of Community Reintegration of Injured Services Members. Journal of Rehabilitation Research and Development. 2009, 46 (4): 469-480. 10.1682/JRRD.2008.07.0082.CrossRefPubMedPubMedCentral
8.
go back to reference Resnik L, Gray M, Borgia M: Measurement of community reintegration in sample of severely wounded servicemembers. J Rehabil Res Dev. 2011, 48 (2): 89-102. 10.1682/JRRD.2010.04.0070.CrossRefPubMed Resnik L, Gray M, Borgia M: Measurement of community reintegration in sample of severely wounded servicemembers. J Rehabil Res Dev. 2011, 48 (2): 89-102. 10.1682/JRRD.2010.04.0070.CrossRefPubMed
9.
go back to reference Weeks M, Kulka R, Lessler J, Whitmore R: Personal versus Telephone Surveys For COllecting Household Health Data at the Local Level. American Journal of Public Health. 1983, 73 (12): 1389-1394. 10.2105/AJPH.73.12.1389.CrossRefPubMedPubMedCentral Weeks M, Kulka R, Lessler J, Whitmore R: Personal versus Telephone Surveys For COllecting Household Health Data at the Local Level. American Journal of Public Health. 1983, 73 (12): 1389-1394. 10.2105/AJPH.73.12.1389.CrossRefPubMedPubMedCentral
10.
go back to reference Warner J, Bermna J, Weyant J, Ciarlo J: Assessing mental health program effectiveness: a comparison of three client follow-up methods. Evaluation Review. 1983, 7: 635-658. 10.1177/0193841X8300700503.CrossRef Warner J, Bermna J, Weyant J, Ciarlo J: Assessing mental health program effectiveness: a comparison of three client follow-up methods. Evaluation Review. 1983, 7: 635-658. 10.1177/0193841X8300700503.CrossRef
11.
go back to reference De Vaus DA: Surveys in social research. 1995, St. Leonards, NSW: Allen & Unwin, 4 De Vaus DA: Surveys in social research. 1995, St. Leonards, NSW: Allen & Unwin, 4
12.
go back to reference Schuman H, Presser S: Questions and answers in attitude surveys: experiments on question form, wording, and context. 1981, New York: Academic Press Schuman H, Presser S: Questions and answers in attitude surveys: experiments on question form, wording, and context. 1981, New York: Academic Press
13.
go back to reference Holbrook A, Green M, Krosnick J: Telephone Versus Face-to-Face Interviewing of National Probability Samples with Long Questionnaires. Public Opinion Quarterly. 2003, 67: 79-125. 10.1086/346010.CrossRef Holbrook A, Green M, Krosnick J: Telephone Versus Face-to-Face Interviewing of National Probability Samples with Long Questionnaires. Public Opinion Quarterly. 2003, 67: 79-125. 10.1086/346010.CrossRef
14.
go back to reference Krosnick J, Narayan S, Smith W, (Eds): Satisficing in surveys: Initial evidence. 1996, San Francisco: Josse-Bass Krosnick J, Narayan S, Smith W, (Eds): Satisficing in surveys: Initial evidence. 1996, San Francisco: Josse-Bass
15.
go back to reference Drolet A, Morris M: Rapport in Conflict Resolution: Accounting for How Face-to-Face Contact Fosters Mutual Cooperation in Mixed-Motive Conflicts. Journal of Experimental Social Psychology. 2000, 36: 26-50. 10.1006/jesp.1999.1395.CrossRef Drolet A, Morris M: Rapport in Conflict Resolution: Accounting for How Face-to-Face Contact Fosters Mutual Cooperation in Mixed-Motive Conflicts. Journal of Experimental Social Psychology. 2000, 36: 26-50. 10.1006/jesp.1999.1395.CrossRef
16.
go back to reference Tourangeau R, Smith T: Asking Sensitive questions: The impact of data collection, question format, and question context. Public Opinion Quarterly. 1996, 69: 275-304.CrossRef Tourangeau R, Smith T: Asking Sensitive questions: The impact of data collection, question format, and question context. Public Opinion Quarterly. 1996, 69: 275-304.CrossRef
17.
go back to reference Hays RD, Kim S, Spritzer K, Kaplan R, Tally S, Feeny D, Liu H, Fryback D: Effects of Mode and Order of Administration on Generic Health-Related Quality of Life Scores. Value in Health. 2009, 12 (6): 1035-1039. 10.1111/j.1524-4733.2009.00566.x.CrossRefPubMedPubMedCentral Hays RD, Kim S, Spritzer K, Kaplan R, Tally S, Feeny D, Liu H, Fryback D: Effects of Mode and Order of Administration on Generic Health-Related Quality of Life Scores. Value in Health. 2009, 12 (6): 1035-1039. 10.1111/j.1524-4733.2009.00566.x.CrossRefPubMedPubMedCentral
18.
go back to reference Greene J, Wiitala W: Telephone and Web: Mixed-Mode Challenge. Health Services Research. 2007, 43 (1): 230-248. 10.1111/j.1475-6773.2007.00747.x.CrossRef Greene J, Wiitala W: Telephone and Web: Mixed-Mode Challenge. Health Services Research. 2007, 43 (1): 230-248. 10.1111/j.1475-6773.2007.00747.x.CrossRef
19.
go back to reference Laungenahusen M, Lange S, Maier C, Schaub C, Trampisch H, Endres H: BMC Medical Research Methodology. 2007, 7 (50): Laungenahusen M, Lange S, Maier C, Schaub C, Trampisch H, Endres H: BMC Medical Research Methodology. 2007, 7 (50):
20.
go back to reference Shrout PE, Fleiss JL: Intraclass correlations: uses in assessing rater reliability. Psychol Bull. 1979, 86 (2): 420-428.CrossRefPubMed Shrout PE, Fleiss JL: Intraclass correlations: uses in assessing rater reliability. Psychol Bull. 1979, 86 (2): 420-428.CrossRefPubMed
21.
go back to reference Winer EA, Stewart BJ: Assessing Individuals. 1984, Boston, MA: Little Brown Winer EA, Stewart BJ: Assessing Individuals. 1984, Boston, MA: Little Brown
22.
go back to reference Nunnally JC: Psychometric Theory. 1978, New York, New York: McGraw-Hill Nunnally JC: Psychometric Theory. 1978, New York, New York: McGraw-Hill
23.
go back to reference Streiner D, Norman G: Health Measurement Scales: a practical guide to their development and use. 2003, New York: Oxford University Press Streiner D, Norman G: Health Measurement Scales: a practical guide to their development and use. 2003, New York: Oxford University Press
24.
go back to reference Donner A, Eljaszw M: Sample size requirements for reliability studies. Statistics in medicine. 1987, 6 (4): 441-448. 10.1002/sim.4780060404.CrossRefPubMed Donner A, Eljaszw M: Sample size requirements for reliability studies. Statistics in medicine. 1987, 6 (4): 441-448. 10.1002/sim.4780060404.CrossRefPubMed
25.
go back to reference McQueen D: Comparison of results of personal interviews and telephone surveys of behavior related to risk of AIDS: Advantages of telephone techniques. Health survey research methods, Rockville, MD. 1989 McQueen D: Comparison of results of personal interviews and telephone surveys of behavior related to risk of AIDS: Advantages of telephone techniques. Health survey research methods, Rockville, MD. 1989
26.
go back to reference Hochstim J: A critical comparison of three strategies of collecting data from households. J Clin Epidemiol. 1998, 51 (11): 961-967. 10.1016/S0895-4356(98)00087-0.CrossRef Hochstim J: A critical comparison of three strategies of collecting data from households. J Clin Epidemiol. 1998, 51 (11): 961-967. 10.1016/S0895-4356(98)00087-0.CrossRef
27.
go back to reference Aneshensel CS, Frerichs RR, Clark VA, Yokopenic P: Telephone versus in-person surveys of community health status. Am J Public Health. Am J Public Health. 1982, 72 (9): 1017-1021. 10.2105/AJPH.72.9.1017.CrossRefPubMedPubMedCentral Aneshensel CS, Frerichs RR, Clark VA, Yokopenic P: Telephone versus in-person surveys of community health status. Am J Public Health. Am J Public Health. 1982, 72 (9): 1017-1021. 10.2105/AJPH.72.9.1017.CrossRefPubMedPubMedCentral
28.
go back to reference Rothstein J, Echternach J: Primer on Measurement: An Introductory Guide to Measurement Issues. 1993, Alexandria, VA: American Physical Therapy Association, 83-84. Rothstein J, Echternach J: Primer on Measurement: An Introductory Guide to Measurement Issues. 1993, Alexandria, VA: American Physical Therapy Association, 83-84.
Metadata
Title
Telephone and face to face methods of assessment of veteran's community reintegration yield equivalent results
Authors
Linda J Resnik
Melissa A Clark
Matthew Borgia
Publication date
01-12-2011
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2011
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/1471-2288-11-98

Other articles of this Issue 1/2011

BMC Medical Research Methodology 1/2011 Go to the issue