Skip to main content
Top
Published in: Population Health Metrics 1/2006

Open Access 01-12-2006 | Research

Transition to the new race/ethnicity data collection standards in the Department of Veterans Affairs

Authors: Min-Woong Sohn, Huiyuan Zhang, Noreen Arnold, Kevin Stroupe, Brent C Taylor, Timothy J Wilt, Denise M Hynes

Published in: Population Health Metrics | Issue 1/2006

Login to get access

Abstract

Background

Patient race in the Department of Veterans Affairs (VA) information system was previously recorded based on an administrative or clinical employee's observation. Since 2003, the VA started to collect self-reported race in compliance with a new federal guideline. We investigated the implications of this transition for using race/ethnicity data in multi-year trends in the VA and in other healthcare data systems that make the transition.

Methods

All unique users of VA healthcare services with self-reported race/ethnicity data in 2004 were compared with their prior observer-recorded race/ethnicity data from 1997 – 2002 (N = 988,277).

Results

In 2004, only about 39% of all VA healthcare users reported race/ethnicity values other than "unknown" or "declined." Females reported race/ethnicity at a lower rate than males (27% vs. 40%; p < 0.001). Over 95% of observer-recorded data agreed with self-reported data. Compared with the patient self-reported data, the observer-recorded White and African American races were accurate for 98% (kappa = 0.89) and 94% (kappa = 0.93) individuals, respectively. Accuracy of observer-recorded races was much worse for other minority groups with kappa coefficients ranging between 0.38 for American Indian or Alaskan Natives and 0.79 for Hispanic Whites. When observer-recorded race/ethnicity values were reclassified into non-African American groups, they agreed with the self-reported data for 98% of all individuals (kappa = 0.93).

Conclusion

For overall VA healthcare users, the agreement between observer-recorded and self-reported race/ethnicity was excellent and observer-recorded and self-reported data can be used together for multi-year trends without creating serious bias. However, this study also showed that observation was not a reliable method of race/ethnicity data collection for non-African American minorities and racial disparity might be underestimated if observer-recorded data are used due to systematic patterns of inaccurate race/ethnicity assignments.
Literature
1.
go back to reference U.S.Department of Veterans Affairs: VHA Directive 2003-027. Capture of race and ethnicity categories. 2003. U.S.Department of Veterans Affairs: VHA Directive 2003-027. Capture of race and ethnicity categories. 2003.
2.
go back to reference Friedman DJ, Cohen BB, Averbach AR, Norton JM: Race/ethnicity and OMB Directive 15: implications for state public health practice. Am J Public Health 2000, 90: 1714-1719.CrossRefPubMedPubMedCentral Friedman DJ, Cohen BB, Averbach AR, Norton JM: Race/ethnicity and OMB Directive 15: implications for state public health practice. Am J Public Health 2000, 90: 1714-1719.CrossRefPubMedPubMedCentral
4.
go back to reference Kressin NR, Chang BH, Hendricks A, Kazis LE: Agreement between administrative data and patients' self-reports of race/ethnicity. Am J Public Health 2003, 93: 1734-1739.CrossRefPubMedPubMedCentral Kressin NR, Chang BH, Hendricks A, Kazis LE: Agreement between administrative data and patients' self-reports of race/ethnicity. Am J Public Health 2003, 93: 1734-1739.CrossRefPubMedPubMedCentral
5.
go back to reference Mays VM, Ponce NA, Washington DL, Cochran SD: Classification of race and ethnicity: implications for public health. Annu Rev Public Health 2003, 24: 83-110.CrossRefPubMed Mays VM, Ponce NA, Washington DL, Cochran SD: Classification of race and ethnicity: implications for public health. Annu Rev Public Health 2003, 24: 83-110.CrossRefPubMed
7.
go back to reference Vali F: Patient race & ethnicity: Improving hospital data collection & reporting. Health Research and Educational Trust of New Jersey, New Jersey Hospital Association; 2004. Vali F: Patient race & ethnicity: Improving hospital data collection & reporting. Health Research and Educational Trust of New Jersey, New Jersey Hospital Association; 2004.
8.
go back to reference Bierman AS, Lurie N, Collins KS, Eisenberg JM: Addressing racial and ethnic barriers to effective health care: the need for better data. Health Affairs 2005, 21: 91-102. 10.1377/hlthaff.21.3.91CrossRef Bierman AS, Lurie N, Collins KS, Eisenberg JM: Addressing racial and ethnic barriers to effective health care: the need for better data. Health Affairs 2005, 21: 91-102. 10.1377/hlthaff.21.3.91CrossRef
9.
go back to reference Davis D, Chase S: Pilot Study of County Data Resources Improving the Health of Minority Populations: Final Report. Rutgers Center for State Health Policy; 2003. Davis D, Chase S: Pilot Study of County Data Resources Improving the Health of Minority Populations: Final Report. Rutgers Center for State Health Policy; 2003.
10.
go back to reference Boehmer U, Kressin NR, Berlowitz DR, Christiansen CL, Kazis LE, Jones JA: Self-reported vs administrative race/ethnicity data and study results. Am J Public Health 2002, 92: 1471-1472.CrossRefPubMedPubMedCentral Boehmer U, Kressin NR, Berlowitz DR, Christiansen CL, Kazis LE, Jones JA: Self-reported vs administrative race/ethnicity data and study results. Am J Public Health 2002, 92: 1471-1472.CrossRefPubMedPubMedCentral
11.
go back to reference Kashner TM: Agreement between administrative files and written medical records: a case of the Department of Veterans Affairs. Med Care 1998, 36: 1324-1336. 10.1097/00005650-199809000-00005CrossRefPubMed Kashner TM: Agreement between administrative files and written medical records: a case of the Department of Veterans Affairs. Med Care 1998, 36: 1324-1336. 10.1097/00005650-199809000-00005CrossRefPubMed
12.
go back to reference Litwin MS, Saigal CS, Yano EM, Avila C, Geschwind SA, Hanley JM, Joyce GF, Madison R, Pace J, Polich SM, Wang M: Urologic diseases in America Project: analytical methods and principal findings. J Urol 2005, 173: 933-937. 10.1097/01.ju.0000152365.43125.3bCrossRefPubMed Litwin MS, Saigal CS, Yano EM, Avila C, Geschwind SA, Hanley JM, Joyce GF, Madison R, Pace J, Polich SM, Wang M: Urologic diseases in America Project: analytical methods and principal findings. J Urol 2005, 173: 933-937. 10.1097/01.ju.0000152365.43125.3bCrossRefPubMed
14.
go back to reference Cowper DC, Hynes DM, Kubal JD, Murphy PA: Using administrative databases for outcomes research: select examples from VA Health Services Research and Development. J Med Syst 1999, 23: 249-259. 10.1023/A:1020579806511CrossRefPubMed Cowper DC, Hynes DM, Kubal JD, Murphy PA: Using administrative databases for outcomes research: select examples from VA Health Services Research and Development. J Med Syst 1999, 23: 249-259. 10.1023/A:1020579806511CrossRefPubMed
15.
go back to reference Murphy PA, Cowper DC, Seppala G, Stroupe KT, Hynes DM: Veterans Health Administration inpatient and outpatient care data: an overview. Eff Clin Pract 2002, 5: E4.PubMed Murphy PA, Cowper DC, Seppala G, Stroupe KT, Hynes DM: Veterans Health Administration inpatient and outpatient care data: an overview. Eff Clin Pract 2002, 5: E4.PubMed
18.
go back to reference Hynes DM, Perrin RA, Rappaport S, Stevens JM, Demakis JG: Informatics resources to support health care quality improvement in the veterans health administration. J Am Med Inform Assoc 2004, 11: 344-350. 10.1197/jamia.M1548CrossRefPubMedPubMedCentral Hynes DM, Perrin RA, Rappaport S, Stevens JM, Demakis JG: Informatics resources to support health care quality improvement in the veterans health administration. J Am Med Inform Assoc 2004, 11: 344-350. 10.1197/jamia.M1548CrossRefPubMedPubMedCentral
19.
go back to reference Fleming C, Fisher ES, Chang CH, Bubolz TA, Malenka DJ: Studying outcomes and hospital utilization in the elderly. The advantages of a merged data base for Medicare and Veterans Affairs hospitals. Med Care 1992, 30: 377-391.CrossRefPubMed Fleming C, Fisher ES, Chang CH, Bubolz TA, Malenka DJ: Studying outcomes and hospital utilization in the elderly. The advantages of a merged data base for Medicare and Veterans Affairs hospitals. Med Care 1992, 30: 377-391.CrossRefPubMed
20.
go back to reference Cohen JA: A coefficient of agreement for nominal scales. Educational and Psychological Measurement 1960, 20: 37-46.CrossRef Cohen JA: A coefficient of agreement for nominal scales. Educational and Psychological Measurement 1960, 20: 37-46.CrossRef
21.
go back to reference Landis JR, Koch GG: The measurement of observer agreement for categorical data. Biometrics 1977, 33: 159-174. 10.2307/2529310CrossRefPubMed Landis JR, Koch GG: The measurement of observer agreement for categorical data. Biometrics 1977, 33: 159-174. 10.2307/2529310CrossRefPubMed
22.
go back to reference Waldo DR: Accuracy and bias of race/ethnicity codes in the Medicare Enrollment Database. Health Care Financ Review 2005, 26: 61-72. Waldo DR: Accuracy and bias of race/ethnicity codes in the Medicare Enrollment Database. Health Care Financ Review 2005, 26: 61-72.
25.
go back to reference Lauderdale DS, Goldberg J: The expanded racial and ethnic codes in the Medicare data files: their completeness of coverage and accuracy. Am J Public Health 1996, 86: 712-716.CrossRefPubMedPubMedCentral Lauderdale DS, Goldberg J: The expanded racial and ethnic codes in the Medicare data files: their completeness of coverage and accuracy. Am J Public Health 1996, 86: 712-716.CrossRefPubMedPubMedCentral
26.
go back to reference Arday SL, Arday DR, Monroe S, Zhang J: HCFA's racial and ethnic data: current accuracy and recent improvements. Health Care Financ Rev 2000, 21: 107-116.PubMedPubMedCentral Arday SL, Arday DR, Monroe S, Zhang J: HCFA's racial and ethnic data: current accuracy and recent improvements. Health Care Financ Rev 2000, 21: 107-116.PubMedPubMedCentral
27.
go back to reference Baker DW, Cameron KA, Feinglass J, A.Thompson J, Georgas P, Foster S, Pierce D, Hasnain-Wynia R: A system for rapidly and accurately collecting patients' race and ethnicity. Am J Public Health 2006, 96: 532-537. 10.2105/AJPH.2005.062620CrossRefPubMedPubMedCentral Baker DW, Cameron KA, Feinglass J, A.Thompson J, Georgas P, Foster S, Pierce D, Hasnain-Wynia R: A system for rapidly and accurately collecting patients' race and ethnicity. Am J Public Health 2006, 96: 532-537. 10.2105/AJPH.2005.062620CrossRefPubMedPubMedCentral
28.
go back to reference Hirschman C, Alba R, Farley R: The meaning and measurement of race in the U.S. census: glimpses into the future. Demography 2000, 37: 381-393.CrossRefPubMed Hirschman C, Alba R, Farley R: The meaning and measurement of race in the U.S. census: glimpses into the future. Demography 2000, 37: 381-393.CrossRefPubMed
29.
go back to reference Grieco EM, Cassidy RC: Census 2000 Brief: Overview of race and Hispanic origin. U.S. Department of Commerce; 2003. Grieco EM, Cassidy RC: Census 2000 Brief: Overview of race and Hispanic origin. U.S. Department of Commerce; 2003.
Metadata
Title
Transition to the new race/ethnicity data collection standards in the Department of Veterans Affairs
Authors
Min-Woong Sohn
Huiyuan Zhang
Noreen Arnold
Kevin Stroupe
Brent C Taylor
Timothy J Wilt
Denise M Hynes
Publication date
01-12-2006
Publisher
BioMed Central
Published in
Population Health Metrics / Issue 1/2006
Electronic ISSN: 1478-7954
DOI
https://doi.org/10.1186/1478-7954-4-7

Other articles of this Issue 1/2006

Population Health Metrics 1/2006 Go to the issue