Skip to main content
Top
Published in: BMC Health Services Research 1/2014

Open Access 01-12-2014 | Research article

Field methods in medical record abstraction: assessing the properties of comparative effectiveness estimates

Authors: Elizabeth A Cook, Kathleen M Schneider, Jennifer Robinson, June Wilwert, Elizabeth Chrischilles, Jane Pendergast, John Brooks

Published in: BMC Health Services Research | Issue 1/2014

Login to get access

Abstract

Background

Comparative effectiveness studies using Medicare claims data are vulnerable to treatment selection biases and supplemental data from a sample of patients has been recommended for examining the magnitude of this bias. Previous research using nationwide Medicare claims data has typically relied on the Medicare Current Beneficiary Survey (MCBS) for supplemental data. Because many important clinical variables for our specific research question are not available in the MCBS, we collected medical record data from a subsample of patients to assess the validity of assumptions and to aid in the interpretation of our estimates. This paper seeks to describe and document the process used to collect and validate this supplemental information.

Methods

Medicare claims data files for all patients with fee-for-service Medicare benefits who had an acute myocardial infarction (AMI) in 2007 or 2008 were obtained. Medical records were obtained and abstracted for a stratified subsample of 1,601 of these patients, using strata defined by claims-based measures of physician prescribing practices and drug treatment combinations. The abstraction tool was developed collaboratively by study clinicians and researchers, leveraging important elements from previously validated tools.

Results

Records for 2,707 AMI patients were requested from the admitting hospitals and 1,751 were received for an overall response rate of 65%; 1,601 cases were abstracted by trained personnel at a contracted firm. Data were collected with overall 96% inter-abstractor agreement across all variables. Some non-response bias was detected at the patient and facility level.

Conclusion

Although Medicare claims data are a potentially powerful resource for conducting comparative effectiveness analyses, observational databases are vulnerable to treatment selection biases. This study demonstrates that it is feasible to abstract medical records for Medicare patients nationwide and collect high quality data, to design the sampling purposively to address specific research questions, and to more thoroughly evaluate the appropriateness of care delivered to AMI patients.
Appendix
Available only for authorised users
Literature
2.
go back to reference Angrist JD, Pischke JS: Mostly harmless econometrics: an empiricist’s companion. 2008, New Jersey: Princeton University Press Angrist JD, Pischke JS: Mostly harmless econometrics: an empiricist’s companion. 2008, New Jersey: Princeton University Press
3.
go back to reference Romano PS, Roos LL, Luft HS, Jollis JG, Doliszny K: A comparison of administrative versus clinical data: coronary artery bypass surgery as an example. J Clin Epidemiol. 1994, 47: 3.CrossRef Romano PS, Roos LL, Luft HS, Jollis JG, Doliszny K: A comparison of administrative versus clinical data: coronary artery bypass surgery as an example. J Clin Epidemiol. 1994, 47: 3.CrossRef
4.
go back to reference The Health Insurance Portability and Accountability Act of 1996 (HIPAA) Privacy Rule (46 CFR Part 160; Part 164 (subparts a,e). The Health Insurance Portability and Accountability Act of 1996 (HIPAA) Privacy Rule (46 CFR Part 160; Part 164 (subparts a,e).
5.
go back to reference Cook EA, Schneider KM, Chrischilles EA, Brooks JM: Accounting for unobserved exposure time bias when using Medicare prescription drug data. Med Med Res Rev. 2013, 3 (4): doi:10.5600/mmrr.003.04.a01 Cook EA, Schneider KM, Chrischilles EA, Brooks JM: Accounting for unobserved exposure time bias when using Medicare prescription drug data. Med Med Res Rev. 2013, 3 (4): doi:10.5600/mmrr.003.04.a01
6.
go back to reference Fang G, Brooks JM, Chrischilles EA: A new method to isolate local-area practice styles in prescription use as the basis for instrumental variables in comparative effectiveness research. Med Care. 2010, 48 (8): 710-717.CrossRefPubMed Fang G, Brooks JM, Chrischilles EA: A new method to isolate local-area practice styles in prescription use as the basis for instrumental variables in comparative effectiveness research. Med Care. 2010, 48 (8): 710-717.CrossRefPubMed
7.
go back to reference Brooks JM, Tang Y, Chapman CG, Cook EA, Chrischilles EA: What is the effect of area size when using local area practice style as an instrument?. J Clin Epidemiol. 2013, 66 (8 Supp): S69-S83.CrossRefPubMedPubMedCentral Brooks JM, Tang Y, Chapman CG, Cook EA, Chrischilles EA: What is the effect of area size when using local area practice style as an instrument?. J Clin Epidemiol. 2013, 66 (8 Supp): S69-S83.CrossRefPubMedPubMedCentral
9.
go back to reference Lee ML, Reif S, Ritter GA, Levine HJ, Horgan CM: Alcohol and drug services study (ADSS) phase II: client records abstract report. DHHS Publ No SMA 04. 2004 Lee ML, Reif S, Ritter GA, Levine HJ, Horgan CM: Alcohol and drug services study (ADSS) phase II: client records abstract report. DHHS Publ No SMA 04. 2004
10.
go back to reference Kaplowitz MD, Hadlock TD, Levine R: A comparison of web and mail survey response rates. Public Opinion Quarter. 2004, 68 (1): 94-101.CrossRef Kaplowitz MD, Hadlock TD, Levine R: A comparison of web and mail survey response rates. Public Opinion Quarter. 2004, 68 (1): 94-101.CrossRef
11.
go back to reference Ellerbeck EF, Jencks SF, Radford MJ, Timothy F, Craig AS, Gold JA, Krumholz HM, Vogel RA: Quality of care for medicare patients with acute myocardial infarction. JAMA: J Am Med Assoc. 1995, 273 (19): 1509-1514.CrossRef Ellerbeck EF, Jencks SF, Radford MJ, Timothy F, Craig AS, Gold JA, Krumholz HM, Vogel RA: Quality of care for medicare patients with acute myocardial infarction. JAMA: J Am Med Assoc. 1995, 273 (19): 1509-1514.CrossRef
12.
go back to reference Anderson G, Cummings S, Freedman LS, Furberg C, Henderson M, Johnson SR, Kuller JM, Prentic RL Rossouw JE OA: Design of the women’s health initiative clinical trial and observational study. Control Clin Trials. 1998, 19 (1): 61-109.CrossRef Anderson G, Cummings S, Freedman LS, Furberg C, Henderson M, Johnson SR, Kuller JM, Prentic RL Rossouw JE OA: Design of the women’s health initiative clinical trial and observational study. Control Clin Trials. 1998, 19 (1): 61-109.CrossRef
13.
go back to reference Bang D, Piccirillo JF, Littenberg B, Johnston A: The adult comorbidity evaluation-27 (ACE-27) test: a new comorbidity index for patients with cancer. Annual Meet Am Soc Clinical Oncol. 2000 Bang D, Piccirillo JF, Littenberg B, Johnston A: The adult comorbidity evaluation-27 (ACE-27) test: a new comorbidity index for patients with cancer. Annual Meet Am Soc Clinical Oncol. 2000
14.
go back to reference Anderson JL, Adams CD, Antman EM, Bridges CR, Califf RM, Casey DE, Chavey WE, Fesmire FM, Hochman JS, Levin TN, Lincoff AM, Peterson ED, Theroux P, Wenger NK, Wright RS: American College of Cardiology; American Heart Association Task Force on Practice Guidelines (Writing Committee to Revise the 2002 Guidelines for the Management of Patients With Unstable Angina/Non-ST-Elevation Myocardial Infarction); American College of Emergency Physicians; Society for Cardiovascular Angiography and Interventions; Society of Thoracic Surgeons; American Association of Cardiovascular and Pulmonary Rehabilitation; Society for Academic Emergency Medicine. ACC/ AHA 2007 guidelines for the management of patients with unstable angina/non-ST-Elevation myocardial infarction: a report of the American College of Cardiology/American Heart Association Task Force on Practice Guidelines (Writing Committee to Revise the 2002 Guidelines for the Management of Patients With Unstable Angina/Non-ST-Elevation Myocardial Infarction) developed in collaboration with the American College of Emergency Physicians, the Society for Cardiovascular Angiography and Interventions, and the Society of Thoracic Surgeons endorsed by the American Association of Cardiovascular and Pulmonary Rehabilitation and the Society for Academic Emergency Medicine. J Am Coll Cardiol. 2007, 50: e1-e157.CrossRefPubMed Anderson JL, Adams CD, Antman EM, Bridges CR, Califf RM, Casey DE, Chavey WE, Fesmire FM, Hochman JS, Levin TN, Lincoff AM, Peterson ED, Theroux P, Wenger NK, Wright RS: American College of Cardiology; American Heart Association Task Force on Practice Guidelines (Writing Committee to Revise the 2002 Guidelines for the Management of Patients With Unstable Angina/Non-ST-Elevation Myocardial Infarction); American College of Emergency Physicians; Society for Cardiovascular Angiography and Interventions; Society of Thoracic Surgeons; American Association of Cardiovascular and Pulmonary Rehabilitation; Society for Academic Emergency Medicine. ACC/ AHA 2007 guidelines for the management of patients with unstable angina/non-ST-Elevation myocardial infarction: a report of the American College of Cardiology/American Heart Association Task Force on Practice Guidelines (Writing Committee to Revise the 2002 Guidelines for the Management of Patients With Unstable Angina/Non-ST-Elevation Myocardial Infarction) developed in collaboration with the American College of Emergency Physicians, the Society for Cardiovascular Angiography and Interventions, and the Society of Thoracic Surgeons endorsed by the American Association of Cardiovascular and Pulmonary Rehabilitation and the Society for Academic Emergency Medicine. J Am Coll Cardiol. 2007, 50: e1-e157.CrossRefPubMed
15.
go back to reference Allison JJ, Wall TC, Spettell CM, Calhoun J, Fargason CA, Kobylinski RW, Farmer R, Kiefe C: The Art and science of chart review. Joint Commission J Quality Patient Safety. 2000, 26 (3): 115-136. 22 Allison JJ, Wall TC, Spettell CM, Calhoun J, Fargason CA, Kobylinski RW, Farmer R, Kiefe C: The Art and science of chart review. Joint Commission J Quality Patient Safety. 2000, 26 (3): 115-136. 22
17.
go back to reference Stürmer T, Glynn RJ, Rothman KJ, Avorn J, Schneeweiss S: Adjustments for unmeasured confounders in pharmacoepidemiologic database studies using external information. Med Care. 2007, 45 (10 SUPL): S158.CrossRefPubMedPubMedCentral Stürmer T, Glynn RJ, Rothman KJ, Avorn J, Schneeweiss S: Adjustments for unmeasured confounders in pharmacoepidemiologic database studies using external information. Med Care. 2007, 45 (10 SUPL): S158.CrossRefPubMedPubMedCentral
18.
go back to reference Schneeweiss S, Glynn R, Tsai EH, Avorn J, Solomon DH: Adjusting for unmeasured confounders in pharmacoepidemiologic claims data using external information: the example of COX2 inhibitors and myocardial infarction. Epidemiology. 2005, 16 (1): 17-24.CrossRefPubMed Schneeweiss S, Glynn R, Tsai EH, Avorn J, Solomon DH: Adjusting for unmeasured confounders in pharmacoepidemiologic claims data using external information: the example of COX2 inhibitors and myocardial infarction. Epidemiology. 2005, 16 (1): 17-24.CrossRefPubMed
19.
go back to reference Schneeweiss S, Setoguchi S, Brookhart MA, Kaci L, Wang PS: Assessing residual confounding of the association between antipsychotic medications and risk of death using survey data. CNS Drugs. 2009, 23 (2): 171-180.CrossRefPubMedPubMedCentral Schneeweiss S, Setoguchi S, Brookhart MA, Kaci L, Wang PS: Assessing residual confounding of the association between antipsychotic medications and risk of death using survey data. CNS Drugs. 2009, 23 (2): 171-180.CrossRefPubMedPubMedCentral
21.
go back to reference Swaine JG, Parish SL, Ghosh S, Luken K, Wright GA: Obtaining medical records for women with intellectual disabilities in a community-based health promotion intervention. J Policy Pract Intell Disab. 2013, 10 (1): 54-61.CrossRef Swaine JG, Parish SL, Ghosh S, Luken K, Wright GA: Obtaining medical records for women with intellectual disabilities in a community-based health promotion intervention. J Policy Pract Intell Disab. 2013, 10 (1): 54-61.CrossRef
Metadata
Title
Field methods in medical record abstraction: assessing the properties of comparative effectiveness estimates
Authors
Elizabeth A Cook
Kathleen M Schneider
Jennifer Robinson
June Wilwert
Elizabeth Chrischilles
Jane Pendergast
John Brooks
Publication date
01-12-2014
Publisher
BioMed Central
Published in
BMC Health Services Research / Issue 1/2014
Electronic ISSN: 1472-6963
DOI
https://doi.org/10.1186/1472-6963-14-391

Other articles of this Issue 1/2014

BMC Health Services Research 1/2014 Go to the issue