Skip to main content
Top
Published in: Maternal and Child Health Journal 4/2014

01-05-2014

Ascertainment of Medicaid Payment for Delivery on the Iowa Birth Certificate: Is Accuracy Sufficient for Timely Policy and Program Relevant Analysis?

Authors: Debra J. Kane, William M. Sappenfield

Published in: Maternal and Child Health Journal | Issue 4/2014

Login to get access

Abstract

The Iowa Department of Public Health annually links Medicaid claims data to the birth certificate. Because the latest version of the birth certificate provides more timely and less costly information on delivery payment source, we were interested in assessing the validity and reliability of the birth certificate payment source compared to Medicaid paid claims. We linked Medicaid paid claims to birth certificates for calendar years 2007–2009 (n = 120,626). We measured reliability by Kappa statistic and validity by sensitivity, specificity, predictive value positive and negative. We examined reliability and validity overall and by maternal characteristics (e.g. age, race, ethnicity, education). The Kappa statistic for the birth certificate payment source indicated substantial agreement (0.78; 95 % CL 0.78–0.79). Sensitivity and specificity were also high, 86.3 % (95 % CL 86.0–86 6 %) and 91.9 % (95 % CL 91.7–92.1 %), respectively. The predictive value positive was 87.0 %. The predictive value negative was 91.4 %. Kappa and specificity were lower among women of racial and ethnic minorities, women younger than age 24, and women with less education. The overall Kappa, sensitivity and specificity generally suggest the birth certificate payment source is as valid and reliable as the linked data source. The birth certificate payment source is less valid and reliable for women of racial and ethnic minorities, women younger than age 24, and those with less education. Consequently caution should be exercised when using the birth certificate payment source for monitoring service use by the Medicaid population within specific population subgroups.
Appendix
Available only for authorised users
Literature
1.
go back to reference Martin, J. A., Hamilton, B. E., & Sutton, P. D. et al. (2010). Births: Final data for 2008. National Vital Statistics Reports, 59(1), 1, 3–17. Martin, J. A., Hamilton, B. E., & Sutton, P. D. et al. (2010). Births: Final data for 2008. National Vital Statistics Reports, 59(1), 1, 3–17.
2.
go back to reference DiGiuseppe, D. L., Aron, D. C., Ranbom, L., et al. (2002). Reliability of birth certificate data: A multi-hospital comparison to medical record information. Maternal and Child Health Journal, 6(3), 169.PubMedCrossRef DiGiuseppe, D. L., Aron, D. C., Ranbom, L., et al. (2002). Reliability of birth certificate data: A multi-hospital comparison to medical record information. Maternal and Child Health Journal, 6(3), 169.PubMedCrossRef
3.
go back to reference Northam, S., & Knapp, T. R. (2006). The reliability and validity of birth certificates. Journal of Obstetric, Gynecologic, and Neonatal Nursing, 35(1), 3.PubMedCrossRef Northam, S., & Knapp, T. R. (2006). The reliability and validity of birth certificates. Journal of Obstetric, Gynecologic, and Neonatal Nursing, 35(1), 3.PubMedCrossRef
4.
go back to reference Reichman, N. E., & Hade, E. M. (2001). Validation of birth certificate data: A study of women in New Jersey’s Health Start Program. Annals of Epidemiology, 11(3), 186.PubMedCrossRef Reichman, N. E., & Hade, E. M. (2001). Validation of birth certificate data: A study of women in New Jersey’s Health Start Program. Annals of Epidemiology, 11(3), 186.PubMedCrossRef
5.
go back to reference Zollinger, T. W., Przybylski, M. J., & Gamache, R. E. (2006). Reliability of Indiana birth certificate data compared to medical records. Annals of Epidemiology, 16(1), 1.PubMedCrossRef Zollinger, T. W., Przybylski, M. J., & Gamache, R. E. (2006). Reliability of Indiana birth certificate data compared to medical records. Annals of Epidemiology, 16(1), 1.PubMedCrossRef
6.
go back to reference Vinikoor, L. C., Messer, L. C., Laraia, B. A., et al. (2010). Reliability of variables on the North Carolina birth certificate: A comparison with directly queried values from a cohort study. Paediatric and Perinatal Epidemiology, 24, 102.PubMedCentralPubMedCrossRef Vinikoor, L. C., Messer, L. C., Laraia, B. A., et al. (2010). Reliability of variables on the North Carolina birth certificate: A comparison with directly queried values from a cohort study. Paediatric and Perinatal Epidemiology, 24, 102.PubMedCentralPubMedCrossRef
7.
go back to reference DiGiuseppe, D. L., Aron, D. C., Payne, S. M. C., et al. (2001). Risk adjusting cesarean delivery rates: A comparison of hospital profiles based on medical record and birth certificate data. HSR: Health Services Research, 36(5), 959.PubMedCentralPubMed DiGiuseppe, D. L., Aron, D. C., Payne, S. M. C., et al. (2001). Risk adjusting cesarean delivery rates: A comparison of hospital profiles based on medical record and birth certificate data. HSR: Health Services Research, 36(5), 959.PubMedCentralPubMed
8.
go back to reference Andrade, S. E., Scott, P. E., Davis, R. L., et al. (2013). Validity of health plan and birth certificate data for pregnancy research. Pharmacoepidemiology and Drug Safety, 22, 7.PubMedCentralPubMedCrossRef Andrade, S. E., Scott, P. E., Davis, R. L., et al. (2013). Validity of health plan and birth certificate data for pregnancy research. Pharmacoepidemiology and Drug Safety, 22, 7.PubMedCentralPubMedCrossRef
9.
go back to reference National Center for Health Statistics. (2003). Revisions of the US standard certificates of live birth and death and the fetal death report. July 7, 2012 (August 7, 2012). National Center for Health Statistics. (2003). Revisions of the US standard certificates of live birth and death and the fetal death report. July 7, 2012 (August 7, 2012).
10.
go back to reference Park, S., Sappenfield, W. M., & Bish, C. et al. (2009). Reliability and validity of birth certificate prepregnancy weight and height among women enrolled in prenatal WIC program: Florida, 2005. Maternal and Child Health Journal, 15(7), 851–859. Park, S., Sappenfield, W. M., & Bish, C. et al. (2009). Reliability and validity of birth certificate prepregnancy weight and height among women enrolled in prenatal WIC program: Florida, 2005. Maternal and Child Health Journal, 15(7), 851–859.
11.
go back to reference Braveman, P., Pearl, M., Egerter, S., et al. (1998). Validity of insurance information on California birth certificates. American journal of public health, 88(5), 813.PubMedCentralPubMedCrossRef Braveman, P., Pearl, M., Egerter, S., et al. (1998). Validity of insurance information on California birth certificates. American journal of public health, 88(5), 813.PubMedCentralPubMedCrossRef
12.
go back to reference Bengiamin, M. I., Capitman, J. A., & Ruwe, M. B. (2010). Disparities in initiation and adherence to prenatal care: Impact of insurance, race-ethnicity, and nativity. Maternal and Child Health Journal, 14, 618.PubMedCrossRef Bengiamin, M. I., Capitman, J. A., & Ruwe, M. B. (2010). Disparities in initiation and adherence to prenatal care: Impact of insurance, race-ethnicity, and nativity. Maternal and Child Health Journal, 14, 618.PubMedCrossRef
13.
go back to reference Jarvis, C., Munoz, M., Graves, L., et al. (2011). Retrospective review of prenatal care and perinatal outcomes in a group of uninsured pregnant women. Journal of obstetrics and gynaecology Canada, 33(3), 235.PubMed Jarvis, C., Munoz, M., Graves, L., et al. (2011). Retrospective review of prenatal care and perinatal outcomes in a group of uninsured pregnant women. Journal of obstetrics and gynaecology Canada, 33(3), 235.PubMed
14.
go back to reference Buettgens, M., Holahan, J., & Carroll, C. (2011). Health reform across the States: Increased insurance coverage and federal spending on the exchanges and Medicaid. In Timely analysis of immediate health policy issues (pp. 1–8). Washington, DC: Urban Institute. Buettgens, M., Holahan, J., & Carroll, C. (2011). Health reform across the States: Increased insurance coverage and federal spending on the exchanges and Medicaid. In Timely analysis of immediate health policy issues (pp. 1–8). Washington, DC: Urban Institute.
15.
go back to reference Goidel, R. K., Procopio, S., Schwalm, D., et al. (2007). Implications of the Medicaid undercount in a high-penetration Medicaid state. HSR: Health Services Research, 42(6), 2424.PubMed Goidel, R. K., Procopio, S., Schwalm, D., et al. (2007). Implications of the Medicaid undercount in a high-penetration Medicaid state. HSR: Health Services Research, 42(6), 2424.PubMed
16.
go back to reference Kincheloe, J., Brown, E. R., Frates, J., et al. (2006). Can we trust population surveys to count Medicaid enrollees and the uninsured? Health Affairs, 25(4), 1163.PubMedCrossRef Kincheloe, J., Brown, E. R., Frates, J., et al. (2006). Can we trust population surveys to count Medicaid enrollees and the uninsured? Health Affairs, 25(4), 1163.PubMedCrossRef
17.
go back to reference Newman, L. M., Samuel, M. C., Stenger, M. R., et al. (2009). Practical considerations for matching STD and HIV surveillance data with data from other sources. Public Health Reports, 124(Supplement 2), 7.PubMedCentral Newman, L. M., Samuel, M. C., Stenger, M. R., et al. (2009). Practical considerations for matching STD and HIV surveillance data with data from other sources. Public Health Reports, 124(Supplement 2), 7.PubMedCentral
18.
go back to reference Landis, J. R., & Koch, G. G. (1977). The measurement of observer agreement for categorical data. Biometrics, 33(1), 159.PubMedCrossRef Landis, J. R., & Koch, G. G. (1977). The measurement of observer agreement for categorical data. Biometrics, 33(1), 159.PubMedCrossRef
19.
go back to reference Viera, A. J., & Garrett, J. M. (2005). Understanding inter-observer agreement: The kappa statistic. Family Medicine, 37(5), 360.PubMed Viera, A. J., & Garrett, J. M. (2005). Understanding inter-observer agreement: The kappa statistic. Family Medicine, 37(5), 360.PubMed
20.
go back to reference Reichman, N. E., & Schwartz-Soicher, O. (2007). Accuracy of birth certificate data by risk factors and outcomes: Analysis of data from New Jersey. American Journal of Obstetrics and Gynecology, 197(32), e1.PubMed Reichman, N. E., & Schwartz-Soicher, O. (2007). Accuracy of birth certificate data by risk factors and outcomes: Analysis of data from New Jersey. American Journal of Obstetrics and Gynecology, 197(32), e1.PubMed
21.
go back to reference State Data Center of Iowa. (2012). Latinos in Iowa: 2012 (pp. 1–5). Des Moines, IA: Iowa State Library. State Data Center of Iowa. (2012). Latinos in Iowa: 2012 (pp. 1–5). Des Moines, IA: Iowa State Library.
22.
go back to reference Peters, C. P. (2007). The title V maternal and child block grant program (pp. 1–5). Washington, DC: National Health Policy Forum at The George Washington University. Peters, C. P. (2007). The title V maternal and child block grant program (pp. 1–5). Washington, DC: National Health Policy Forum at The George Washington University.
23.
go back to reference Buettgens, M., Nichols, A., & Dorn, S. (2012). Churning under the ACA and State policy options for mitigation. Timely analysis of immediate health policy issues (pp. 1–11). Washington, DC: Urban Institute. Buettgens, M., Nichols, A., & Dorn, S. (2012). Churning under the ACA and State policy options for mitigation. Timely analysis of immediate health policy issues (pp. 1–11). Washington, DC: Urban Institute.
24.
go back to reference Bronstein, J. M., Lomatsch, C. T., Fletcher, D., et al. (2009). Issues and biases in matching Medicaid pregnancy episodes to vital records data: The Arkansas experience. Maternal and Child Health Journal, 13, 250.PubMedCrossRef Bronstein, J. M., Lomatsch, C. T., Fletcher, D., et al. (2009). Issues and biases in matching Medicaid pregnancy episodes to vital records data: The Arkansas experience. Maternal and Child Health Journal, 13, 250.PubMedCrossRef
25.
go back to reference Gyllstrom, M. E., Jensen, J. L., Vaughan, J. N., et al. (2002). Linking birth certificates with Medicaid data to enhance population health assessment: Methodological issues addressed. Journal of Public Health Management and Practice, 8(4), 38.PubMedCrossRef Gyllstrom, M. E., Jensen, J. L., Vaughan, J. N., et al. (2002). Linking birth certificates with Medicaid data to enhance population health assessment: Methodological issues addressed. Journal of Public Health Management and Practice, 8(4), 38.PubMedCrossRef
Metadata
Title
Ascertainment of Medicaid Payment for Delivery on the Iowa Birth Certificate: Is Accuracy Sufficient for Timely Policy and Program Relevant Analysis?
Authors
Debra J. Kane
William M. Sappenfield
Publication date
01-05-2014
Publisher
Springer US
Published in
Maternal and Child Health Journal / Issue 4/2014
Print ISSN: 1092-7875
Electronic ISSN: 1573-6628
DOI
https://doi.org/10.1007/s10995-013-1325-7

Other articles of this Issue 4/2014

Maternal and Child Health Journal 4/2014 Go to the issue