Skip to main content
SpringerLink
Log in

Birth Certificate Validity and the Impact on Primary Cesarean Section Quality Measure in New York State

  • Original Paper
  • Published:
Journal of Community Health Aims and scope Submit manuscript

Abstract

In New York (NY), birth certificate data are routinely used for assessing quality of care and health outcomes such as primary cesarean section (PCS) rates. However rare events are often underreported. This study compared birth certificates to medical records, and examined the impact of underreporting on risk adjustment variables for PCS. We conducted an internal validation study using a random sample of 702 NY births in 2009. Sensitivity and positive predictive value (PPV) of rare events reported on birth certificates were determined using abstracted and matched medical records as the gold standard. To assess the impact, we calculated PCS odds ratios for variables in the risk-adjustment model before and after correcting for measurement error. The sensitivity and PPV of birth certificate data elements including those in the PCS risk model varied from 0 to 100. After correction for measurement error, PCS odds ratios increased for most variables. For example, the PCS odds ratio for those with no prior live births was 3.03 (95% CI 2.94, 3.13), but after correction of measurement error increased to 3.46 (95% CI 3.22, 3.67). A composite negative event variable including abruptio placenta, eclampsia, or infection was the only variable that decreased after correction and was no longer significant (uncorrected OR 3.06, 95% CI 2.86, 3.29; corrected OR 1.42, 95% CI 0.79, 2.59). Underreporting on birth certificates remains concerning and impacts the risk adjustment for quality measures. Without improved data validity, health plans’ quality metrics do not fully account for patient case-mix.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Roohan, P. J., Josberger, R. E., Acar, J., Dabir, P., Feder, H. M., & Gagliano, P. J. (2003). Validation of birth certificate data in New York State. Journal of Community Health, 28(5), 335–346.

    Article  PubMed  Google Scholar 

  2. Osterman, M. J., Martin, J. A., Mathews, T. J., & Hamilton, B. E. (2011). Expanded data from the new birth certificate, 2008. National Vital Statistics Reports, 59(7), 1–28.

    PubMed  Google Scholar 

  3. New York state medicaid update: Prenatal care special edition. (2010). https://www.health.ny.gov/health_care/medicaid/program/update/2010/2010-02_special_edition.htm: New York State Department of Health.

  4. Northam, S., & Knapp, T. R. (2006). The reliability and validity of birth certificates. Journal of Obstetric, Gynecologic, & Neonatal Nursing, 35(1), 3–12. https://doi.org/10.1111/j.1552-6909.2006.00016.x.

    Article  Google Scholar 

  5. Zollinger, T. W., Przybylski, M. J., & Gamache, R. E. (2006). Reliability of Indiana birth certificate data compared to medical records. Annals of Epidemiology, 16(1), 1–10. https://doi.org/10.1016/j.annepidem.2005.03.005.

    Article  PubMed  Google Scholar 

  6. Clayton, H. B., Sappenfield, W. M., Gulitz, E., et al. (2013). The Florida investigation of primary late preterm and cesarean delivery: The accuracy of the birth certificate and hospital discharge records. Maternal and Child Health Journal, 17(5), 869–878. https://doi.org/10.1007/s10995-012-1065-0.

    Article  PubMed  Google Scholar 

  7. Howland, R. E., Mulready-Ward, C., Madsen, A. M., et al. (2015). Reliability of reported maternal smoking: Comparing the birth certificate to maternal worksheets and prenatal and hospital medical records, New York City and Vermont, 2009. Maternal and Child Health Journal, 19(9), 1916–1924. https://doi.org/10.1007/s10995-015-1722-1.

    Article  PubMed  PubMed Central  Google Scholar 

  8. Andrade, S. E., Scott, P. E., Davis, R. L., et al. (2013). Validity of health plan and birth certificate data for pregnancy research. Pharmacoepidemiology and Drug Safety, 22(1), 7–15. https://doi.org/10.1002/pds.3319.

    Article  PubMed  Google Scholar 

  9. Stout, M. J., Macones, G. A., & Tuuli, M. G. (2017). Accuracy of birth certificate data for classifying preterm birth. Paediatric and Perinatal Epidemiology, 31(3), 245–249. https://doi.org/10.1111/ppe.12352.

    Article  PubMed  Google Scholar 

  10. Jurek, A. M., & Greenland, S. (2013). Adjusting for multiple-misclassified variables in a study using birth certificates. Annals of Epidemiology, 23(8), 515–520. https://doi.org/10.1016/j.annepidem.2013.05.010.

    Article  PubMed  Google Scholar 

  11. Haghighat, N., Hu, M., Laurent, O., Chung, J., Nguyen, P., & Wu, J. (2016). Comparison of birth certificates and hospital-based birth data on pregnancy complications in Los Angeles and Orange County, California. BMC Pregnancy Childbirth, 16, 93. https://doi.org/10.1186/s12884-016-0885-0.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  12. Lydon-Rochelle, M. T., Holt, V. L., Cardenas, V., et al. (2005). The reporting of pre-existing maternal medical conditions and complications of pregnancy on birth certificates and in hospital discharge data. American Journal of Obstetrics and Gynecology, 193(1), 125–134. https://doi.org/10.1016/j.ajog.2005.02.096.

    Article  PubMed  Google Scholar 

  13. Annual report of vital statistics: New York State 2014. (2016). https://www.health.ny.gov/statistics/vital_statistics/docs/vital_statistics_annual_report_2014.pdf: New York State Department of Health, Office of Quality and Patient Safety.

  14. 2017 Health Plan Comparison Report: A report comparing quality and satisfaction performance results for health plans. (2017). https://www.health.ny.gov/health_care/managed_care/reports/docs/health_comp_report/health_comp_report_2017.pdf: New York State Department of Health, Office of Quality and Patient Safety.

  15. Buderer, N. M. (1996). Statistical methodology: I. Incorporating the prevalence of disease into the sample size calculation for sensitivity and specificity. Academic Emergency Medicine, 3(9), 895–900.

    Article  PubMed  CAS  Google Scholar 

  16. Wang, T., Schoen, L. D., Melnik, T. A., Kacica, M. A., & Shields, E. (2014). Primary cesarean delivery in New York State, 2003–2012. https://www.health.ny.gov/statistics/vital_statistics/docs/primary_cesarean_delivery_2003-2012.pdf: New York State Department of Health.

  17. Roohan, P. J., Josberger, R. E., & Gesten, F. C. (2001). Risk-adjusted primary cesarean delivery rates for managed care plans in New York State, 1998. Maternal and Child Health Journal, 5(3), 169–177.

    Article  PubMed  CAS  Google Scholar 

  18. Kane, D. J., & Sappenfield, W. M. (2014). Ascertainment of medicaid payment for delivery on the Iowa birth certificate: Is accuracy sufficient for timely policy and program relevant analysis? Maternal and Child Health Journal, 18(4), 970–977. https://doi.org/10.1007/s10995-013-1325-7.

    Article  PubMed  Google Scholar 

  19. Lyles, R. H., Zhang, F., & Drews-Botsch, C. (2007). Combining internal and external validation data to correct for exposure misclassification: A case study. Epidemiology, 18(3), 321–328. https://doi.org/10.1097/01.ede.0000260004.49431.70.

    Article  PubMed  Google Scholar 

  20. Li, J., Robbins, S., & Lamm, S. H. (2013). The influence of misclassification bias on the reported rates of congenital anomalies on the birth certificates for West Virginia—A consequence of an open-ended query. Birth Defects Research Part A Clinical and Molecular Teratology, 97(3), 140–151. https://doi.org/10.1002/bdra.23119.

    Article  PubMed  CAS  Google Scholar 

  21. Melnik, T. A., Guldal, C. G., Schoen, L. D., Alicandro, J., & Henfield, P. (2015). Barriers in accurate and complete birth registration in New York State. Maternal and Child Health Journal, 19(9), 1943–1948. https://doi.org/10.1007/s10995-015-1711-4.

    Article  PubMed  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Office of Quality and Patient Safety, New York State Department of Health, Corning Tower, Empire State Plaza, Albany, NY, 12237, USA

    Raina E. Josberger, Meng Wu & Elizabeth L. Nichols

Authors
  1. Raina E. Josberger
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Meng Wu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Elizabeth L. Nichols
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Raina E. Josberger.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Josberger, R.E., Wu, M. & Nichols, E.L. Birth Certificate Validity and the Impact on Primary Cesarean Section Quality Measure in New York State. J Community Health 44, 222–229 (2019). https://doi.org/10.1007/s10900-018-0577-y

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10900-018-0577-y

Keywords

Search

Navigation