Journal of Urban Health

, Volume 95, Issue 6, pp 777–780 | Cite as

NYC HANES 2013–14 and Reflections on Future Population Health Surveillance

  • Sharon E. PerlmanEmail author
  • R. Charon Gwynn
  • Carolyn M. Greene
  • Amy Freeman
  • Claudia Chernov
  • Lorna E. Thorpe

Accurate and reliable population health data are critical to public health and enable evidence-based planning, policy-making, and program evaluation. Public health agencies rely on local data to identify and monitor the burden of disease in a population over time and to answer important health policy questions. The New York City Health and Nutrition Examination Survey (NYC HANES), a local, representative heath examination survey, was conducted twice in NYC, once in 2004 and again in 2013–14 [1, 2]. Data from NYC HANES have served as a strong complement to existing population health surveillance data, especially in the context of New York City’s urban environment. In this special issue, we describe a range of findings from NYC HANES 2013–14 that collectively illustrate the unique contribution of examination surveys to population health surveillance. Yet, few public health agencies implement examination surveys, despite their important contributions, in part because such surveys can be expensive and difficult to conduct. We explore the value and challenges of surveys like NYC HANES, and we also describe emerging population health surveillance approaches that might provide complementary information to improve public health.

NYC HANES was modeled on the National Health and Nutrition Examination Survey (NHANES), using a similar sampling design, instruments, protocols, and testing laboratories. Results from NYC HANES 2004 showed for the first time how many New Yorkers suffered from diagnosed and undiagnosed chronic conditions like diabetes, high cholesterol, and depression, and whether their conditions were well controlled. NYC HANES 2004 findings [3] helped identify and support public health policies to improve New Yorkers’ health, such as laws to restrict the use of artificial trans-fat in restaurants and to reduce exposure to secondhand smoke, the creation of a diabetes A1c Registry to improve diabetes diagnosis and control, and an educational campaign to inform the public of high levels of mercury in certain fish. Ten years later, in 2013–14, the NYC Health Department and researchers at the CUNY School of Public Health (now at NYU School of Medicine) conducted a second NYC HANES to collect information about the health of New Yorkers, to assess health changes since 2004, and to support evaluation of health policies implemented over the past decade.

Unique strengths of a study like NYC HANES include the ability to quantify and characterize the burden of undiagnosed disease by combining self-reported survey data with objective measurements from laboratory testing or physical examination. Also, by remaining consistent with the national HANES design, comparisons can be made between NYC, a diverse, urban area, and the country to view local health changes in the context of national trends. For example, a 2016 study compared secondhand smoke exposure in NYC to the US overall using objectively measured blood cotinine levels and found more non-smokers in NYC were exposed to secondhand smoke than were exposed nationally (37 vs. 24%) and that non-smoking residents in NYC experienced a substantial decrease in secondhand smoke exposure since 2004 (from 57 to 37%) [4]. Possible explanations for greater exposure in NYC included more multi-unit housing, greater population density, and pedestrian exposure.

Many of the articles in this issue demonstrate these strengths, including a brief report that describes increases in obesity and racial inequities from 2004 to 2013–14 using findings from measured height and weight, as well as a brief report on local changes in diagnosed and undiagnosed diabetes and treatment and control using results from laboratory testing. The paper on depression highlights that surveys like NYC HANES can capture mental health conditions and associated health behaviors, data not typically captured well in non-survey sources. Several papers in this issue compare NYC results to the US overall, highlighting issues unique to urban areas and providing context for changes resulting from municipal policy and programmatic initiatives. For example, one paper in this issue demonstrates that decreases in blood mercury levels in NYC adults from 2004 to 2013–14 were greater than the national decrease, most likely reflecting the impact of intense local educational campaigns about high mercury concentration in certain types of fish and leading to decreased consumption of those species.

NYC HANES and other local surveys provide important local health information to inform municipal policies and program planning. In particular, health behaviors, health functioning, and small geographic area estimates resonate deeply with local policy-makers. Yet conducting an extensive in-person examination study such as NYC HANES is challenging. This is likely why only a handful of jurisdictions have been able to conduct local health examination surveys; these include NYC, Chicago, [5] and Wisconsin [6]. Population-based health examination surveys are not only costly and logistically difficult, but residents in NYC and elsewhere increasingly express distrust when asked to participate. Declining response rates to both in-person and telephone surveys require researchers to spend more energy and resources to reach and recruit cases [7, 8]. Thus, an important question is whether such studies will continue to be a worthwhile investment, especially in the context of emerging surveillance sources. New technologies and data systems have prompted public health practitioners to examine novel ways of collecting and analyzing health data for surveillance [9], while maintaining well-established surveillance standards [10].

Electronic health records (EHRs) are an example of an emerging source of population health information. The widespread use of EHRs is encouraging and suggests that data captured in EHRs may eventually be a representative of communities. As of 2015, 87% of office-based physicians were using an EHR [11]. One goal in conducting NYC HANES 2013–14 was to assess the potential for using EHR data for population health surveillance by validating a new EHR-based system, the NYC Macroscope, with NYC HANES findings. NYC HANES 2013–14 estimates were compared with EHR-derived estimates during the same period with mixed results. Among those who had seen a provider for primary care in the past year, diabetes, hypertension, smoking, and obesity prevalence estimates were similar to NYC HANES, but estimates for depression and influenza vaccination were considerably lower than survey estimates [12, 13]. Other jurisdictions have used EHR data to look at a range of conditions, including chlamydia, Lou Gehrig’s disease, asthma, and kidney disease [14, 15]. Massachusetts has validated estimates for diabetes, asthma, smoking, hypertension, and obesity from the EHR-based MDPHnet with the national Behavioral Risk Factor Surveillance Survey (BRFSS) [14]. In Colorado, the Colorado Health Observation Regional Data Service (CHORDS) is being used for public health monitoring and evaluation [16]. More work is needed to understand how EHR-based health estimates can be used and to ensure that they are reliable and accurate.

While EHRs offer innovative, timely and potentially cost-effective approaches to population health surveillance, to date, information from these sources is typically available only for select groups and cannot be generalized to entire populations. There are a few exceptions, such as Kaiser Permanente and the Department of Veteran’s Affairs, which have EHR networks that have broad, representative coverage of well-defined populations. With even more widespread use of EHRs and improved documentation and standardization promoted through meaningful use [17], future population coverage and data quality may improve sufficiently to provide reliable and representative health estimates for other populations and for many more conditions. Yet EHRs are unlikely to replace survey research, as EHRs exclude those not in care, and seldom contain information on health behaviors, such as alcohol use, exercise, and diet.

Health apps, mobile health technologies (mHealth), and social media are also opening new possibilities for health research and disease monitoring and management. Mobile health applications include smoking cessation, mental health counseling, chronic disease monitoring, and reminders to take prescription medication [18, 19, 20]. Technology is also driving innovations in how data can be analyzed. Private companies have been using artificial intelligence for health data analysis and predictive modeling [21, 22]. Public-private partnerships can encourage the use of advanced technology and have resulted in innovative approaches to capturing public health data. For example, the Centers for Disease Control and Prevention has recently partnered with Watson Health to explore ways to better manage data and respond to emergencies [23], and the NYC Health Department worked with Columbia University in using social media restaurant reviews to detect food poisoning outbreaks [24]. As such partnerships evolve, generating representative data that can inform public health agencies and policy-makers will be critical.

Innovative technologies can also be employed to strengthen how existing data are used for population health surveillance. One example of this is linking multiple data sources such as EHR, survey, and administrative data (e.g., housing, hospital, birth, and death records), enabling researchers to answer broader questions about causation, progression of risk factors and diseases, and the effect of environmental factors on health. New York City [25], San Diego [26], and other cities have compiled neighborhood-level data on crime, education, employment, housing, hospitalization, parks, transportation, and measures of social cohesion to provide a larger picture of the health of communities and the individuals living within those communities. Combining neighborhood and health survey data allows us to ask broader social questions, such as how do crime and access to parks impact exercise and obesity, and what housing characteristics are associated with increased secondhand smoke exposure and asthma.

In summary, population health surveys like NYC HANES are an important component of public health surveillance because they are representative, and they capture health measures that cannot be easily self-reported, such as undiagnosed disease and exposure to environmental toxins. While such surveys can be expensive and labor-intensive as currently designed, methodologic advances in sampling and more cost-effective approaches to collect and analyze biospecimens may improve feasibility over time. In addition, with more reliable and complete complementary data sources, it may be beneficial to conduct smaller-scale examination surveys that focus on objective measures for targeted conditions. Emerging approaches such as EHR-based surveillance and better data linkage technology also allow researchers to more easily supplement traditional survey data. Strong population health surveillance systems rely on triangulation of multiple data sources. With time, more jurisdictions can potentially obtain valuable information by combining representative surveys with some of these newer approaches. For the foreseeable future, population-based surveys like NYC HANES can continue to play an important role in population health surveillance.



The authors thank the many people at CUNY and the New York City Health Department who provided support to NYC HANES, including our dedicated field staff team, as well as study participants who made the study possible. Support for NYC HANES 2013–2014 was primarily provided by the de Beaumont Foundation with additional support from the Robert Wood Johnson Foundation, the Robin Hood Foundation, the New York State Health Foundation, Quest Diagnostics, the Doris Duke Charitable Foundation, the NYC Department of Health and Mental Hygiene, Hunter College Office of the Provost, the City University of New York (CUNY) Vice Chancellors Office of Research, and the CUNY School of Public Health Dean’s Office. Additional support was provided by the NYU-CUNY Prevention Research Center. The contents of this paper are the responsibility of the authors and do not represent the official views of the funders.

Authors’ Contributions

All authors were involved in writing and editing the paper, with SP leading this effort.


  1. 1.
    Thorpe LE, Gwynn RC, Mandel-Ricci J, et al. Study design and participation rates of the New York City Health and Nutrition Examination Survey, 2004. Prev Chronic Dis. 2006;3(3):A94. Scholar
  2. 2.
    Thorpe LE, Greene C, Freeman A, Snell E, Rodriguez-Lopez JS, Frankel M, et al. Rationale, design and respondent characteristics of the 2013–2014 New York City Health and Nutrition Examination Survey (NYC HANES 2013–2014). Prev Med Rep. 2015;2:580–5. Scholar
  3. 3.
    Gwynn RC, Garg RK, Kerker BD, Frieden TR, Thorpe LE. Contributions of a local health examination survey to the surveillance of chronic and infectious diseases in New York City. Am J Public Health. 2009;99(1):152–9. Scholar
  4. 4.
    Perlman SE, Chernov C, Farley SM, Greene CM, Aldous KM, Freeman A, et al. Exposure to secondhand smoke among nonsmokers in New York City in the context of recent tobacco control policies: current status, changes over the past decade, and national comparisons. Nicotine Tob Res. 2016;18(11):2065–74. Scholar
  5. 5.
    Whitman S, Shah A, Benjamin M, editors. Urban health: combating disparities with local data. New York, NY: Oxford University Press; 2011.Google Scholar
  6. 6.
    Survey of the Health of Wisconsin. Available at Accessed 18 Jan 2018.
  7. 7.
    Czajka JL, Beyler, A. Declining response rates in federal surveys: trends and implications. Mathematica Policy Research. 2016. Available at Accessed 25 Jan 2018.
  8. 8.
    Pew Research Center. Assessing the representativeness of public opinion surveys. 2012 Available at Accessed 18 Jan2018.
  9. 9.
    Thacker SB, Qualters JR, Lee LM. Public health surveillance in the United States: evolution and challenges. MMWR. 2012;61(03):3–9.Google Scholar
  10. 10.
    German RR, Lee LM, Horan JM, Milstein RL, Pertowski CA, Waller MN, et al. Updated guidelines for evaluating public health surveillance systems: recommendations from the Guidelines Working Group. MMWR Recomm Rep. 2001 Jul 27;50(RR-13):1–35.Google Scholar
  11. 11.
    Office of the National Coordinator for Health Information Technology. Office-based physician electronic health record adoption, Health IT Quick-Stat #50. Accessed 18 June 2018.
  12. 12.
    McVeigh KH, Newton-Dame R, Chan PY, et al. Can electronic health records be used for population health surveillance? Validating population health metrics against established survey data. EGEMS (Wash DC). 2016;4(1):27.Google Scholar
  13. 13.
    Thorpe LE, McVeigh KH, Perlman SE, et al. Monitoring prevalence, treatment, and control of metabolic conditions in New York City adults using 2013 primary care electronic health records: a surveillance validation study. EGEMS (Wash DC). 2016;4(1):28.Google Scholar
  14. 14.
    Klompas M, Cocoros NM, Menchaca JT, Erani D, Hafer E, Herrick B, et al. State and local chronic disease surveillance using electronic health record systems. Am J Public Health. 2017;107(9):1406–12. Scholar
  15. 15.
  16. 16.
    Colorado Health Observation Regional Data Service. Available at Accessed 29 Jan 2018.
  17. 17.
    Office of the National Coordinator for Health Information Technology. Meaningful use definitions and objectives. 2015. Available at: Accessed 23 Jan 2018.
  18. 18.
    Anxiety and Depression Association of America. ADAA reviewed mental health apps. Available at Accessed 28 Dec 2017.
  19. 19.
    Whittaker R, McRobbie H, Bullen C, Rodgers A, Gu Y. Mobile phone-based interventions for smoking cessation. Cochrane Database Syst Rev. 2016;4:CD006611. Scholar
  20. 20.
    Silva BMC, Rodrigues JJPC, de la Torre Díez I, López-Coronado M, Saleem K. Mobile-health: a review of current state in 2015. J Biomed Inform. 2015;56:265–72.CrossRefGoogle Scholar
  21. 21.
    Watson Oncology. Memorial Sloan Kettering Cancer Center. Available at Accessed 28 Dec 2017.
  22. 22.
    How companies learn your secrets. New York Times. Available at Accessed 28 Dec 2017.
  23. 23.
  24. 24.
    Effland T, Lawson A, Balter S, Devinney K, Reddy V, Waechter H, et al. Discovering foodborne illness in online restaurant reviews. J Am Med Inform Assoc. 2018;
  25. 25.
    Reilly KH, Schretzman M, Johns E, et al. Neighborhood tabulation areas: enhancing population health and human services capacity in NYC through shared information at the small area level. Available at Accessed 28 Dec 2017.
  26. 26.

Copyright information

© The New York Academy of Medicine 2018

Authors and Affiliations

  1. 1.Division of EpidemiologyNew York City Department of Health and Mental HygieneNew YorkUSA
  2. 2.Department of Population HealthNew York University School of MedicineNew YorkUSA

Personalised recommendations