Reliability and One-Year Stability of the PIN3 Neighborhood Environmental Audit in Urban and Rural Neighborhoods
- 128 Downloads
Reliable and stable environmental audit instruments are needed to successfully identify the physical and social attributes that may influence physical activity. This study described the reliability and stability of the PIN3 environmental audit instrument in both urban and rural neighborhoods. Four randomly sampled road segments in and around a one-quarter mile buffer of participants’ residences from the Pregnancy, Infection, and Nutrition (PIN3) study were rated twice, approximately 2 weeks apart. One year later, 253 of the year 1 sampled roads were re-audited. The instrument included 43 measures that resulted in 73 item scores for calculation of percent overall agreement, kappa statistics, and log-linear models. For same-day reliability, 81% of items had moderate to outstanding kappa statistics (kappas ≥ 0.4). Two-week reliability was slightly lower, with 77% of items having moderate to outstanding agreement using kappa statistics. One-year stability had 68% of items showing moderate to outstanding agreement using kappa statistics. The reliability of the audit measures was largely consistent when comparing urban to rural locations, with only 8% of items exhibiting significant differences (α < 0.05) by urbanicity. The PIN3 instrument is a reliable and stable audit tool for studies assessing neighborhood attributes in urban and rural environments.
KeywordsBuilt environment Physical activity Active transport Measurement Walkability
The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health.
Funding for this study was provided by the National Institutes of Health (NIH) /National Cancer Institute (#CA109804-01). AKP was supported by a National Research Service Award T32 post-doctoral research fellowship, funded by the NIH, National Heart, Lung, and Blood Institute (#T32HL007055).
Compliance with ethical standards
This study was reviewed and approved by the Institutional Review Board at UNC.
- 1.Sallis JF, Owen N, Fisher EB. Ecological models of health behavior. In: Glanz K, Rimer BK, Viswanath K, editors. Health behavior and health education: theory, research, and practice. 4th ed. San Francisco, CA: Jossey-Bass; 2008. p. 465–86.Google Scholar
- 5.Bethlehem JR, Mackenbach JD, Ben-Rebah M, Compernolle S, Glonti K, Bárdos H, et al. The SPOTLIGHT virtual audit tool: a valid and reliable tool to assess obesogenic characteristics of the built environment. Int J Health Geogr. 2014;13:52.Google Scholar
- 7.Bader MDM, Mooney SJ, Lee YJ, Sheehan D, Neckerman KM, Rundle AG, et al. Development and deployment of the Computer Assisted Neighborhood Visual Assessment System (CANVAS) to measure health-related neighborhood conditions. Health Place. 2015;31:163–72.Google Scholar
- 12.Millstein RA, Cain KL, Sallis JF, Conway TL, Geremia C, Frank LD, et al. Development, scoring, and reliability of the Microscale Audit of Pedestrian Streetscapes (MAPS). BMC Public Health. 2013;13:403.Google Scholar
- 13.Malecki KC, Engelman CD, Peppard PE, Nieto FJ, Grabow ML, Bernardinello M, et al. The Wisconsin Assessment of the Social and Built Environment (WASABE): a multi-dimensional objective audit instrument for examining neighborhood effects on health. BMC Public Health. 2014;14Google Scholar
- 16.Leung CW, Gregorich SE, Laraia BA, Kushi LH, Yen IH. Measuring the neighborhood environment: associations with young girls’ energy intake and expenditure in a cross-sectional study. Int J Behav Nutr Phys Act. 2010;7:52.Google Scholar
- 17.Parsons JA, Singh G, Scott AN, Nisenbaum R, Balasubramaniam P, Jabbar A, et al. Standardized observation of neighbourhood disorder: does it work in Canada? Int J Health Geogr. 2010;9:6.Google Scholar
- 20.Franzini L, Elliott MN, Cuccaro P, Schuster M, Gilliland MJ, Grunbaum JA, et al. Influences of physical and social neighborhood environments on children's physical activity and obesity. Am J Public Health. 2009;99(2):271–8.Google Scholar
- 26.Zenk SN, Schulz AJ, Mentz G, House JS, Gravlee CC, Miranda PY, et al. Inter-rater and test-retest reliability: methods and results for the neighborhood observational checklist. Health Place. 2007;13(2):452–65.Google Scholar
- 34.Laraia BA, Messer L, Kaufman JS, Dole N, Caughy M, O’Campo P, et al. Direct observation of neighborhood attributes in an urban area of the US south: characterizing the social context of pregnancy. Int J Health Geogr. 2006;5:11.Google Scholar
- 40.Knapp EA, Nau C, Brandau S, DeWalle J, Hirsch AG, Bailey-Davis L, et al. Community Audit of Social, Civil, and Activity Domains in Diverse Environments (CASCADDE). Am J Prev Med. 2017;52(4):530–40.Google Scholar
- 43.Census 2000 urban and rural classifications. https://www.census.gov/geo/reference/ua/urban-rural-2000.html. Accessed Sept 26, 2017.
- 47.Agresti A. An introduction to categorical data analysis. New York, NY: Wiley; 1996.Google Scholar