Skip to main content
Log in

The possible “backfire” effects of hot spots policing: an experimental assessment of impacts on legitimacy, fear and collective efficacy

  • Published:
Journal of Experimental Criminology Aims and scope Submit manuscript

Abstract

Objectives

To examine the impacts of broken windows policing at crime hot spots on fear of crime, ratings of police legitimacy and reports of collective efficacy among residents of targeted hot spots.

Methods

A block randomized experimental design with a police intervention targeting disorder delivered to 55 treatment street segments with an equal number of segments serving as controls. Main outcomes were measured using a panel survey of 371 persons living or working in these sites.

Results

The broken windows police intervention delivered to crime hot spots in this study had no significant impacts on fear of crime, police legitimacy, collective efficacy, or perceptions of crime or social disorder. Perceptions of physical disorder appear to have been modestly increased in the target areas.

Conclusions

The findings suggest that recent criticisms of hot spots policing approaches which focus on possible negative “backfire” effects for residents of the targeted areas may be overstated. The study shows that residents are not aware of, or much affected by, a three hour per week dosage of aggressive order maintenance policing on their blocks (in addition to routine police responses in these areas). Future research needs to replicate these findings focusing on varied target populations and types of crime hot spots, and examining different styles of hot spots policing.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1

Similar content being viewed by others

Notes

  1. For selection of study street segments, disorder was defined to include all calls for service for prostitution, drug possession, disturbing the peace, vandalism, public drinking, misdemeanor DUI, noise complaints, fights, and thefts from automobiles. We use a different measure of disorder in our analyses in this study, as we later decided that DUI, fights and automobile burglaries did not fit with Wilson and Kelling’s (1982) concept of disorder. However, for selecting the study sites, they were considered as good proxies as places with such problems were deemed likely to also have issues with other types of social disorder (loitering, panhandling, vagrancy, etc.) which do not tend to generate many police calls for service.

  2. Part 1 crime included the FBI defined part 1 offenses, excluding thefts from autos which were included as a disorder for site selection purposes as outlined in footnote 1.

  3. For Redlands and Colton, we were able to bolster the PowerFinder database with a list of phone numbers on the study blocks provided by each city’s water department. We were unable to obtain such data for Ontario, but this was less of a concern as the number of phones per street segment in the PowerFinder data were higher in Ontario than the other two cities.

  4. The survey was first piloted in a city removed from the study. All interviewers were required to satisfactorily complete pilot shifts before calling respondents in the study sample.

  5. The cooperation rate excludes cases that were coded as chronic no answer/busy/answering machine (n = 307) and cases where there was a language (not an English or Spanish speaker) or cognitive barrier (n = 59) from the denominator.

  6. Specifically, a study using random digit dialing in the state of Kentucky had a response rate of 27.5% (Rader et al. 2007), a study of fear in Dallas neighborhoods had a response rate of 33.4% (Ferguson and Midel 2007), and a study by Xu et al. (2005) achieved a response rate of 60%, and a study in Philadelphia had a response rate of 77% (Wyant 2008). It is worth noting that the Xu et al. data was collected by a police department (and respondents may be less likely to refuse a survey collected directly by the police) and the Wyant study involved a $10 monetary reward for respondents to encourage participation.

  7. The crimes asked about included: robbery, assault (attacked by stranger), murder, sexual assault, burglary, car stolen, vandalism

  8. These questions were drawn from work on police legitimacy by Tom Tyler (1990; 2004).

  9. The perceived social disorder measure includes: fist fights, people loitering or being disorderly, public drinking, drunk or high in public, panhandlers, vandalism, people making too much noise late at night/early morning, gambling in the street, drug sales, and prostitution.

  10. The perceived physical disorder measure includes: broken windows, graffiti, abandoned or boarded-up buildings, vacant lots, abandoned cars, litter, street or sidewalks in need of repair, and areas in need of better lighting.

  11. The perceived crime measure included: cars being broken into, burglary, robbery, shooting guns in public, sexual assaults.

  12. These power estimates were calculated using the Optimal Design software.

  13. This power analysis was conducted in the Power and Precisions Software, and based on t tests assuming no change from the pre-intervention mean in the control areas, and hypothesized changes from the pre-intervention mean in the target areas.

  14. These results are based on regression models that include treatment, city, pre-crime counts, and an interaction of treatment and pre-crime counts. In the simple analyses of all cases only for crime outcomes, we do find a significant effect for treatment and the interaction of treatment and crime baseline outcomes. However, a sensitivity analysis shows that this effect is highly unstable and impacted strongly by outliers.

  15. As such there is some nesting of the data. However, given the small number of subjects per street segment, there are not enough cases in the level-one clusters to justify hierarchical data modeling. The mean number of subjects per segment is 3.5 with a range of 1 to 10. Sixteen segments have only one respondent, which means there is no within-cluster variation for nearly 15 percent of our segments. See Silver (2000) for a similar justification for not using multilevel modeling with a low number of subjects per level-two unit.

  16. We think that this approach is reasonable given our assumption that the treatment is delivered relatively similarly across sites and the balance of treatment and control cases in the survey. Nonetheless, we recognize that treatment was randomly allocated at the street-segment level and not the individual level. In order to examine the outcomes of the experiment strictly at that level, we also aggregated outcome variables to the segment level and ran the analyses on those variables as a sensitivity check. All results were substantively identical to the individual-level findings presented below in terms of direction of changes, and significance levels were also very similar. As an additional sensitivity test, we also analyzed the data using repeated measures split plot ANOVA tests with the pre- and post-intervention outcome variables as the within subjects repeated factor and the treatment and city as between subjects factors. These analyses were also substantively identical to both the analyses below and the segment-level analyses.

References

  • Appleyard, D. (1981). Livable streets. Berkeley: University of California Press.

    Google Scholar 

  • Bloom, H. S. (2005). Randomizing groups to evaluate place-based programs. In H. S. Bloom (Ed.), Learning More From Social Experiments: Evolving Analytic Approaches. New York: Russell Sage Foundation Publications.

    Google Scholar 

  • Braga, A. A. (2001). The effects of hot spots policing on crime. Annals of the American Academy of Political and Social Sciences, 568, 104–125.

    Article  Google Scholar 

  • Braga, A. A. (2005). Hot spots policing and crime prevention: A systematic review of randomized controlled trials. Journal of Experimental Criminology, 1, 317–342.

    Article  Google Scholar 

  • Braga, A. A., & Bond, B. J. (2008). Policing crime and disorder hot spots: A randomized controlled trial. Criminology, 46, 577–607.

    Article  Google Scholar 

  • Braga, A. A., & Bond, B. J. (2009). Community perception of police crime prevention efforts: Using interviews in small areas to evaluate crime reduction strategies. In J. Knutsson & N. Tilley (Eds.), Crime Prevention Studies (Vol. 24, pp. 87–119). Monsey: Criminal Justice Press.

    Google Scholar 

  • Braga, A. A., & Weisburd, D. (2010). Policing Problem Places: Crime Hot Spots and Effective Crime Prevention. Oxford: Oxford University Press.

    Google Scholar 

  • Braga, A. A., Weisburd, D., Waring, E. J., Green Mazerolle, L., Spelman, W., & Gajewski, F. (1999). Problem-oriented policing in violent crime places: A randomized controlled experiment. Criminology, 37, 541–580.

    Article  Google Scholar 

  • Chermak, S., McGarrell, E. F., & Weiss, A. (2001). Citizen perceptions of aggressive traffic enforcement strategies. Justice Quarterly, 18, 365–391.

    Article  Google Scholar 

  • Clarke, R. V., & Weisburd, D. (1994). Diffusion of crime control benefits: Observations on the reverse of displacement. In R. V. Clarke (Ed.), Crime Prevention Studies (pp. 165–184). Monsey: Criminal Justice Press.

    Google Scholar 

  • Cohen, J. (1988). Statistical power analysis for the behavioral sciences. Hillsdale: Lawrence Erlbaum Associates, Inc.

    Google Scholar 

  • Ferguson, K. M., & Midel, C. H. (2007). Modeling fear of crime in Dallas neighborhoods: A test of social capital theory. Crime & Delinquency, 53, 322–350.

    Article  Google Scholar 

  • Ferraro, K. F. (1995). Fear of crime: Interpreting victimization risk. Albany: State University of New York Press.

    Google Scholar 

  • Green, L. (1995). Cleaning up drug hot spots in Oakland, California: The displacement and diffusion effects. Justice Quarterly, 12, 737–754.

    Article  Google Scholar 

  • Green, L. (1996). Policing places with drug problems. Thousand Oaks: Sage.

    Google Scholar 

  • Greene, J. A. (1999). Zero tolerance: A case study of police policies and practices in New York City. Crime & Delinquency, 45, 171–187.

    Article  Google Scholar 

  • Greenwood, P. & Petersilia, J. (1975). The criminal investigation process: Summary and policy implications. R-1776-DOJ, the RAND Corporation

  • Harcourt, B. E. (2001). The illusion of order: The false promise of broken windows policing. Cambridge: Harvard University Press.

    Google Scholar 

  • Hinkle, J. C., & Weisburd, D. (2008). The irony of broken windows policing: A micro-place study of the relationship between disorder, focused police crackdowns and fear of crime. Journal of Criminal Justice, 36, 503–512.

    Article  Google Scholar 

  • Hinkle, J. C., & Yang, S. (2008). What shapes peoples’ perceptions of disorder? An exploratory study of fear, victimization and demographics. St. Louis: Paper presented at the annual meeting of the American Society of Criminology.

    Google Scholar 

  • Hunter, A. (1978). Symbols of incivility: Social disorder and fear of crime in urban neighborhoods. Dallas: Paper presented at the annual meeting of the American Society of Criminology.

    Google Scholar 

  • Jacobs, J. (1961). The Death and Life of Great American Cities. New York: Vintage Books.

    Google Scholar 

  • Kelling, G. L., & Coles, C. (1996). Fixing broken windows: Restoring order and reducing crime in American cities. New York: Free Press.

    Google Scholar 

  • Kelling, G. L., Pate, T., Dieckman, D., & Brown, C. E. (1974). The Kansas City Preventive Patrol Experiment. Washington: The Police Foundation.

    Google Scholar 

  • Kochel, T. R. (2011). Constructing hot spots policing: Unexamined consequences for disadvantaged populations and for police legitimacy. Criminal Justice Policy Review (in press)

  • Levine, J. P. (1975). The ineffectiveness of adding police to prevent crime. Public Policy, 23, 523–545.

    Google Scholar 

  • Mastrofski, S., Snipes, J., & Supina, A. (1996). Compliance on demand: The public’s response to specific police requests. Journal of Research in Crime and Delinquency, 33, 269–305.

    Article  Google Scholar 

  • Mastrofski, S., Snipes, J. B., Parks, R. B., & Maxwell, C. D. (2000). The helping hand of the law: Police control of citizens on request. Criminology, 38, 307–342.

    Article  Google Scholar 

  • McCluskey, J., Mastrofski, S., & Parks, R. (1999). To acquiesce or rebel: Predicting citizen compliance with police requests. Police Quarterly, 2(4), 389–416.

    Article  Google Scholar 

  • McGarrell, E. F., Chermak, S., & Weiss, A. (1999). Reducing firearms violence through directed police patrol: Final report on the evaluation of the Indianapolis Police Department’s directed patrol project. Washington: National Institute of Justice.

    Google Scholar 

  • National Research Council (2004). Fairness and effectiveness in policing: The evidence, Committee to Review Research on Police Policy and Practices. In W. Skogan & K. Frydl (Eds.), Committee on Law and Justice, Division of Behavioral and Social Sciences and Education. Washington: The National Academies Press.

  • Pierce, G., Spaar, S., & Briggs, L. R. (1986). The character of police work: strategic and tactical implications. Center for Applied Social Research. Boston: Northeastern University.

    Google Scholar 

  • Rader, N. E., May, D. C., & Goodrum, S. (2007). An empirical assessment of the “threat of victimization:” Considering fear of crime, perceived risk, avoidance, and defensive behaviors. Sociological Spectrum, 27, 475–505.

    Article  Google Scholar 

  • Rosenbaum, D. P. (2006). The limits of hot spots policing. In D. Weisburd & A. A. Braga (Eds.), Police innovation: Contrasting perspectives. Cambridge: Cambridge University Press.

    Google Scholar 

  • Sampson, R. J. (2004). Neighborhood and community: Collective efficacy and community safety. New Economy, 11, 106–113.

    Article  Google Scholar 

  • Sampson, R. J., & Raudenbush, S. W. (1999). Systematic social observation of public spaces: A new look at disorder in urban neighborhoods. The American Journal of Sociology, 105, 603–651.

    Article  Google Scholar 

  • Sampson, R. J., Raudenbush, S. W., & Earls, F. (1997). Neighborhoods and violent crime: A multilevel study of collective efficacy. Science, 277, 918–924.

    Article  Google Scholar 

  • Shaw, J. W. (1995). Community policing against guns: Public opinion of the Kansas City Gun Experiment. Justice Quarterly, 12, 695–710.

    Article  Google Scholar 

  • Sherman, L. W., & Rogan, D. P. (1995). Effects of gun seizures on gun violence: “Hot spots” patrol in Kansas City. Justice Quarterly, 12, 673–693.

    Article  Google Scholar 

  • Sherman, L. W., & Weisburd, D. (1995). General deterrent effects of police patrol in crime “hot-spots”: A randomized controlled trial. Justice Quarterly, 12, 755–782.

    Article  Google Scholar 

  • Sherman, L. W., Gartin, P. R., & Buerger, M. E. (1989). Hot spots of predatory crime: Routine activities and the criminology of place. Criminology, 27, 27–56.

    Article  Google Scholar 

  • Silver, E. (2000). Extending social disorganization theory: A multilevel approach to the study of violence among persons with mental illnesses. Criminology, 39, 1043–1074.

    Article  Google Scholar 

  • Skogan, W. G. (1990). Disorder and decline: Crime and the spiral of decline in American neighborhoods. New York: Free Press.

    Google Scholar 

  • Smith, W., Frazee, S., & Davidson, E. (2000). Furthering the integration of routine activity and social disorganization theories: Small units of analysis and the study of street robbery as a diffusion process. Criminology, 38, 489–524.

    Article  Google Scholar 

  • Spelman, W., & Brown, D. (1984). Calling the Police: Citizen reporting of serious crime. Washington: Government Printing Office.

    Google Scholar 

  • St. Jean, P. K. B. (2007). Pockets of crime: Broken windows, collective efficacy, and the criminal point of view. Chicago: The University of Chicago Press.

    Google Scholar 

  • Taylor, R. B. (1997). Social order and disorder of street blocks and neighborhoods: Ecology, microecology, and the systemic model of social disorganization. Journal of Research in Crime and Delinquency, 34, 113–155.

    Article  Google Scholar 

  • Tyler, T. R. (1990). Why people obey the law. New Haven: Yale University Press.

    Google Scholar 

  • Tyler, T. R. (2004). Enhancing police legitimacy. Annals of the American Academy of Political and Social Sciences, 593, 84–99.

    Article  Google Scholar 

  • U.S. Census Bureau (2000). United States Census 2000. Retrieved from http://www.census.gov/main/www/cen2000.html

  • Weisburd, D. (2004). The emergence of crime place in crime prevention. In G. Bruinsma, H. Elffers, & J. Keijser (Eds.), Punishment, places and perpetrators: Developments in criminological and criminal justice research (pp. 155–168). Cullompton: Willan.

    Google Scholar 

  • Weisburd, D., & Braga, A. A. (2003). Hot spots policing. In H. Kury & J. Obergfell-Fuchs (Eds.), Crime prevention: New approaches (pp. 337–354). Mainz: Weisser Ring.

    Google Scholar 

  • Weisburd, D., & Eck, J. E. (2004). What can police do to reduce crime, disorder and fear. The Annals of the American Academy of Political and Social Science, 593, 42–65.

    Article  Google Scholar 

  • Weisburd, D., & Green, L. (1995). Policing drug hotspots: The Jersey City drug market analysis experiment. Justice Quarterly, 12, 711–735.

    Article  Google Scholar 

  • Weisburd, D., & Lum, C. (2005). The diffusion of computerized crime mapping in policing: Linking research and practice. Police Practice and Research, 6, 419–434.

    Article  Google Scholar 

  • Weisburd, D., Petrosino, A., & Mason, G. (1993). Design sensitivity in criminal justice experiments. In M. Tonry (Ed.), Crime and Justice: A Review of Research (Vol. 17). Chicago: University of Chicago Press.

    Google Scholar 

  • Weisburd, D., Bushway, S., Lum, C., & Yang, S. (2004). Trajectories of crime and places: A longitudinal study of street segments in the city of Seattle. Criminology, 42, 283–321.

    Article  Google Scholar 

  • Weisburd, D., Wyckoff, L. A., Ready, J., Eck, J. E., Hinkle, J. C., & Gajewski, F. (2004). Does crime just move around the corner? A study of displacement and diffusion in Jersey City, NJ. Washington: National Institute of Justice.

    Google Scholar 

  • Weisburd, D., Wyckoff, L. A., Ready, J., Eck, J. E., Hinkle, J. C., & Gajewski, F. (2006). Does crime just move around the corner? A controlled study of spatial displacement and diffusion of crime control benefits. Criminology, 44, 549–592.

    Article  Google Scholar 

  • Weisburd, D., Groff, E. R., & Yang, S. (Forthcoming). The Criminology of Place: Street Segments and Our Understanding of the Crime Problem. Oxford: Oxford University Press (in press)

  • Weisburd, D., Hinkle, J. C., Famega, C., & Ready, J. (2011). Legitimacy, fear and collective efficacy in crime hot spots: assessing the impacts of broken windows policing strategies on citizen attitudes. Final Report. Washington, DC: National Institute of Justice (in press)

  • Wilson, J. Q., & Kelling, G. L. (1982). Broken windows: The police and neighborhood safety. Atlantic Monthly, 211, 29–38.

    Google Scholar 

  • Wyant, B. R. (2008). Multilevel impacts of perceived incivilities and perceptions of crime risk on fear of crime: Isolating endogenous impacts. Journal of Research in Crime and Delinquency, 45, 29–64.

    Article  Google Scholar 

  • Xu, Y., Fiedler, M. L., & Flaming, K. H. (2005). Discovering the impact of community policing: The broken windows thesis, collective efficacy and citizens’ judgment. Journal of Research in Crime and Delinquency, 42, 147–186.

    Article  Google Scholar 

Download references

Acknowledgements

This research was supported by grant no. 2007-91116-MD-IJ from the National Institute of Justice. The authors would like to thank Chief Jim Bueerman of the Redlands Police Department, Chief Jim Doyle of the Ontario Police Department and Chief Bob Miller of the Colton Police Department for their willingness to participate in an experimental study, and for their support throughout the project. Appreciation is also due to a number of graduate students who assisted with the project: Jill Christie for her tireless work supervising the survey data collection and data entry; Julie Willis for her invaluable assistance with data cleaning and geocoding; and Cody Telep, Dave McClure and Breanne Cave for their valuable comments on, and edits to, early drafts of this manuscript. Finally, thanks are also due to the anonymous peer reviewers for their helpful feedback.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to David Weisburd.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Weisburd, D., Hinkle, J.C., Famega, C. et al. The possible “backfire” effects of hot spots policing: an experimental assessment of impacts on legitimacy, fear and collective efficacy. J Exp Criminol 7, 297–320 (2011). https://doi.org/10.1007/s11292-011-9130-z

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11292-011-9130-z

Keywords

Navigation