The Private Sector and Content Regulation: The Margin of Permissible Expression

  • Ben Wagner
Part of the Law, Governance and Technology Series book series (LGTS, volume 28)


This chapter focuses on private sector models of content regulation. It argues that the legal need and external pressure for content regulation creates a demand for norm-creation within many Internet companies. Particularly, as Internet companies operate in many international jurisdictions with frequently conflicting legal norms, companies are constantly responding to multiple regulatory demands. In order to explore this logic in greater detail, three cases were selected as they demonstrate crucial cases in the evolution of the private sector model of Internet content regulation: AOL, Google & Facebook.


Child Sexual Abuse Online Service Content Regulation Probabilistic Algorithm Hate Speech 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. AOL. 2003. AOL community policies. Retrieved February 9, 2012
  2. Banks, J. 2010. Regulating hate speech online. International Review of Law, Computers and Technology. 24(3): 233–239.CrossRefGoogle Scholar
  3. Barzilai-Nahon, Karine. 2008. Toward a theory of network gatekeeping: A framework for exploring information control. Journal of the American Society for Information Science and Technology 59(9): 1493–1512.CrossRefGoogle Scholar
  4. Bennett, Brian. 2010. YouTube is letting users decide on terrorism-related videos. Los Angeles Times. Retrieved February 11, 2012
  5. Bethge, Philip. 2012. Fischer Im Datenozean. DER SPIEGEL. Retrieved February 13, 2012
  6. Birnhack, Michael, and Niva Elkin-Koren. 2003. The invisible handshake: The reemergence of the state in the digital environment. Virginia Journal of Law and Technology 8: 6.Google Scholar
  7. Blumberg, Rae Lesser. 1984. A general theory of gender stratification. Sociological Theory 2: 23–101.CrossRefGoogle Scholar
  8. Boli, John, and George M. Thomas. 1997. World culture in the world polity: A century of international non-governmental organization. American Sociological Review 62(2): 171–190.CrossRefGoogle Scholar
  9. Bosavage, Jennifer. 2006. The rise and fall (And Rise?) of AOL. Informationweek. Retrieved February 9, 2012
  10. Boyd, Danah M., and Nicole B. Ellison. 2008. Social network sites: Definition, history, and scholarship, ed. Danah M Boyd and Nicole B Ellison. Journal of Computer-Mediated Communication 13(1): 210–230.Google Scholar
  11. Boyd, Danah, Eszter Hargittai, Jason Schultz, and John Palfrey. 2011. Why parents help their children lie to Facebook about age: Unintended consequences of the ‘Children’s online privacy protection act’. First Monday 16(11).Google Scholar
  12. Cafaggi, Fabrizio. 2011. New foundations of transnational private regulation. Journal of Law and Society 38(1): 20–49.CrossRefGoogle Scholar
  13. Carr, Nicholas. 2008. The big switch: Rewiring the world, from Edison to Google, 1st ed. New York: W.W. Norton & Co.Google Scholar
  14. Chen, Yun, Flora S. Tsai, and Kap Luk Chan. 2008. Machine learning techniques for business blog search and mining. Expert Systems with Applications 35(3): 581–590.CrossRefGoogle Scholar
  15. Cleverdon, Cyril W. 1972. On the inverse relationship of recall and precision. Journal of Documentation 28(3): 195–201.CrossRefGoogle Scholar
  16. de Groat, Greta. 2002. Perspectives on the Web and Google. Journal of Internet Cataloging 5(1): 17–28.Google Scholar
  17. Enders, A., H. Hungenberg, H.P. Denker, and S. Mauch. 2008. The long tail of social networking. Revenue models of social networking sites. European Management Journal 26(3): 199–211.CrossRefGoogle Scholar
  18. Erica, Newland, Caroline Nolan, Cynthia Wong, and Jillian C. York. 2011. Account deactivation and content removal: Guiding principles and practices for companies and users. Boston.Google Scholar
  19. Frynas, J.G., Kamel Mellahi, and G.A. Pigman. 2006. First mover advantages in international business and firm-specific political resources. Strategic Management Journal 27(4): 321–345.CrossRefGoogle Scholar
  20. Greenstein, Shane. 2002. The evolving structure of commercial internet markets. In Understanding the digital economy: Data, tools, and research, ed. Erik Brynjolfsson and Brian Kahin. Cambridge: MIT Press.Google Scholar
  21. Hazlett, Thomas, and David W. Sosa. 1997. Chilling the Internet?: Lessons from FCC regulation of radio broadcasting, Policy ana. Washington, DC: Cato Institute.Google Scholar
  22. Helft, Miguel. 2010. Facebook wrestles with free speech and civility. New York Times. Retrieved February 19, 2011
  23. Hoboken, JVJ van. 2012. Search engine freedom: On the implications of the right to freedom of expression for the legal governance of web search engines. University of Amsterdam (UvA).Google Scholar
  24. Kierkegaard, Sylvia. 2011. To block or not to block – European child porno law in question. Computer Law and Security Review 27(6): 573–584.CrossRefGoogle Scholar
  25. Kiss, Jemima. 2012. Facebook hits 1 Billion users a month. The Guardian. Retrieved October 8, 2012
  26. Knox, Richard A. 1995. Women go on line to Decry Ban on ‘breast’. Boston Globe, December 1.Google Scholar
  27. Labovitz, Craig. 2010. How big is Google? Arbor Networks Security Blog. Retrieved February 9, 2012
  28. Lessig, Lawrence. 1999. Code and other laws of cyberspace. New York: Basic Books.Google Scholar
  29. Levin, Josh. 2012. Facebook’s IPO filing reveals how Zuckerberg and his employees talk. Slate Magazine. Retrieved February 11, 2012
  30. MacKinnon, Rebecca. 2012. Consent of the networked: The world-wide struggle for internet freedom. New York: Basic Books.Google Scholar
  31. Marsden, Christopher T. 2008. Beyond Europe: The internet, regulation, and multistakeholder governance – Representing the consumer interest? Journal of Consumer Policy 31(1): 115–132.CrossRefGoogle Scholar
  32. McCracken, Harry. 2010. A history of AOL, as told in its own old press releases. Technologizer. Retrieved February 9, 2012
  33. McIntyre, T.J. 2012. Child abuse images and cleanfeeds: Assessing internet blocking systems. In Research handbook on governance of the internet, ed. Ian Brown. Cheltenham: Edward Elgar.Google Scholar
  34. Mueller, Philipp. 2011. Offene Staatskunst – Strategie Für Eine Vernetzte Welt. In Arbeitskreis Internet Governance. Munich, Germany: Münchner Centrum für Governance-Forschung (MCG).Google Scholar
  35. Osborne, David, and Ted Gaebler. 1992. Reinventing government: How the entrepreneurial spirit is transforming the public sector. New York: Plume Book.Google Scholar
  36. Phillips, Sarah. 2007. A brief history of Facebook | Technology | The Guardian. The Guardian. Retrieved February 11, 2012
  37. Pollock, Rufus. 2009. Is Google the next Microsoft?: Competition, welfare and regulation in internet search. Cambridge: University of Cambridge Faculty of Economics.Google Scholar
  38. Raghavan, Vijay, Peter Bollmann, and Gwang S. Jung. 1989. A critical investigation of recall and precision as measures of retrieval system performance. ACM Transactions on Information Systems 7(3): 205–229.CrossRefGoogle Scholar
  39. Rappa, M. 2004. The utility business model and the future of computing services. IBM Systems Journal 43(1): 32–42.CrossRefGoogle Scholar
  40. Rheingold, Howard. 2000. The virtual community: Homesteading on the electronic frontier. Cambridge, MA: MIT Press.Google Scholar
  41. Robert, Hof. 2012. Poof! $1 Billion slashed from 2012 Facebook revenue forecast – Forbes. Forbes. Retrieved October 8, 2012
  42. Rosen, Jeffrey. 2013. Free speech on the internet: Silicon Valley is making the rules. New Republic. Retrieved May 9, 2013 Scholar
  43. Ruder, Thomas, Gary M. Hatch, Garyfalia Ampanozi, Michael J. Thali, and Nadja Fischer. 2011. Suicide announcement on Facebook. Crisis: The Journal of Crisis Intervention and Suicide Prevention 32(5): 280–282.CrossRefGoogle Scholar
  44. Soghoian, Christopher. 2010. An end to privacy theater: Exposing and discouraging corporate disclosure of user data to the government. Minnesota Journal of Law, Science & Technology, Forthcoming. 12(1): 191.Google Scholar
  45. Sunstein, Cass. 2007. 2.0. Princeton: Princeton University Press.Google Scholar
  46. Swisher, Kara. 1998. AOL.COM: How Steve case beat Bill Gates, nailed the netheads, and made millions in the war for the Web, 1st ed. New York: Times Books.Google Scholar
  47. Tambini, Damian, Danilo Leonardi, and Christopher T. Marsden. 2008. Codifying cyberspace : Communications self-regulation in the age of internet convergence. London/New York: Routledge.Google Scholar
  48. Turner, Fred. 2010. From counterculture to cyberculture: Stewart Brand, the whole earth network, and the rise of digital utopianism. Chicago: University of Chicago Press.Google Scholar
  49. Vasile, James. 2011. Presentation of the FreedomBox. In Elevate 2011 – Music, Arts and Political Discourse. Graz, Austria: Verein zur Förderung des gesellschaftspolitischen und kulturellen Austausches.Google Scholar
  50. Waddington, P. 1994. Liberty and order: Public order policing in a capital city. London: UCL Press.Google Scholar
  51. Wagner, Ben. 2012. Push-button-autocracy in Tunisia: Analysing the role of internet infrastructure, institutions and international markets in creating a Tunisian censorship regime. Telecommunications Policy 36(6): 484–492.CrossRefGoogle Scholar
  52. Webster, Stephen C. 2012. Low-Wage Facebook contractor leaks secret censorship list | the raw story. Retrieved October 8, 2012
  53. Williams, Christopher. 2009. Facebook battles attack by child protection chief. The Register. Retrieved February 10, 2012
  54. Wu, Tim. 2010. The master switch: The rise and fall of information empires, 1st ed. New York: Knopf.Google Scholar
  55. York, Jillian C. 2010. Policing content in the quasi-public sphere. Boston: Open Net Initiative Bulletin. Berkman Center. Harvard University.Google Scholar

Copyright information

© Springer International Publishing Switzerland 2016

Authors and Affiliations

  • Ben Wagner
    • 1
  1. 1.Centre for Internet & Human RightsEuropean University ViadrinaFrankfurtGermany

Personalised recommendations