Benchmarking Internet of Things Deployment: Frameworks, Best Practices, and Experiences

  • Franck Le GallEmail author
  • Sophie Vallet Chevillard
  • Alex Gluhak
  • Nils Walravens
  • Zhang Xueli
  • Hend Ben Hadji
Part of the Modeling and Optimization in Science and Technologies book series (MOST, volume 4)


IoT deployments generate data of the real world in an automated fashion without direct user involvement. With increasing scale of these IoT deployments the extraction of the right knowledge about the real world from a vast amount of IoT data and efficient decisions is a challenging endeavor. While solutions to deal with large amounts of IoT data are slowly emerging, potential users of IoT solutions, or policy makers find it difficult to assess the actual usefulness of investing in IoT deployments or selecting adequate deployment strategies for a particular business domain.

Despite the recent hype generated by consultancy companies and IoT vendors about the IoT, there is still a lack of experience in assessing the utility and benefits of IoT deployments as many IoT deployments are still in their early stages. In order to capture such experience quicker and derive best practices for IoT deployments, systematic tools, or methodologies are required in order to allow the assessment of the goodness or usefulness of IoT deployments and a comparison between emerging IoT deployments to be performed.

This chapter addresses the existing gap and proposes a novel benchmarking framework for IoT deployments. The proposed framework is complementary to the emerging tools for the analysis of big data as it allows various stakeholders to develop a deeper understanding of the surrounding IoT business ecosystem in a respective problem domain and the value proposition that the deployment of an IoT infrastructure may bring. It also allows a better decision making for policy makers for regulatory frameworks.


Business Model Smart Grid Smart City Business Ecosystem Smart Service 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    MacGillivray, C., Turner, V., Lund, D.: Worldwide Internet of Things (IoT) 2013–2020 Forecast: Billions of Things, Trillions of Dollars, Gartnet Market Analysis (2013)Google Scholar
  2. 2.
    Smith, I.G. (ed.): The Internet of Things 2012, New Horizons (2012) IERC, Casagras2, ISBN 978-0-9553707-9-3Google Scholar
  3. 3.
    Gauthier, P., Gonzales, L.: L’Internet des Objets... Internet, mais en mieux (2011) ISBN 978-2-12-465316-4Google Scholar
  4. 4.
    Rifkin, J.: The Third Industrial Revolution: How Lateral Power Is Trans-forming Energy, the Economy, and the World (2009) ISBN 978-0230115217Google Scholar
  5. 5.
    Patton, M.Q.: Utilization-Focused Evaluation. Sage, ISBN 978-1-4129-5861-5Google Scholar
  6. 6.
    European Commission, MEANS Collection - Evaluation of socio-economic programmes (1999) ISBN 92-828-6626-2 CX-10-99-000-EN-CGoogle Scholar
  7. 7.
    Mazhelis, O., Warma, H., Leminen, S., Ahokangas, P., Pussinen, P., Rajahonka, M., Siuruainen, R., Okkonen, H., Shveykovskiy, A., Myllykoski, J.: Internet-of-Things Market, Value Networks, and Business Models: State of the Art Report, ch. 2 (2013) ISBN 978-951-39-5249-5Google Scholar
  8. 8.
    Hawkins, R.: The Business Model as a Research Problem in Electronic Commerce, Socio-economic Trends Assessment for the digital Revolution (STAR), IST project, Issue Report No. 4, SPRU – Science and Technology Policy Research, Brighton (2001)Google Scholar
  9. 9.
    Linder, J.C., Cantrell, S.: Changing Business Models: Surveying the Landscape. Institute for Strategic Change, Accenture, New York (2000)Google Scholar
  10. 10.
    Faber, E., Ballon, P., Bouwman, H., Haaker, T., Rietkerk, O., Steen, M.: Designing business models for mobile ICT services. In: Proceedings of 16th Bled E-Commerce Conference, Bled, Slovenia (2003)Google Scholar
  11. 11.
    Pigneur, Y.: An ontology for m-business models. In: Spaccapietra, S., March, S.T., Kambayashi, Y. (eds.) ER 2002. LNCS, vol. 2503, pp. 3–6. Springer, Heidelberg (2002)CrossRefGoogle Scholar
  12. 12.
    Osterwalder, A.: The business model ontology: a proposition in a design science approach. PhD thesis, HEC Lausanne, Lausanne (2004)Google Scholar
  13. 13.
    Gordijn, J., Akkermans, J.M.: E3-value: design and evaluation of e-business models. IEEE Intelligent Systems 16(4), special issue on E-business, 11–17 (2001)Google Scholar
  14. 14.
    Ballon, P.: Control and Value in Mobile Communications: A Political Economy of the Reconfiguration of Business Models in the European Mobile Industry. PhD thesis, Department of Communications, Vrije Universiteit Brussel (2009),
  15. 15.
    Vallet Chevillard, S., Le Gall, F., Zhang, X., Gluhak, A., Marao, G., Amazonas, J.R.: Benchmarking framework for IoT deployment evaluation, Project Deliverable (2013)Google Scholar
  16. 16.
    Margolis, J.: Benefits, External Economies, and the Justification of Public Investment. The Review of Economics and Statistics 39(3), 284–291 (1957), CrossRefGoogle Scholar
  17. 17.
    Bovaird, T.: Public-private Partnerships: From Contested Concepts to Prevalent Practice. International Review of Administrative Sciences 70(2), 199–215 (2004)CrossRefGoogle Scholar
  18. 18.
    Bovaird, T.: Developing New Forms of Partnership With the ‘Market’ in the Procurement of Public Services. Public Administration 84(1), 81–102 (2006)CrossRefGoogle Scholar
  19. 19.
    Moore, M.: Creating Public Value: Strategic Management in Government. Harvard University Press (1995)Google Scholar
  20. 20.
    Talbot, C.: Measuring Public Value: A Competing Values Approach. The Work Foundation Research Report (2008),
  21. 21.
    Benington, J.: From Private Choice to Public Value? In: Benington, J., Moore, M. (eds.) Public Value: Theory and Practice, pp. 31–39. Palgrave MacMillan (2011)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2015

Authors and Affiliations

  • Franck Le Gall
    • 1
    Email author
  • Sophie Vallet Chevillard
    • 2
  • Alex Gluhak
    • 3
  • Nils Walravens
    • 4
  • Zhang Xueli
    • 5
  • Hend Ben Hadji
    • 6
  1. 1.Easy Global Market, Business PôleSophia Antipolis CedexFrance
  2. 2.Inno TSDSophia-AntipolisFrance
  3. 3.University of SurreyGuildfordUnited Kingdom
  4. 4.iMinds-SMIT, Vrije Universiteit BrusselVrije Universiteit BrusselElseneBelgium
  5. 5.Chinese Academy of Telecom ResearchBeijingChina
  6. 6.Centre d’Etudes et des Recherches des TélécommunicationsParc TechnologiqueEL GHAZALA ARIANATunisia

Personalised recommendations