Skip to main content
SpringerLink
Log in
Book cover

Research Conference on Metadata and Semantics Research

MTSR 2019: Metadata and Semantic Research pp 272–283Cite as

Create Dashboards and Data Story with the Data & Analytics Frameworks

  • Conference paper
  • First Online:

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 1057))

Abstract

In recent years, many data visualization tools have appeared on the market that can potentially guarantee citizens and users of the Public Administration (PA) the ability to create dashboards and data stories with just a few clicks, using open and unopened data from the PA. The Data Analytics Framework (DAF), a project of the Italian government launched at the end of 2017 and currently being tested, has the goal to improve and simplify the interoperability and exchange of data between Public Administrations, thanks to its big data platform and the integrated use of data visualization tools and semantic technologies. The DAF also has the objective of facilitating data analysis, improving the management of Open Data and facilitating the spread of linked open data (LOD) thanks to the integration of OntoPiA, a network of controlled vocabularies and ontologies, such as “IoT Events”, an ontology for representing and modelling the knowledge within the domain of the Internet of Things. This paper contributes to the enhancement of the project by introducing a case study created by the author, concerns tourism of Sardinia (a region of Italy). The case study follows a process in the DAF in 5 steps, starting from selection of the dataset to the creation phase of the real dashboard through Apache Superset (a business intelligence tool) and the related data story. This case study is one of the few demonstrations of use on a real case of DAF and highlights the ability of this national platform to transform the analysis of a large amount of data into simple visual representations with clear and effective language.

This is a preview of subscription content, log in via an institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Notes

  1. 1.

    The science of visual representation of ‘data’, which has been abstracted in some schematic form, including attributes or variables for the units of information.

  2. 2.

    Open Government Data. http://www.oecd.org/gov/digital-government/open-government-data.htm.

  3. 3.

    Lightweight Directory Access Protocol. http://foldoc.org/ldap.

  4. 4.

    Superset Github repository. https://github.com/apache/incubator-superset.

  5. 5.

    https://superset.incubator.apache.org/sqllab.html.

  6. 6.

    https://www.docker.com/resources/what-container.

  7. 7.

    Data stories are an extension of the dashboards, which allow you to express what you can see from the views.

  8. 8.

    https://lg-patrimonio-pubblico.readthedocs.io.

  9. 9.

    https://superset.incubator.apache.org/gallery.html#visualizations-gallery.

  10. 10.

    Contest dedicated to open data, promoted by the Sardinia Region and held in the period from 16/10/2017 to 21/01/2018. http://contest.formez.it/.

  11. 11.

    The complete dashboard is accessible online at http://bit.ly/storia-turismo-sardo-story.

References

  1. AgID Advance digital transformation. https://avanzamentodigitale.italia.it/it/progetto/open-data. Accessed 10 Aug 2019

  2. Temiz, S., Brown, T.: Open data project for e-government: case study of Stockholm open data project. Int. J. Electron. Gov. 9, 55 (2017). https://doi.org/10.1504/IJEG.2017.10005479

  3. Drakopoulou, S.: Open data today and tomorrow: the present challenges and possibilities of open data. Int. J. Electron. Gov. 10, 157 (2018). https://doi.org/10.1504/IJEG.2018.10015213

  4. Team Transformation D GitHub - italia/daf: Data & Analytics Framework (DAF). https://github.com/italia/daf. Accessed 10 Sept 2018

  5. Digital Transformation Team (2019). https://teamdigitale.governo.it. Accessed 1 Jun 2018

  6. HDFS Architecture Guide. https://hadoop.apache.org/docs/r1.2.1/hdfs_design.html. Accessed 12 Sept 2018

  7. Desouza, K.C., Jacob, B.: Big Data in the Public Sector: Lessons for Practitioners and Scholars. Adm. Soc. (2017). https://doi.org/10.1177/0095399714555751

  8. Gomes, E., Foschini, L., Dias, J., et al.: An infrastructure model for smart cities based on big data. Int. J. Grid Util. Comput. 9, 322 (2018). https://doi.org/10.1504/IJGUC.2018.10016122

  9. European Interoperability Framework (EIF). https://ec.europa.eu/isa2/eif_en. Accessed 10 Dec 2018

  10. Agid & Team Digitale (2018) OntoPia. https://github.com/italia/daf-ontologie-vocabolari-controllati. Accessed 10 Nov 2018

  11. Apache Superset. https://superset.incubator.apache.org. Accessed 19 Aug 2018

  12. Sabotta, C.: Introducing Microsoft BI Reporting and Analysis Tools. In: Microsoft (2015). http://msdn.microsoft.com/en-us/library/d0e16108-7123-4788-87b3-05db962dbc94

  13. Tableau. Free Data Visualization Software. Tableau Public (2011)

    Google Scholar 

  14. Google Data Studio. https://datastudio.google.com/. Accessed 15 Sept 2018

  15. Plotly. Modern Visualization for the Data Era – Plotly (2017). https://plot.ly/

  16. MySql. https://www.mysql.com/i. Accessed 15 Sept 2018

  17. PostgreSQL. PostgreSQL: The world’s most advanced open source database (2014). http://www.postgresql.org/. http://www.postgresql.org/

  18. Metabase. https://www.metabase.com/. Accessed 16 Sept 2018

  19. Redash. https://github.com/getredash/redash. Accessed 15 Sept 2018

  20. Graves, A., Hendler, J.: Visualization tools for open government data. In: Proceedings of the 14th Annual International Conference on Digital Government Research - dg.o 2013, p. 136 (2013)

    Google Scholar 

  21. Ronacher A Flask MicroFramework. http://flask.pocoo.org/. Accessed 10 Sept 2018

  22. Python. https://www.python.org/. Accessed 15 Sept 2018

  23. NVD3 Project. http://nvd3.org/. Accessed 15 Sept 2018

  24. van Dierendonck, R., van Tienhoven, S., Elid, T.: D3.JS: Data-Driven Documents (2015)

    Google Scholar 

  25. Team Transformation D Data & Analytics Framework (DAF) - Developer Documentation. https://daf-docs.readthedocs.io/. Accessed 15 Sept 2018

  26. DAF - Public Dataportal. https://dataportal.daf.teamdigitale.it. Accessed 5 Jan 2019

  27. DAF Private Dataportal. https://dataportal.daf.teamdigitale.it/#/login. Accessed 5 Jan 2019

  28. Kong. https://konghq.com/. Accessed 15 Sept 2018

  29. Apache Software Foundation, Apache Superset Contributors. Apache Superset — Apache Superset documentation (2018). https://superset.incubator.apache.org/

  30. Jupyter Project. Project Jupyter | Project (2016). http://jupyter.org/about.html

  31. CKAN (2018). https://github.com/ckan/ckan. Accessed 12 Sept 2018

  32. Redis. https://redis.io. Accessed 15 Sept 2018

  33. FreeIPA LDAP. https://www.freeipa.org/. Accessed 19 Sept 2018

  34. StumbleUpon. OpenTSDB - A Distributed, Scalable Monitoring System (2012)

    Google Scholar 

  35. Apache Livy. https://livy.incubator.apache.org/. Accessed 19 Sept 2018

  36. The Apache Software Foundation. Apache NiFi (2017)

    Google Scholar 

  37. Apache hadoop. https://hadoop.apache.org/. Accessed 3 Feb 2018

  38. Apache HBase (2015). https://hbase.apache.org/. Accessed 12 Sept 2018

  39. Apache Kudu. https://kudu.apache.org/. Accessed 11 Sept 2018

  40. Fallucchi, F., Petito, M., De Luca, E.W.: Analysing and visualising open data within the data and analytics framework. In: Garoufallou, E., Sartori, F., Siatri, R., Zervas, M. (eds.) MTSR 2018. CCIS, vol. 846, pp. 135–146. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-14401-2_13

    Chapter  Google Scholar 

  41. (SEMIC) SIC Core Vocabularies. https://joinup.ec.europa.eu/collection/semantic-interoperability-community-semic/core-vocabularies. Accessed 1 Dec 2018

  42. Fayyad, U., Piatetsky-Shapiro, G., Smyth, P.: The KDD process for extracting useful knowledge from volumes of data. Commun. ACM (1996). https://doi.org/10.1145/240455.240464

  43. ISO/IEC ISO/IEC 25024:2015 Systems and software engineering — Systems and software Quality Requirements and Evaluation (SQuaRE) — Measurement of data quality. Int. Stand. ISO/IEC 250242015. https://www.iso.org/obp/ui/#iso:std:iso-iec:25024:ed-1:v1:en. Accessed 14 Sept 2018

  44. Sriparasa, S.S.: JavaScript and JSON Essentials (2013)

    Google Scholar 

  45. Apache Impala. https://impala.apache.org/. Accessed 15 Sept 2018

  46. SQLite. https://www.sqlite.org/. Accessed 15 Sept 2018

  47. Ansa. Turismo: 2,9mln arrivi in Sardegna 2016 (2018). http://bit.ly/AnsaTurismo2016. Accessed 15 Dec 2018

Download references

Author information

Authors and Affiliations

  1. DIII, Guglielmo Marconi University, Rome, Italy

    Francesca Fallucchi & Ernesto William De Luca

  2. DIFI, Georg Eckert Institute, Brunswick, Germany

    Francesca Fallucchi & Ernesto William De Luca

  3. Università di Pisa, Pisa, Italy

    Petito Michele

  4. Guglielmo Marconi University, Rome, Italy

    Petito Michele

Authors
  1. Petito Michele
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Francesca Fallucchi
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Ernesto William De Luca
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Francesca Fallucchi .

Editor information

Editors and Affiliations

  1. International Hellenic University, Thessaloniki, Greece

    Emmanouel Garoufallou

  2. Guglielmo Marconi University, Rome, Italy

    Francesca Fallucchi

  3. Georg Eckert Institute – Leibniz Institute for International Textbook Research, Braunschweig, Germany

    Ernesto William De Luca

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Michele, P., Fallucchi, F., De Luca, E.W. (2019). Create Dashboards and Data Story with the Data & Analytics Frameworks. In: Garoufallou, E., Fallucchi, F., William De Luca, E. (eds) Metadata and Semantic Research. MTSR 2019. Communications in Computer and Information Science, vol 1057. Springer, Cham. https://doi.org/10.1007/978-3-030-36599-8_24

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-36599-8_24

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-36598-1

  • Online ISBN: 978-3-030-36599-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation