Advertisement

Dependable Outlier Detection in Harsh Environments Monitoring Systems

  • Gonçalo Jesus
  • António CasimiroEmail author
  • Anabela Oliveira
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11094)

Abstract

Environmental monitoring systems are composed by sensor networks deployed in uncertain and harsh conditions, vulnerable to external disturbances, posing challenges to the comprehensive system characterization and modelling. When unexpected sensor measurements are produced, there is a need to detect and identify, in a timely manner, if they stem from a failure behavior or if they indeed represent some environment-related process. Existing solutions for fault detection in environmental sensor networks do not portray the required sensitivity for the differentiation of these processes or they are unable to meet the time constraints of the affected cyber-physical systems.

We have been developing a framework for dependable detection of failures in harsh environments monitoring systems, aiming to improve the overall sensor data quality. Herein we present the application of an early framework implementation to an aquatic sensor network dataset, using neural networks to model sensors’ behaviors, correlated data between neighbor sensors, and a statistical technique to detect the presence of outliers in the datasets.

Keywords

Dependability Data quality Outlier detection Machine learning Neural networks Water monitoring 

Notes

Acknowledgements

The authors thank António Baptista and the CMOP SATURN team for their support in the Columbia river analysis. This work was partially supported by the FCT, through the LASIGE Research Unit, Ref. UID/CEC/00408/2013, PhD Grant SFRH/BD/82489/2011 and by H2020 WADI—EC Grant Agreement No. 689239.

References

  1. 1.
    Zhang, Y., Meratnia, N., Havinga, P.: Outlier detection techniques for wireless sensor networks: a survey. IEEE Commun. Surv. Tutor. 12(2), 159–170 (2010)CrossRefGoogle Scholar
  2. 2.
    Zimek, A., Schubert, E., Kriegel, H.P.: A survey on unsupervised outlier detection in high-dimensional numerical data. Stat. Anal. Data Mining ASA Data Sci. J. 5(5), 363–387 (2012)MathSciNetCrossRefGoogle Scholar
  3. 3.
    Gupta, M., Gao, J., Aggarwal, C.C., Han, J.: Outlier detection for temporal data: a survey. IEEE Trans. Knowl. Data Eng. 26(9), 2250–2267 (2014)CrossRefGoogle Scholar
  4. 4.
    Jesus, G., Casimiro, A., Oliveira, A.: A survey on data quality for dependable monitoring in wireless sensor networks. Sensors 17(9) (2017)Google Scholar
  5. 5.
    Jesus, G., Oliveira, A., Azevedo, A., Casimiro, A.: Improving sensor-fusion with environmental models. In: 2015 IEEE SENSORS, pp. 1–4 (2015)Google Scholar
  6. 6.
    Jesus, G., Casimiro, A., Oliveira, A.: Using machine learning for dependable outlier detection in environmental monitoring systems (submitted)Google Scholar
  7. 7.
    Baptista, A., Howe, B., Freire, J., Maier, D., Silva, C.T.: Scientific exploration in the era of ocean observatories. Comput. Sci. Eng. 10(3), 53–58 (2008)CrossRefGoogle Scholar
  8. 8.
    Pugh, D.T.: Tides, surges and mean sea-level (reprinted with corrections). John Wiley & Sons Ltd., Chichester (1996)Google Scholar

Copyright information

© Springer Nature Switzerland AG 2018

Authors and Affiliations

  1. 1.Hydraulics and Environment DepartmentLNECLisbonPortugal
  2. 2.LASIGE, Faculdade de CiênciasUniversidade de LisboaLisbonPortugal

Personalised recommendations