Skip to main content
SpringerLink
Log in

Automatic Thresholding for Sensor Data Gap Detection Using Statistical Approach

  • Conference paper
  • First Online:
Book cover Sustainability in Energy and Buildings

Part of the book series: Smart Innovation, Systems and Technologies ((SIST,volume 163))

  • 1222 Accesses

Abstract

Sensors are currently being used for applications in buildings. In sensor grids, a significant amount of sensor data may be lost. This paper tackles the issue of unreliable sensors in buildings. The common sensor faults known in the literature are bias and outliers. Occurrences of data gaps have not been given adequate attention in the research literature. A methodology based on statistical approach allows the automatic thresholding for data gap detection, i.e., abnormalities on the delay for a set of heterogeneous sensors in instrumented buildings. The efficiency of the method is evaluated on measurements obtained from a real building: an office at Grenoble Institute of technology with a large number of sensors.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 219.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Teixeira, A.M., Araújo, J., Sandberg, H., Johansson, K.H.: Distributed sensor and actuator reconfiguration for fault-tolerant networked control systems. IEEE Trans. Control Netw. Syst. 5(4), 1517–1528 (2018)

    Article  MathSciNet  Google Scholar 

  2. Shi, L., Cheng, P., Chen, J.: Sensor data scheduling for optimal state estimation with communication energy constraint. Automatica 47(8), 1693–1698 (2011)

    Article  MathSciNet  Google Scholar 

  3. Wang, X., Wang, Z., Xu, Z., Cheng, M., Wang, W., Hu, Y.: Comprehensive diagnosis and tolerance strategies for electrical faults and sensor faults in dual three-phase PMSM drives. IEEE Trans. Power Electron. (2018)

    Google Scholar 

  4. Li, X., Huang, D., Sun, Z.: A routing protocol for balancing energy consumption in heterogeneous wireless sensor networks. In: International Conference on Mobile Ad-Hoc and Sensor Networks (pp. 79–88). Springer, Berlin (2007)

    Google Scholar 

  5. Ni, K., Ramanathan, N., Chehade, M.N.H., Balzano, L., Nair, S., Zahedi, S., et al.: Sensor network data fault types. ACM Trans. Sens. Netw. (TOSN) 5(3), 25 (2009)

    Article  Google Scholar 

  6. Ramanathan, R.: Data envelopment analysis for weight derivation and aggregation in the analytic hierarchy process. Comput. Oper. Res. 33(5), 1289–1307 (2006)

    Article  Google Scholar 

  7. Werner-Allen, G., Lorincz, K., Ruiz, M., Marcillo, O., Johnson, J., Lees, J., Welsh, M.: Deploying a wireless sensor network on an active volcano. IEEE Internet Comput. 10(2), 18–25 (2006)

    Article  Google Scholar 

  8. Li, C.Y., Su, W.L., McKenzie, T.G., Hsu, F.C., Lin, S.D., Hsu, J.Y.J., Gibbons, P.B.: Recommending missing sensor values. In: 2015 IEEE International Conference on Big Data (Big Data) (pp. 381–390). IEEE (2015)

    Google Scholar 

  9. Le Gruenwald, M.H.: Estimating missing values in related sensor data streams. In: COMAD (2005)

    Google Scholar 

  10. Pan, L., Li, J.: K-nearest neighbor based missing data estimation algorithm in wireless sensor networks. Wireless Sens. Netw. 2(02), 115 (2010)

    Article  Google Scholar 

  11. Yuan, Y.C.: Multiple imputation for missing data: Concepts and new development (Version 9.0), SAS Institute Inc, Rockville, MD, vol. 49, pp. 1–11 (2010)

    Google Scholar 

  12. Gruenwald, L., Chok, H., Aboukhamis, M.: Using data mining to estimate missing sensor data. In: Seventh IEEE International Conference on Data Mining Workshops, pp. 207–212 (2007)

    Google Scholar 

  13. Yu, X., Fu, Y., Li, P., Zhang, Y.: Fault-tolerant aircraft control based on self-constructing fuzzy neural networks and multivariable SMC under actuator faults. IEEE Trans. Fuzzy Syst. 26(4), 2324–2335 (2018)

    Article  Google Scholar 

  14. Zhang, Y.: A novel outlier detection method for improving industrial process monitoring. In: 2018 Chinese Control And Decision Conference (CCDC) (pp. 1155–1159). IEEE (2018)

    Google Scholar 

  15. Kim, W., Katipamula, S.: A review of fault detection and diagnostics methods for building systems. Science and Technology for the Built Environment 24(1), 3–21 (2018)

    Article  Google Scholar 

  16. Zhou, J., Huang, Z.: Recover missing sensor data with iterative imputing network. In: Workshops at the Thirty-Second AAAI Conference on Artificial Intelligence (2018)

    Google Scholar 

  17. Mehmood, A., Zia, K., Muhammad, A., Kumar Saini, D.: Missing observation approximation for spatio-temporal profile reconstruction in participatory sensor networks. Int. J. Crowd Sci. 2(2), 108–122 (2018)

    Article  Google Scholar 

  18. Monte-Moreno, E., Chetouani, M., Faundez-Zanuy, M., Sole-Casals, J.: Maximum likelihood linear programming data fusion for speaker recognition. Speech Commun. 51(9), 820–830 (2009)

    Article  Google Scholar 

Download references

Acknowledgements

This work is supported by the French National Research Agency in the framework of the “Investissements d’avenir” Eco SESA program (ANR-15-IDEX-02) and by the ADEME in the framework of the COMEPOS project.

Author information

Authors and Affiliations

  1. G-SCOP Lab, CNRS, UMR 5272, University of Grenoble Alpes, Grenoble, France

    Houda Najeh & Stéphane Ploix

  2. MACS Lab, University of Gabes, LR16ES22, Gabes, Tunisia

    Houda Najeh, Karim Chabir & Mohamed Naceur Abdelkrim

  3. Maersk Mc-Kinney Moller Institute, University of Southern, Odense, Denmark

    Mahendra Pratap Singh

Authors
  1. Houda Najeh
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Mahendra Pratap Singh
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Stéphane Ploix
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Karim Chabir
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Mohamed Naceur Abdelkrim
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Houda Najeh .

Editor information

Editors and Affiliations

  1. School of Art and Design, Cardiff Metropolitan University, Cardiff, UK

    John Littlewood

  2. Bournemouth University, Poole, UK

    Robert J. Howlett

  3. Politecnico di Torino, Turin, Italy

    Alfonso Capozzoli

  4. University of Canberra, Canberra, Australia

    Lakhmi C. Jain

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Najeh, H., Singh, M.P., Ploix, S., Chabir, K., Abdelkrim, M.N. (2020). Automatic Thresholding for Sensor Data Gap Detection Using Statistical Approach. In: Littlewood, J., Howlett, R., Capozzoli, A., Jain, L. (eds) Sustainability in Energy and Buildings. Smart Innovation, Systems and Technologies, vol 163. Springer, Singapore. https://doi.org/10.1007/978-981-32-9868-2_39

Download citation

Publish with us

Policies and ethics

Search

Navigation