Skip to main content

Big Data Dimensionality Reduction for Wireless Sensor Networks Using Stacked Autoencoders

  • Conference paper
  • First Online:

Part of the book series: Springer Proceedings in Complexity ((SPCOM))

Abstract

A typical wireless sensor network (WSN) consists of spatially dispersed sensor nodes for monitoring and gathering data at a central location. Over time, this data accumulates and it becomes difficult to transmit this large volume of data. Owing to the recent advancements in internet of things (IoTs), more complex data is generated. This high-dimensional data must be reduced to a lower dimensional representation before transmission. Principal component analysis (PCA) is a common method for data aggregation. However, PCA performs best for the cases that require linear mapping. Therefore, a method for linear and/or non-linear data mapping is considered in this work. Autoencoders are neural networks that can learn about the internal structure of the data and reduce its dimensionality. Stacked autoencoders are a class of deep feed forward neural networks that perform real learning of the data. Principal component analysis assumes that the underlying data can be fully described by its mean and variance, whereas, autoencoders are adaptive to different data distributions. In this paper, we compare the performance of PCA and autoencoder in terms of their respective ability to reduce the reconstruction error in the observed high-dimensional data from a WSN. The results of numerical analysis demonstrate that the autoencoder reduces the reconstruction error by up to 10 times as compared to an ordinary PCA-based scheme.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD   169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Diebold, F.X.: On the Origin(s) and Development of the Term ‘Big Data’. PIER Working Paper No. 12-037. Available at SSRN https://ssrn.com/abstract=2152421 or https://doi.org/10.2139/ssrn.2152421 (2012)

  2. Laney D: 3-d data management: controlling data volume, velocity and variety. META Group Research Note (2001)

    Google Scholar 

  3. Lohr, S.: The Age of Big Data, p. 11. New York Times (2012)

    Google Scholar 

  4. Jimenez, L.O., Landgrebe, D.A.: Supervised classification in high-dimensional space: geometrical, statistical, and asymptotical properties of multivariate data. IEEE Trans. Syst., Man Cybern. 28(1), 39–54 (1997)

    Article  Google Scholar 

  5. Pearson, K.: On lines and planes of closest fit to systems of points in space. Philiosophical Mag. 2, 559–572 (1901)

    Google Scholar 

  6. Roweis, S.T.: EM algorithms for PCA and SPCA. In: Advances in Neural Information Processing Systems, vol. 10, pp. 626–632 (1997)

    Google Scholar 

  7. Saul, L.K., Weinberger, K.Q., Ham, J.H., Sha, F., Lee, D.D.: Spectral methods for dimensionality reduction. In: Semisupervised Learning. The MIT Press, Cambridge, MA, USA (2006)

    Google Scholar 

  8. Burges, C.J.C.: Data Mining and Knowledge Discovery Handbook: A Complete Guide for Practitioners and Researchers, chapter Geometric Methods for Feature Selection and Dimensional Reduction: A Guided Tour. Kluwer Academic Publishers (2005)

    Google Scholar 

  9. Venna, J.: Dimensionality reduction for visual exploration of similarity structures. Ph.D. thesis, Helsinki University of Technology (2007)

    Google Scholar 

  10. Lee, J.A., Verleysen, M.: Nonlinear Dimensionality Reduction. Springer, New York (2007)

    Book  Google Scholar 

  11. Torgerson, W.S.: Multidimensional scaling I: theory and method. Psychometrika 17, 401–419 (1952)

    Article  Google Scholar 

  12. Brand, M.: Charting a manifold. In: Advances in Neural Information Processing Systems, vol. 15, pp. 985–992. The MIT Press, Cambridge, MA, USA (2002)

    Google Scholar 

  13. Guo, C., Nelson, J.D.B.: Compressive imaging with complex wavelet transform and turbo amp reconstruction. In: 23rd European Signal Processing Conference (EUSIPCO), pp. 1751–1755 (2015)

    Google Scholar 

  14. Hotelling, H.: Analysis of a complex of statistical variables into principal components. J. Educ. Psychol. 24, 417441 (1933)

    Article  Google Scholar 

  15. Tipping and Bishop: Pattern Recognition and Machine Learning by C. Bishop, 12.2.1 p. 574 (1999)

    Google Scholar 

  16. Chen, Z., Yang, S., Li, L., Xie, Z.: A clustering approximation mechanism based on data spatial correlation in wireless sensor networks. In: Wireless Telecommunications Symposium (WTS), p. 17 (2010)

    Google Scholar 

  17. Li, J., Guo, S., Yang, Y., He, J.: Data aggregation with principal component analysis in big data wireless sensor networks. In: 12th International Conference on Mobile Ad-Hoc and Sensor Networks (2016)

    Google Scholar 

  18. LeCuns, Y.: Online Available at http://yann.lecun.com/exdb/lenet/index.html

  19. Fan, W., Zhang, K., Yuan, X.J.: UCI Machine Learning Repository. Online Available http://archive.ics.uci.edu/ml

  20. Vergar, A.: UCI Machine Learning Repository. Online Available http://archive.ics.uci.edu/ml

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Sajid Saleem .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Sirshar, M., Saleem, S., Ilyas, M.U., Khan, M.M., Alkatheiri, M.S., Alowibdi, J.S. (2019). Big Data Dimensionality Reduction for Wireless Sensor Networks Using Stacked Autoencoders. In: Visvizi, A., Lytras, M. (eds) Research & Innovation Forum 2019. RIIFORUM 2019. Springer Proceedings in Complexity. Springer, Cham. https://doi.org/10.1007/978-3-030-30809-4_35

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-30809-4_35

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-30808-7

  • Online ISBN: 978-3-030-30809-4

  • eBook Packages: EducationEducation (R0)

Publish with us

Policies and ethics