Skip to main content
SpringerLink
Log in
Book cover

International Conference in Communications, Signal Processing, and Systems

CSPS 2018: Communications, Signal Processing, and Systems pp 870–874Cite as

Design and Implementation of Sensory Data Collection and Storage Based on Hadoop Platform

  • Conference paper
  • First Online:

Part of the book series: Lecture Notes in Electrical Engineering ((LNEE,volume 517))

Abstract

At present, modern manufacturing and management concepts such as digitization, networking, and intelligence are widely used in the industry. Industry automation and information have been unprecedentedly improved, and therefore the entire life of industrial production link involves massive amounts of data, and the status monitoring data of industrial machine have large, multiple source, heterogeneous, and complex data characteristics. What is more, the traditional processing methods and tools could not meet the requirements for massive data, and may miss the best time to repair machine. So, to resolve the challenges that the industrial sensory big data faces, this paper proposes the sensory data collection and storage based on Hadoop platform.

This is a preview of subscription content, log in via an institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   139.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   179.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD   249.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Liu, F.C., Shen, F.: Building a research data science platform from industrial machines. In: IEEE Conference (2015)

    Google Scholar 

  2. Manwal, M., Gupta, A.: Big Data and Hadoop A Technological Survey, Emerging Trends in Computing and Communication Technologies (ICETCCT), February (2018)

    Google Scholar 

  3. Lyu, Y., Fan, X., Liu, K.: An optimized strategy for small files storing and accessing in HDFS. In: IEEE International Conference on Computational Science and Engineering (CSE), vol. 1, pp. 611–614 (2017)

    Google Scholar 

  4. Sarnovsky, M., Bajus, D.: Building environment analysis based on clustering methods from sensory data on top of the Hadoop platform. In: IEEE Conference (2017)

    Google Scholar 

  5. Xie, J.: Construction for the city taxi trajectory data analysis system by Hadoop platform. In: IEEE Conference (2017)

    Google Scholar 

  6. Zhonghua, M.: Seismic data attribute extraction based on Hadoop platform. In: IEEE Conference (2017)

    Google Scholar 

  7. Longley, P.A., Goodchild, M.F., Maguire, D.J., Rhind, D.W.: Geographic Information Systems and Science. Wiley, New York (2001)

    Google Scholar 

  8. Mazumdar, S., Dhar, S.: Hadoop as big data operating system—the emerging approach for managing challenges of enterprise big data platform. In: IEEE Conference (2015)

    Google Scholar 

  9. Ding, X., Tian, B.: A scheme of structured data compression and query on Hadoop platform. In: IEEE Conference (2015)

    Google Scholar 

  10. Yan, H., Song, G.: Based on the Hadoop cloud computing experiment platform. J. Shenyang Norm. Univ. (Natural Sciences) 1, 85–89 (2013)

    Google Scholar 

Download references

Acknowledgements

This work was funded by the National Intelligent Manufacturing Project.

Author information

Authors and Affiliations

  1. Key Laboratory of Universal Wireless Communications, MOE, Beijing University of Posts and Telecommunications, Xitucheng Road 10, Beijing, China

    Zhen Bai & Chenglin Zhao

  2. China Petroleum Technology & Development Corporation, Beijing, China

    Shaohua Cui

Authors
  1. Zhen Bai
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Shaohua Cui
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Chenglin Zhao
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Zhen Bai .

Editor information

Editors and Affiliations

  1. Department of Electrical Engineering, University of Texas at Arlington, Arlington, TX, USA

    Qilian Liang

  2. School of Information and Communication Engineering, Dalian University of Technology, Dalian, China

    Xin Liu

  3. School of Information Science and Technology, Dalian Maritime University, Dalian, China

    Zhenyu Na

  4. College of Electronic and Communication Engineering, Tianjin Normal University, Tianjin, China

    Wei Wang

  5. College of Electronic and Communication Engineering, Tianjin Normal University, Tianjin, China

    Jiasong Mu

  6. College of Electronic and Communication Engineering, Tianjin Normal University, Tianjin, China

    Baoju Zhang

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Bai, Z., Cui, S., Zhao, C. (2020). Design and Implementation of Sensory Data Collection and Storage Based on Hadoop Platform. In: Liang, Q., Liu, X., Na, Z., Wang, W., Mu, J., Zhang, B. (eds) Communications, Signal Processing, and Systems. CSPS 2018. Lecture Notes in Electrical Engineering, vol 517. Springer, Singapore. https://doi.org/10.1007/978-981-13-6508-9_106

Download citation

  • DOI: https://doi.org/10.1007/978-981-13-6508-9_106

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-13-6507-2

  • Online ISBN: 978-981-13-6508-9

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics

Search

Navigation