Abstract
With the development of the Internet of Things, more and more edge devices (such as smart-phones, tablets, wearable devices, embedded devices, gateway equipment and etc.) generate huge amounts of rich sensor data every day. With them, some deep learning based recognition applications provide users with various recognition services on edge devices. However, a fundamental problem these applications meet is how to perform deep learning algorithms effectively and promptly on a resource-constrained platform. Some researchers have proposed completing all computation tasks on the cloud side then returning the results back to edge devices, but such procedure is always time-consuming because of data transmission. In this case, training deep learning models on cloud side and executing the trained model directly on edge devices for inference is a better choice. Meanwhile, the deep learning based mobile applications also need to satisfy the requirements of low latency, low storage and low consumption. To fulfill above objectives, we aim to propose a new deep learning compression algorithm. We conduct comprehensive experiments to compare the proposed light-weight model with other standard state-of-the-art compression algorithms in terms of inference accuracy, process delay, CPU load, energy cost and storage coverage, based on an audio recognition system.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Hofer, T., Schwinger, W., Pichler, M., Leonhartsberger, G., Altmann, J., Retschitzegger, W.: Context-awareness on mobile devices-the hydrogen approach. In: Proceedings of the 36th Annual Hawaii International Conference on System Sciences, 10-pp. (2003)
Shi, W., Cao, J., Zhang, Q., Li, Y., Xu, L.: Edge computing: vision and challenges. IEEE Internet Things J. 3, 637–646 (2016)
Su, X., Tong, H., Ji, P.: Activity recognition with smartphone sensors. Tsinghua Sci. Technol. 19, 235–249 (2014)
Wang, T., Cardone, G., Corradi, A., Torresani, L., Campbell, A.T.: WalkSafe: a pedestrian safety app for mobile phone users who walk and talk while crossing roads. In: Proceedings of the Twelfth Workshop on Mobile Computing Systems & Applications, p. 5 (2012)
LiKamWa, R., Zhong, L.: Starfish: efficient concurrency support for computer vision applications. In: Proceedings of 13th Annual International Conference on Mobile Systems, Applications, and Services, pp. 213–226 (2015)
Bo, C., Li, X.-Y., Jung, T., Mao, X., Tao, Y., Yao, L.: Smartloc: push the limit of the inertial sensor based metropolitan localization using smartphone. In: Proceedings of 19th Annual International Conference on Mobile Computing and Networking, pp. 195–198 (2013)
Gupta, P., Dallas, T.: Feature selection and activity recognition system using a single triaxial accelerometer. IEEE Trans. Biomed. Eng. 61, 1780–1786 (2014)
Duchowski, A.: Eye Tracking Methodology: Theory and Practice. Springer Science & Business Media, London (2007)
Swain, P.H., Hauska, H.: The decision tree classifier: design and potential. IEEE Trans. Geosci. Electron. 15, 142–147 (1977)
Lane, N.D., Bhattacharya, S., Georgiev, P., Forlivesi, C., Jiao, L., Qendro, L., Kawsar, F.: Deepx: a software accelerator for low-power deep learning inference on mobile devices. In: 2016 15th ACM/IEEE International Conference on Information Processing in Sensor Networks (IPSN), pp. 1–12 (2016)
Liu, C., Zhang, L., Liu, Z., Liu, K., Li, X., Liu, Y.: Lasagna: towards deep hierarchical understanding and searching over mobile sensing data. In: Proceedings of 22nd Annual International Conference on Mobile Computing and Networking, pp. 334–347 (2016)
Wikipedia. AlexNet – Wikipedia, The Free Encyclopedia (2017)
Wikipedia. VGG Image Annotator – Wikipedia, The Free Encyclopedia (2017)
Xue, J., Li, J., Gong, Y.: Restructuring of deep neural network acoustic models with singular value decomposition. In: Interspeech, pp. 2365–2369 (2013)
Liu, B., Wang, M., Foroosh, H., Tappen, M., Pensky, M.: Sparse convolutional neural networks. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pp. 806–814 (2015)
Abadi, M., Agarwal, A., Barham, P., Brevdo, E., Chen, Z., Citro, C., Corrado, G.S., Davis, A., Dean, J., Devin, M., et al.: Tensorflow: large-scale machine learning on heterogeneous distributed systems. arXiv Prepr. arXiv:1603.04467 (2016)
Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., Darrell, T.: Caffe: convolutional architecture for fast feature embedding. In: Proceedings of the 22nd ACM international conference on Multimedia, pp. 675–678 (2014)
Keras: Deep Learning library for Theano and TensorFlow (2016)
Dally, W.J.: CNTK: an embedded language for circuit description, Department of Computer Science, California Institute of Technology, Display File
Wikipedia. Torch (machine learning) – Wikipedia, The Free Encyclopedia (2017)
Chen, T., Li, M., Li, Y., Lin, M., Wang, N., Wang, M., Xiao, T., Xu, B., Zhang, C., Zhang, Z.: Mxnet: a flexible and efficient machine learning library for heterogeneous distributed systems. arXiv Prepr. arXiv:1512.01274 (2015)
Wikipedia. Theano – Wikipedia, The Free Encyclopedia (2016)
Lane, N.D., Georgiev, P., Qendro, L.: DeepEar: robust smartphone audio sensing in unconstrained acoustic environments using deep learning. In: Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing, pp. 283–294 (2015)
Han, S., Mao, H., Dally, W.J.: Deep compression: compressing deep neural networks with pruning, trained quantization and huffman coding. arXiv Prepr. arXiv:1510.00149 (2015)
Lane, N., Bhattacharya, S.: Sparsifying deep learning layers for constrained resource inference on wearables. In: Proceedings of the 14th ACM Conference on Embedded Network Sensor Systems, pp. 176–189 (2016)
Liu, S., Du, J.: Poster: MobiEar-building an environment-independent acoustic sensing platform for the deaf using deep learning. In: Proceedings of the 14th Annual International Conference on Mobile Systems, Applications, and Services Companion, p. 50 (2016)
Kunz, R., Tetzlaff, R., Wolf, D.: SCNN: a universal simulator for cellular neural networks. In: 1996 Fourth IEEE International Workshop on Cellular Neural Networks and their Applications, CNNA 1996. Proceedings, pp. 255–259 (1996)
Tomé, D., Bondi, L., Baroffio, L., Tubaro, S., Plebani, E., Pau, D.: Reduced memory region based deep Convolutional Neural Network detection. In: 2016 IEEE 6th International Conference on Consumer Electronics (ICCE), Berlin, pp. 15–19 (2016)
Park, J., Li, S., Wen, W., Li, H., Chen, Y., Dubey, P.: Holistic SparseCNN: forging the trident of accuracy, speed, and size. arXiv Prepr. arXiv:1608.01409 (2016)
Han, S., Liu, X., Mao, H., Pu, J., Pedram, A., Horowitz, M.A., Dally, W.J.: EIE: efficient inference engine on compressed deep neural network. In: Proceedings of the 43rd International Symposium on Computer Architecture (2016)
Acknowledgements
This work is partially supported by the National Natural Science Foundation of China (NSFC) under Grant No.61472312 and No.61502374, the Fundamental Research Funds for the Central Universities under Grants JBZ171002, and the CETC shining Star Innovation.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Du, J., Liu, S., Wei, Y., Liu, H., Wang, X., Nan, K. (2018). Understanding Sensor Data Using Deep Learning Methods on Resource-Constrained Edge Devices. In: Li, J., et al. Wireless Sensor Networks. CWSN 2017. Communications in Computer and Information Science, vol 812. Springer, Singapore. https://doi.org/10.1007/978-981-10-8123-1_13
Download citation
DOI: https://doi.org/10.1007/978-981-10-8123-1_13
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-10-8122-4
Online ISBN: 978-981-10-8123-1
eBook Packages: Computer ScienceComputer Science (R0)
