Advertisement

Audio Event Detection Using Wireless Sensor Networks Based on Deep Learning

  • Jose Marie Mendoza
  • Vanessa TanEmail author
  • Vivencio Fuentes
  • Gabriel Perez
  • Nestor Michael Tiglao
Conference paper
Part of the Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering book series (LNICST, volume 264)

Abstract

Wireless acoustic sensor network is useful for ambient assisted living applications. Its capability of incorporating an audio event detection and classification system helps its users, especially elderly, on their everyday needs. In this paper, we propose using convolutional neural networks (CNN) for classifying audio streams. In contrast to AAL systems using traditional machine learning, our solution is capable of learning and inferring activities in an end-to-end manner. To demonstrate the system, we developed a wireless sensor network composed of Raspberry Pi boards with microphones as nodes. The audio classification system results to an accuracy of 83.79% using a parallel network for the Urban8k dataset, extracting constant-Q transform (CQT) features as system inputs. The overall system is scalabale and flexible in terms of the number of nodes, hence it is applicable on wide areas where assisted living applications are utilized.

Keywords

Audio event detection Ambient assisted living 

Notes

Acknowledgments

The authors would like to acknowledge the support of the University of the Philippines Diliman and the Department of Science and Technology through the Engineering Research and Development for Technology (ERDT) Consortium.

References

  1. 1.
    Ramson, S.R.J., Moni, D.J.: Applications of wireless sensor networks-a survey. In: 2017 International Conference on Innovations in Electrical, Electronics, Instrumentation and Media Technology (ICEEIMT), pp. 325–329. IEEE (2017)Google Scholar
  2. 2.
    Erden, F., Velipasalar, S., Alkar, A.Z., Cetin, A.E.: Sensors in assisted living: a survey of signal and image processing methods. IEEE Signal Process Mag. 33(2), 36–44 (2016)CrossRefGoogle Scholar
  3. 3.
    Martalò, M., Ferrari, G., Malavenda, C.: Wireless Sensor Networks and Audio Signal Recognition for Homeland Security. CRC Press (2012)Google Scholar
  4. 4.
    Dhawan, A., Balasubramanian, R., Vokkarane, V.: A framework for real-time monitoring of acoustic events using a wireless sensor network. In: 2011 IEEE International Conference on Technologies for Homeland Security (HST), pp. 254–261. IEEE (2011)Google Scholar
  5. 5.
    Sruthy, S., George, S.N.: WiFi enabled home security surveillance system using raspberry Pi and IoT module. In: 2017 IEEE International Conference on Signal Processing, Informatics, Communication and Energy Systems (SPICES), pp. 1–6. IEEE (2017)Google Scholar
  6. 6.
    Alsina-Pagès, R.M., Navarro, J., Alías, F., Hervás, M.: HomeSound: real-time audio event detection based on high performance computing for behaviour and surveillance remote monitoring. Sensors 17(4), 854 (2017)CrossRefGoogle Scholar
  7. 7.
    Nisar, K., Ibrahim, A.A.A., Wu, L., Adamov, A., Deen, M.J.: Smart home for elderly living using wireless sensor networks and an android application. In: 2016 IEEE 10th International Conference on Application of Information and Communication Technologies (AICT), pp. 1–8. IEEE (2016)Google Scholar
  8. 8.
    Kong, Q., Sobieraj, I., Wang, W., Plumbley, M.: Deep neural network baseline For DCASE challenge 2016. In: Proceedings of the Detection and Classification of Acoustic Scenes and Events 2016 Workshop (DCASE2016) (2016)Google Scholar
  9. 9.
    Cakir, E., Heittola, T., Virtanen, T.: Domestic audio tagging with convolutional neural networks. In: IEEE AASP Challenge on Detection and Classification of Acoustic Scenes and Events (DCASE 2016) (2016)Google Scholar
  10. 10.
    Lidy, T., Schindler, A.: CQT-based convolutional neural networks for audio scene classification and domestic audio tagging. In: Proceedings of the Detection and Classification of Acoustic Scenes and Events 2016 Workshop (DCASE2016), DCASE2016 Challenge, vol. 90 (2016)Google Scholar
  11. 11.
    Hershey, S., Chaudhuri, S., Ellis, D.P.W., Gemmeke, J.F., et al.: CNN architectures for large-scale audio classification. In: 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 131–135. IEEE (2017)Google Scholar
  12. 12.
    Krizhevsky, A., Sutskever, I., Hinton, G.E.: ImageNet classification with deep convolutional neural networks. In: Advances in Neural Information Processing Systems, pp. 1097–1105 (2012)Google Scholar
  13. 13.
    Tokozume, Y., Harada, T.: Learning environmental sounds with end-to-end convolutional neural network. In: 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 2721–2725. IEEE (2017)Google Scholar
  14. 14.
    Vujović, V., Maksimović, M.: Raspberry Pi as a wireless sensor node: performances and constraints. In: 2014 37th International Convention on Information and Communication Technology, Electronics and Microelectronics (MIPRO), pp. 1013–1018 (2014)Google Scholar
  15. 15.
    Bahari, M.H., Plata-Chaves, J., Bertrand, A., Moonen, M.: Distributed labelling of audio sources in wireless acoustic sensor networks using consensus and matching. In: 2016 24th European Signal Processing Conference (EUSIPCO), pp. 2345–2349. IEEE (2016)Google Scholar
  16. 16.
    Salamon, J., Jacoby, C., Bello, J.P.: A dataset and taxonomy for urban sound research. In: Proceedings of the 22nd ACM International Conference on Multimedia, pp. 1041–1044. ACM (2014)Google Scholar
  17. 17.
    Mysore, G., Smaragdis, P.: Relative pitch estimation of multiple instruments. In: IEEE International Conference on 2009 Acoustics, Speech and Signal Processing, ICASSP 2009, pp. 313–316. IEEE (2009)Google Scholar
  18. 18.
    Nanni, L., Costa, Y.M.G., Lucio, D.R., Silla, C.N. Jr., Brahnam, S.: Combining visual and acoustic features for audio classification tasks. In: Pattern Recognition Letters, pp. 49–56, vol. 88 (2017)Google Scholar
  19. 19.
    Burkert, P., Trier, F., Afzal, M.Z., Dengel, A., Liwicki, M.: DeXpression: deep convolutional neural network for expression recognition (2015). arXiv preprint arXiv:1509.05371
  20. 20.
    Chollet, F. et al.: KERAS. In: GitHub (2015). https://github.com/fchollet/keras
  21. 21.
    Piczak, K.J.: Environmental sound classification with convolutional neural networks. In: 2015 IEEE 25th International Workshop on Machine Learning for Signal Processing (MLSP), pp. 1–6. IEEE (2015)Google Scholar
  22. 22.
    Dai, W., Dai, C., Qu, S., Li, J., Das, S.: Very deep convolutional neural networks for raw waveforms. In: 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 421–425. IEEE (2017)Google Scholar

Copyright information

© ICST Institute for Computer Sciences, Social Informatics and Telecommunications Engineering 2019

Authors and Affiliations

  • Jose Marie Mendoza
    • 1
  • Vanessa Tan
    • 1
    Email author
  • Vivencio Fuentes
    • 1
  • Gabriel Perez
    • 1
  • Nestor Michael Tiglao
    • 1
  1. 1.Electrical and Electronics Engineering InstituteUniversity of the Philippines - DilimanQuezon CityPhilippines

Personalised recommendations