Advertisement

Convolutional Neural Network Based Sound Recognition Methods for Detecting Presence of Amateur Drones in Unauthorized Zones

  • Ungati GanapathiEmail author
  • M. Sabarimalai ManikandanEmail author
Conference paper
  • 65 Downloads
Part of the Communications in Computer and Information Science book series (CCIS, volume 1241)

Abstract

Unmanned aerial vehicles (UAVs), or drones, have become an integral part of diverse civil and commercial applications. But illegal operations of UAVs pose serious risks to public safety, privacy and national security. Thus, the detection of these vehicles has become vital to identify and track amateur drones in unauthorized zones or restricted areas. This paper presents three sound event recognition (SER) methods developed based on the Mel-frequency cepstrum coefficients (MFCCs) and spectrogram features combined with three machine learning classifiers such as multi-class SVM, one-dimensional convolutional neural networks (1DCNN) and two-dimensional CNN (2DCNN) for recognizing drone sounds. The SER methods are evaluated using a wide variety of sounds such as music, speech, wind, rain, and vehicle. Results showed that the MFCC-SVM based and MFCC-1DCNN based SER methods had average recall rate (RR) = 92.53%, precision rate (PR) = 93.21% and F1-score = 92.84% and RR = 94.28%, PR = 96.57% and F1-score = 95.02% for a segment length of 1 s, respectively. The spectrogram-2DCNN based method had average RR = 73.27%, PR = 74.55% and F1-score = 73.37% for audio segment length of 500 ms. Preliminary results demonstrate that the MFCC-1DCNN based SER method achieves better recognition rates as compared to that of the MFCC-SVM based and spectrogram-2DCNN based methods in recognizing drone sounds.

Keywords

UAV detection Acoustic based UAV detection Convolutional neural networks Audio event recognition 

References

  1. 1.
    Taha, B., Shoufan, A.: Machine learning-based drone detection and classification: state-of-the-art in research. IEEE Access 7, 138669–138682 (2019) CrossRefGoogle Scholar
  2. 2.
    Ezuma, M., Erden, F., Anjinappa, C.K., Ozdemir, O., Guvenc, I.: Detection and classification of UAVs using RF fingerprints in the presence of Wi-Fi and bluetooth interference. IEEE Open J. Commun. Soc. 1, 60–76 (2020)CrossRefGoogle Scholar
  3. 3.
    Ezuma, M., Erden, F., Anjinappa, C.K., Ozdemir, O., Guvenc, I.: Micro-UAV detection and classification from RF fingerprints using machine learning techniques. In: Proceedings of the IEEE Aerospace Conference, pp. 1–13, March 2019Google Scholar
  4. 4.
    Alipour-Fanid, A., Dabaghchian, M., Wang, N., Wang, P., Zhao, L., Zeng, K.: Machine learning-based delay-aware UAV detection and operation mode identification over encrypted Wi-Fi traffic. IEEE Trans. Inf. Forensics Secur. 15, 2346–2360 (2019)CrossRefGoogle Scholar
  5. 5.
    Zhang, W., Li, G.: Detection of multiple micro-drones via cadence velocity diagram analysis. Electron. Lett. 54(7), 441–443 (2018)CrossRefGoogle Scholar
  6. 6.
    Patel, J.S., Fioranelli, F., Anderson, D.: Review of radar classification and RCS characterisation techniques for small UAVs or drones. IET Radar Sonar Navig. 12(9), 911–919 (2018)CrossRefGoogle Scholar
  7. 7.
    Rozantsev, A., Lepetit, V., Fua, P.: Detecting flying objects using a single moving camera. IEEE Trans. Pattern Anal. Mach. Intell. 39(5), 879–892 (2017)CrossRefGoogle Scholar
  8. 8.
    Zhang, P., Yang, L., Chen, G., Li, G.: Classification of drones based on micro-Doppler signatures with dual-band radar sensors. In: Progress in Electromagnetics Research Symposium-Fall (PIERS-FALL), pp. 638–643, November 2017Google Scholar
  9. 9.
    Nguyen, P., Truong, H., Ravindranathan, M., Nguyen, A., Han, R., Vu, T.: Matthan: drone presence detection by identifying physical signatures in the drone’s RF communication. In: Proceedings of the 15th Annual International Conference on Mobile Systems, Applications, and Services, pp. 211–224, June 2017Google Scholar
  10. 10.
    Nguyen, P., Ravindranatha, M., Nguyen, A., Han, R., Vu, T.: Investigating cost-effective RF-based detection of drones. In: Proceedings of the 2nd Workshop on Micro Aerial Vehicle Networks, Systems, and Applications for Civilian Use, pp. 17–22, June 2016Google Scholar
  11. 11.
    Taha, B., Shoufan, A.: Machine learning-based drone detection and classification: state-of-the-art in research. IEEE Access, 1–5 (2016) Google Scholar
  12. 12.
    Lim, D., et al.: Practically classifying unmanned aerial vehicles sound Using convolutional neural networks. In: Proceedings of IEEE International Conference on Robotic Computing (IRC), pp. 242–245, January 2017Google Scholar
  13. 13.
    Lim, D., et al.: A study on detecting drones using deep convolutional neural networks. In Proceedings of IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS), pp. 1–5, August 2018Google Scholar
  14. 14.
    Al-Emadi, S., Al-Ali, A., Mohammad, A., Al-Ali, A.: Audio based drone detection and identification using deep learning. In: Proceedings of IEEE International Wireless Communications and Mobile Computing Conference (IWCMC), pp. 459–464, June 2019Google Scholar
  15. 15.
    Matson, E., Yang, B., Smith, A., Dietz, E., Gallagher, J.: UAV detection system with multiple acoustic nodes using machine learning models. In: Proceedings of IEEE International Conference on Robotic Computing (IRC), pp. 493–498, February 2019Google Scholar
  16. 16.
    Jeon, S., Shin, J.W., Lee, Y.J., Kim, W.H., Kwon, Y., Yang, H.Y.: Empirical study of drone sound detection in real-life environment with deep neural networks. In: Proceedings of European Signal Processing Conference (EUSIPCO), pp. 1858–1862, February 2017Google Scholar
  17. 17.
    Mezei, J., Molnár, A.: Drone sound detection by correlation. In: Proceedings of IEEE International Symposium on Applied Computational Intelligence and Informatics (SACI), pp. 509–518, May 2016Google Scholar
  18. 18.
    Kim, J., Park, C., Ahn, J., Ko, Y., Park, J., Gallagher, J.C.: Real-time UAV sound detection and analysis system. In: IEEE Sensors Applications Symposium (SAS), pp. 1–5, March 2017Google Scholar
  19. 19.
    Bernardini, A., Mangiatordi, F., Pallotti, E., Capodiferro, L.: Drone detection by acoustic signature identification. Electron. Imaging 2017, 60–64 (2017)CrossRefGoogle Scholar
  20. 20.
    Case, E.E., Zelnio, A.M., Rigling, B.D.: Low-cost acoustic array for small UAV detection and tracking. In: Proceedings of IEEE National Aerospace and Electronics Conference, pp. 110–113, July 2019Google Scholar
  21. 21.
    Soni, S., Dey, S., Manikandan, M.S.: Automatic audio event recognition schemes for context-aware audio computing devices. In: Proceedings of IEEE International Conference on Digital Information Processing and Communications (ICDIPC), vol. 64, pp. 23–28 (2019)Google Scholar
  22. 22.
    Beritelli, F., Grasso, R.: A pattern recognition system for environmental sound classification based on MFCCs and neural networks. In: Proceedings of IEEE International Conference on Signal Processing and Communication Systems, pp. 1–4, December 2019Google Scholar
  23. 23.
    Soni, S., Dey, S., Manikandan, M.S.: SSQA: speech signal quality assessment method using spectrogram and 2-D convolutional neural networks for improving efficiency of ASR devices. In Proceedings of IEEE International Conference on Digital Information Processing and Communications (ICDIPC), pp. 29–34, May 2019Google Scholar
  24. 24.

Copyright information

© Springer Nature Singapore Pte Ltd. 2020

Authors and Affiliations

  1. 1.Real-Time Embedded Signal Processing Lab, School of Electrical SciencesIndian Institute of Technology BhubaneswarJatani, KhordhaIndia

Personalised recommendations