Abstract
Audio scene classification, the problem of predicting class labels of audio scenes, has drawn lots of attention during the last several years. However, it remains challenging and falls short of accuracy and efficiency. Recently, Convolutional Neural Network (CNN)-based methods have achieved better performance with comparison to the traditional methods. Nevertheless, conventional single channel CNN may fail to consider the fact that additional cues may be embedded in the multi-channel recordings. In this paper, we explore the use of Multi-channel CNN for the classification task, which aims to extract features from different channels in an end-to-end manner. We conduct the evaluation compared with the conventional CNN and traditional Gaussian Mixture Model-based methods. Moreover, to improve the classification accuracy further, this paper explores the using of mixup method. In brief, mixup trains the neural network on linear combinations of pairs of the representation of audio scene examples and their labels. By employing the mixup approach for data augmentation, the novel model can provide higher prediction accuracy and robustness in contrast with previous models, while the generalization error can also be reduced on the evaluation data.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Sawhney, N., Schmandt, C.: Nomadic radio: speech and audio interaction for contextual messaging in nomadic environments. ACM Trans. Comput. Interact. 7(3), 353–383 (2000)
Stowell, D., Giannoulis, D., Benetos, E., Lagrange, M., Plumbley, M.D.: Detection and classification of acoustic scenes and events. IEEE Trans. Multimed. 17(10), 1733–1746 (2015)
Marchi, E., Tonelli, D., Xu, X., Ringeval, F., Deng, J., Squartini, S.: The up system for the 2016 DCASE challenge using deep recurrent neural network and multiscale kernel subspace learning. In: IEEE AASP Challenge on Detection and Classification of Acoustic Scenes and Events (DCASE) (2016)
Adavanne, S.: Sound event detection in multichannel audio using spatial and harmonic features. In: IEEE AASP Challenge on Detection and Classification of Acoustic Scenes and Events (DCASE) (2016)
Elizalde, B., Lei, H., Friedland, G., Peters, N.: An i-vector based approach for audio scene detection. In: IEEE AASP Challenge on Detection and Classification of Acoustic Scenes and Events (DCASE) (2013)
Zhang, H., Cisse, M., Dauphin, Y.N., Lopez-Paz, D.: mixup: Beyond Empirical Risk Minimization. In: International Conference on Learning Representations (2018)
Mesaros, A., et al.: DCASE 2017 challenge setup: tasks, datasets and baseline system. In: IEEE AASP Challenge on Detection and Classification of Acoustic Scenes and Events (DCASE) (2017)
Mesaros, A., Heittola, T., Virtanen, T.: Metrics for Polyphonic sound event detection. Appl. Sci. 6(6), 162 (2016)
Rakotomamonjy, A., Gasso, G.: Histogram of gradients of time-frequency representations for audio scene classification. IEEE/ACM Trans. Audio Speech Lang. Process. (TASLP) 23(1), 142–153 (2015)
Salamon, J., Bello, J.P.: Unsupervised feature learning for urban sound classification. In: IEEE International Conference on Acoustics, Speech and Signal Processing, pp. 171–175 (2015)
Eghbal-Zadeh, H.: CP-JKU submissions for DCASE-2016: a hybrid approach using binaural i-vectors and deep convolutional neural networks. In: IEEE AASP Challenge on Detection and Classification of Acoustic Scenes and Events (DCASE) (2016)
Bisot, V., Serizel, R., Essid, S., Richard, G.: Supervised nonnegative matrix factorization for acoustic scene classification. In: IEEE AASP Challenge on Detection and Classification of Acoustic Scenes and Events (DCASE) (2016)
Schröder, J., Anemüller, J., Goetze, S.: Performance comparison of GMM, HMM and DNN based approaches for acoustic event detection within task 3 of the DCASE 2016 challenge. In: IEEE AASP Challenge on Detection and Classification of Acoustic Scenes and Events (DCASE) (2016)
Phan, H., Hertel, L., Maass, M., Koch, P., Mertins, A.: Label tree embeddings for acoustic scene classification. In: IEEE AASP Challenge on Detection and Classification of Acoustic Scenes and Events (DCASE) (2016)
Han, Y., Lee, K.: Acoustic scene classification using convolutional neural network and multiple-width frequency-delta data augmentation. In: IEEE AASP Challenge on Detection and Classification of Acoustic Scenes and Events (DCASE) (2016)
Xu, Y., Kong, Q., Huang, Q., Wang, W., Plumbley, M.D.: Convolutional gated recurrent neural network incorporating spatial features for audio tagging. arXiv:1702.07787 (2017)
Krizhevsky, A., Sutskever, I., Hinton, G.E.: ImageNet classification with deep convolutional neural networks. In: Advances in Neural Information Processing Systems, pp. 1–9 (2012)
Hinton, G., et al.: Deep neural networks for acoustic modeling in speech recognition. IEEE Signal Process. Mag. 29, 82–97 (2012)
Hertel, L., Phan, H., Mertins, A.: Classifying variable-length audio files with all-convolutional networks and masked global pooling. arXiv:1607.02857 (2016)
LeCun, Y., Bottou, L., Bengio, Y., Haffner, P.: Gradient-based learning applied to document recognition. Proc. IEEE 86(10), 2278–2324 (1998)
Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556 (2014)
Chollet, F.: Xception: deep learning with depthwise separable convolutions. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (2017)
Srivastava, N., Hinton, G., Krizhevsky, A., Sutskever, I., Salakhutdinov, R.: Dropout: a simple way to prevent neural networks from overfitting. J. Mach. Learn. Res. 15(1), 1929–1958 (2014)
Ioffe, S., Szegedy, C.: Batch normalization: accelerating deep network training by reducing internal covariate shift. In: International Conference on Machine Learning (2015)
Mun, S., Park, S., Han D.K., Ko, H.: Generative adversarial network based acoustic scene training set augmentation and selection using SVM hyper-plane. In: IEEE AASP Challenge on Detection and Classification of Acoustic Scenes and Events (DCASE) (2017)
Acknowledgments
This work is sponsored by the Scientific Research Project of NUDT (No. ZK17-03-31).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer Nature Switzerland AG
About this paper
Cite this paper
Xu, K. et al. (2018). Mixup-Based Acoustic Scene Classification Using Multi-channel Convolutional Neural Network. In: Hong, R., Cheng, WH., Yamasaki, T., Wang, M., Ngo, CW. (eds) Advances in Multimedia Information Processing – PCM 2018. PCM 2018. Lecture Notes in Computer Science(), vol 11166. Springer, Cham. https://doi.org/10.1007/978-3-030-00764-5_2
Download citation
DOI: https://doi.org/10.1007/978-3-030-00764-5_2
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-00763-8
Online ISBN: 978-3-030-00764-5
eBook Packages: Computer ScienceComputer Science (R0)