Development Report:
Music Genre Classification Algorithm Based on Multi-Scale Fusion
Tingting Chen* and Yonggang Tang**,
*College of Music, Suzhou University
No.49 Bianhe Middle Road, Suzhou, Anhui 234000, China
**College of Mechanical and Electronic Engineering, Suzhou University
No.49 Bianhe Middle Road, Suzhou, Anhui 234000, China
Corresponding author
In the era of music streaming, the vast volume of digital music resources renders manual classification impractical. Although deep learning has achieved significant advances in music genre classification tasks, existing methods still face challenges such as insufficient feature extraction, low classification accuracy, loss of temporal sequence information, and limited dataset sizes. This study addresses these challenges in several ways: first, to tackle the problem of varying music durations affecting classification accuracy, log-Mel spectrograms are generated from segmented audio data; second, to improve classification accuracy on small datasets, we propose HybridNet, a deep learning model that employs a deep multi-scale fusion module to extract richer feature information. Subsequently, to further mitigate the loss of temporal information, we introduce a bidirectional long short-term memory (BiLSTM) layer resulting in the Bi-HybridNet model, which captures key sequential information in both forward and backward directions. Experimental results demonstrate that the proposed method achieves 86.92% accuracy on the FMA-small dataset, indicating improved classification performance over classical models. This study provides a practical technical solution for music genre classification, offering certain reference values in feature extraction and temporal modeling.
- [1] International Federation of the Phonographic Industry, “Global music report 2023,” 2023. https://globalmusicreport.ifpi.org/ [Accessed February 26, 2024]
- [2] C. Cortes and V. Vapnik, “Support-vector networks,” Mach. Learn., Vol.20, No.3, pp. 273-297, 1995. https://doi.org/10.1007/BF00994018
- [3] B. Matityaho and M. Furst, “Neural network based model for classification of music type,” 18th Conv. Electr. Electron. Eng. Isr., Session No.4.3.4, 1995. https://doi.org/10.1109/EEIS.1995.514161
- [4] D.-N. Jiang, L. Lu, H.-J. Zhang, J.-H. Tao, and L.-H. Cai, “Music type classification by spectral contrast feature,” Proc. IEEE Int. Conf. Multimed. Expo, Vol.1, pp. 113-116, 2002. https://doi.org/10.1109/ICME.2002.1035731
- [5] C. Laurier and P. Herrera, “Audio music mood classification using support vector machine,” MIREX Task Audio Mood Classif., pp. 2-4, 2007.
- [6] Y. Panagakis, C. Kotropoulos, and G. R. Arce, “Non-negative multilinear principal component analysis of auditory temporal modulations for music genre classification,” IEEE Trans. Audio Speech Lang. Process., Vol.18, No.3, pp. 576-588, 2010. https://doi.org/10.1109/TASL.2009.2036813
- [7] Y. M. G. Costa, L. S. Oliveira, A. L. Koerich, F. Gouyon, and J. G. Martins, “Music genre classification using LBP textural features,” Signal Process., Vol.92, No.11, pp. 2723-2737, 2012. https://doi.org/10.1016/j.sigpro.2012.04.023
- [8] S. Sugianto and S. Suyanto, “Voting-based music genre classification using melspectogram and convolutional neural network,” 2019 Int. Semin. Res. Inf. Technol. Intell. Syst. (ISRITI), pp. 330-333, 2019. https://doi.org/10.1109/ISRITI48646.2019.9034644
- [9] Y. Atahan et al., “Music genre classification using acoustic features and autoencoders,” 2021 Innov. Intell. Syst. Appl. Conf. (ASYU), 2021. https://doi.org/10.1109/ASYU52992.2021.9598979
- [10] X. Liu, S. Song, M. Zhang, and Y. Huang, “MATT. A multiple-instance attention mechanism for long-tail music genre classification,” 2022 IEEE Int. Conf. Syst. Man Cybern. (SMC), pp. 782-787, 2022. https://doi.org/10.1109/SMC53654.2022.9945477
- [11] B. Liang and M. Gu, “Music genre classification using transfer learning,” 2020 IEEE Conf. Multimed. Inf. Process. Retr. (MIPR), pp. 392-393, 2020. https://doi.org/10.1109/MIPR49039.2020.00085
- [12] L. G. Hafemann, L. S. Oliveira, and P. Cavalin, “Forest species recognition using deep convolutional neural networks,” 22nd Int. Conf. Pattern Recognit., pp. 1103-1107, 2014. https://doi.org/10.1109/ICPR.2014.199
- [13] W. Zhang, W. Lei, X. Xu, and X. Xing, “Improved music genre classification with convolutional neural networks,” Proc. Interspeech 2016, pp. 3304-3308, 2016. https://doi.org/10.21437/Interspeech.2016-1236
- [14] C. Senac, T. Pellegrini, F. Mouret, and J. Pinquier, “Music feature maps with convolutional neural networks for music genre classification,” Proc. 15th Int. Workshop Content-Based Multimed. Index. (CBMI), Article No.19, 2017. https://doi.org/10.1145/3095713.3095733
- [15] K. Choi, G. Fazekas, M. Sandler, and K. Cho, “Transfer learning for music classification and regression tasks,” arXiv:1703.09179, 2017. https://doi.org/10.48550/arXiv.1703.09179
- [16] H. Yang and W.-Q. Zhang, “Music genre classification using duplicated convolutional layers in neural networks,” Proc. Interspeech 2019, pp. 3382-3386, 2019. https://doi.org/10.21437/Interspeech.2019-1298
- [17] C. Liu, L. Feng, G. Liu, H. Wang, and S. Liu, “Bottom-up broadcast neural network for music genre classification,” Multimed. Tools Appl., Vol.80, No.5, pp. 7313-7331, 2021. https://doi.org/10.1007/s11042-020-09643-6
- [18] G. Song, Z. Wang, F. Han, S. Ding, and M. A. Iqbal, “Music auto-tagging using deep Recurrent Neural Networks,” Neurocomputing, Vol.292, pp. 104-110, 2018. https://doi.org/10.1016/j.neucom.2018.02.076
- [19] Z. Wang, S. Muknahallipatna, M. Fan, A. Okray, and C. Lan, “Music classification using an improved CRNN with multi-directional spatial dependencies in both time and frequency dimensions,” 2019 Int. Jt. Conf. Neural Netw. (IJCNN), 2019. https://doi.org/10.1109/IJCNN.2019.8852128
- [20] R. Yang, L. Feng, H. Wang, J. Yao, and S. Luo, “Parallel recurrent convolutional neural networks-based music genre classification method for mobile devices,” IEEE Access, Vol.8, pp. 19629-19637, 2020. https://doi.org/10.1109/ACCESS.2020.2968170
This article is published under a Creative Commons Attribution-NoDerivatives 4.0 Internationa License.