Research Paper:
A Feature Fusion Method for IMU and sEMG Signals Based on Modal Reliability Weighting
Juan Zhao*1,*2
, Qin Peng*1,*3,*4
, Jie Chen*5,*6
, Seiichi Kawata*1,*3,*4
, and Jinhua She*7,

*1School of Artificial Intelligence and Automation, China University of Geosciences
No.388 Lumo Road, Hongshan District, Wuhan, Hubei 430074, China
*2Engineering Innovation Training Center, China University of Geosciences
No.388 Lumo Road, Hongshan District, Wuhan, Hubei 430074, China
*3Hubei Key Laboratory of Advanced Control and Intelligent Automation for Complex Systems
No.388 Lumo Road, Hongshan District, Wuhan, Hubei 430074, China
*4Engineering Research Center of Intelligent Technology for Geo-Exploration, Ministry of Education
No.300 Lumo Road, Hongshan District, Wuhan, Hubei 430074, China
*5Xiangjiang Laboratory, Changsha
Changsha, Hunan 410000, China
*6School of Computer Science, Hunan University of Technology and Business
No.569 Yuelu Avenue, Changsha, Hunan 410205, China
*7School of Engineering, Tokyo University of Technology
1404-1 Katakuramachi, Hachioji, Tokyo 192-0982, Japan
Corresponding author
Gait analysis has become a critical means of evaluating motor function by analyzing kinematic and physiological information during human locomotion. Inertial measurement unit (IMU) and surface electromyography (sEMG) are extensively utilized in gait data acquisition and gait analysis for their compact size and ease of wear. However, the single-modality sensors exhibit certain limitations in information representation and features of different modalities are often utilized unevenly during multimodal data fusion, which affect the robustness of fusion features. This paper presents a feature fusion method for IMU and sEMG signals based on modal reliability weighting. The method analyzes the statistical stability of features of different modalities to evaluate their reliability quantitatively and allocates fusion weights adaptively to achieve weighted feature fusion. Experimental results demonstrate that the presented method outperforms other feature fusion methods, such as equal fusion and single-modality analysis, in terms of classification accuracy and feature stability in the activity classification task. It also provides a promising and practical strategy for multimodal gait analysis and rehabilitation assessment.
- [1] G. Cicirelli et al., “Human gait analysis in neurodegenerative diseases: A review,” IEEE J. Biomed. Health Inform., Vol.26, No.1, pp. 229-242, 2022. https://doi.org/10.1109/JBHI.2021.3092875
- [2] A. A. Carmo, A. F. R. Kleiner, P. H. Lobo da Costa, and R. M. L. Barros, “Three-dimensional kinematic analysis of upper and lower limb motion during gait of post-stroke patients,” Braz. J. Med. Biol. Res., Vol.45, No.6, pp. 537-545, 2012. https://doi.org/10.1590/S0100-879X2012007500051
- [3] M. Bonanno et al., “Gait analysis in neurorehabilitation: From research to clinical practice,” Bioengineering, Vol.10, No.7, Article No.785, 2023. https://doi.org/10.3390/bioengineering10070785
- [4] V. B. Semwal, N. Gaud, P. Lalwani, V. Bijalwan, and A. K. Alok, “Pattern identification of different human joints for different human walking styles using inertial measurement unit (IMU) sensor,” Artif. Intell. Rev., Vol.55, No.2, pp. 1149-1169, 2022. https://doi.org/10.1007/s10462-021-09979-x
- [5] X. Ru, N. Gu, H. Shang, and H. Zhang, “MEMS inertial sensor calibration technology: Current status and future trends,” Micromachines, Vol.13, No.6, Article No.879, 2022. https://doi.org/10.3390/mi13060879
- [6] S. R. Estévez, J. Mallah, D. Kazieczko, C. Tang, and L. G. Occhipinti, “Deep learning for motion classification in ankle exoskeletons using surface EMG and IMU signals,” Sci. Rep., Vol.15, Article No.38242, 2025. https://doi.org/10.1038/s41598-025-22103-1
- [7] Y. Chen et al., “Biomechanical monitoring of exercise fatigue using wearable devices: A review,” Bioengineering, Vol.13, No.1, Article No.13, 2026. https://doi.org/10.3390/bioengineering13010013
- [8] S. M. Sid’El Moctar, I. Rida, and S. Boudaoud, “Comprehensive review of feature extraction techniques for sEMG signal classification: From handcrafted features to deep learning approaches,” IRBM, Vol.45, No.6, Article No.100866, 2024. https://doi.org/10.1016/j.irbm.2024.100866
- [9] Y. Lu, J. Zhu, W. Chen, and X. Ma, “An IMU-based real-time gait detection method for intelligent control of knee assistive devices,” IEEE Trans. Instrum. Meas., Vol.72, Article No.2532309, 2023. https://doi.org/10.1109/TIM.2023.3329222
- [10] D. H. Yoon et al., “Inertial measurement unit sensor-based gait analysis in adults and older adults: A cross-sectional study,” Gait Posture, Vol.107, pp. 212-217, 2024. https://doi.org/10.1016/j.gaitpost.2023.10.006
- [11] A. Vijayvargiya, B. Singh, R. Kumar, and J. M. R. S. Tavares, “Human lower limb activity recognition techniques, databases, challenges and its applications using sEMG signal: An overview,” Biomed. Eng. Lett., Vol.12, No.4, pp. 343-358, 2022. https://doi.org/10.1007/s13534-022-00236-w
- [12] S. De, P. Mukherjee, and A. H. Roy, “GLEAM: A multimodal deep learning framework for chronic lower back pain detection using EEG and sEMG signals,” Comput. Biol. Med., Vol.189, Article No.109928, 2025. https://doi.org/10.1016/j.compbiomed.2025.109928
- [13] Z. Zhou et al., “Lower limb motion recognition based on sEMG and CNN-TL fusion model,” Sensors, Vol.24, No.21, Article No.7087, 2024. https://doi.org/10.3390/s24217087
- [14] Q. Hu et al., “EA-Net: Edge-aware network for brain structure segmentation via decoupled high and low frequency features,” Comput. Biol. Med., Vol.150, Article No.106139, 2022. https://doi.org/10.1016/j.compbiomed.2022.106139
- [15] B. Zhou et al., “Non-invasive dual attention TCN for electromyography and motion data fusion in lower limb ambulation prediction,” J. Neural Eng., Vol.19, No.4, Article No.046051, 2022. https://doi.org/10.1088/1741-2552/ac89b4
- [16] C. Li et al., “TTCLNet: Ankle foot motion classification model based on wireless wearable sEMG and IMU sensors,” Sens. Actuators A: Phys., Vol.408, Article No.118042, 2026. https://doi.org/10.1016/j.sna.2026.118042
- [17] H. Feng et al., “Security of target recognition for UAV forestry remote sensing based on multi-source data fusion transformer framework,” Inf. Fusion, Vol.112, Article No.102555, 2024. https://doi.org/10.1016/j.inffus.2024.102555
- [18] J.-Y. Wang, Y.-H. Dai, and X.-X. Si, “Feature layer fusion of linear features and empirical mode decomposition of human EMG signal,” J. Electron. Sci. Technol., Vol.20, No.3, Article No.100169, 2022. https://doi.org/10.1016/j.jnlest.2022.100169
- [19] H. F. Nweke, Y. W. Teh, G. Mujtaba, U. R. Alo, and M. A. Al-garadi, “Multi-sensor fusion based on multiple classifier systems for human activity identification,” Hum.-Cent. Comput. Inf. Sci., Vol.9, No.1, Article No.34, 2019. https://doi.org/10.1186/s13673-019-0194-5
- [20] S. Chaabene, A. Boudaya, B. Bouaziz, and L. Chaari, “An overview of methods and techniques in multimodal data fusion with application to healthcare,” Int. J. Data Sci. Anal., Vol.20, No.4, pp. 3093-3117, 2025. https://doi.org/10.1007/s41060-025-00715-0
- [21] M. Gu, “Improved Kalman filtering and adaptive weighted fusion algorithms for enhanced multi-sensor data fusion in precision measurement,” Informatica, Vol.49, No.10, pp. 85-100, 2025. https://doi.org/10.31449/inf.v49i10.7122
- [22] G. de Alteriis et al., “Innovative fusion strategy for MEMS redundant-IMU exploiting custom 3D components,” Sensors, Vol.23, No.5, Article No.2508, 2023. https://doi.org/10.3390/s23052508
- [23] R. Chereshnev and A. Kertész-Farkas, “HuGaDB: Human gait database for activity recognition from wearable inertial sensor networks,” Proc. 6th Int. Conf. Anal. Images Soc. Netw. Texts, pp. 131-141, 2017. https://doi.org/10.1007/978-3-319-73013-4_12
- [24] V. K. Verma, K. Saxena, and U. Banodha, “Analysis effect of K values used in K fold cross validation for enhancing performance of machine learning model with decision tree,” Proc. 13th Int. Adv. Comput. Conf., Part 1, pp. 374-396, 2023. https://doi.org/10.1007/978-3-031-56700-1_30
This article is published under a Creative Commons Attribution-NoDerivatives 4.0 Internationa License.