Research Paper:
MRI Imaging Recognition Model for Spinal Lesions Based on Multiple Attention Mechanism
Hui Zhou*,
, Hong Zhu*
, Xinjing Song*, Peng Chen**,
, Yuan Wang***,
, and Xiangji Liu***
*School of Software, Dalian Neusoft University of Information
No.8 Software Park Road, Ganjingzi District, Dalian, Liaoning 116023, China
**Navigation College, Dalian Maritime University
No.1 Linghai Road, Dalian, Liaoning 116026, China
***The Second Affiliated Hospital, Dalian Medical University
No.467 Zhongshan Road, Shahekou District, Dalian, Liaoning 116044, China
Corresponding author
Manual detection of spinal pathologies is a labor-intensive process that relies heavily on clinical expertise; thus the development of automated identification systems is clinically imperative. However, distinguishing among spinal lesions—specifically spinal tumors, spinal brucellosis (a rare infectious disease), and spinal tuberculosis—presents a significant challenge due to their high radiological mimicry. These conditions share overlapping imaging features, including vertebral bone destruction, intervertebral space narrowing, and paravertebral soft tissue swelling. Furthermore, the extent of the lesions and the specific vertebral segments involved lack fixed patterns, leading to frequent feature confusion. To address these issues, we propose an improved computational framework. Firstly, we introduce a bidirectional feature pyramid network backbone based on ResNet-101. Deformable convolution is employed instead of traditional convolution across various layers to extract richer semantic features. Concurrently, multiple attention mechanisms, including self-attention and soft attention, are integrated into different modules to effectively fuse the most informative feature components. Finally, an improved balanced cross-entropy loss function is implemented to mitigate the data imbalance issue arising from the rarity of both spinal tumors and brucellosis. The proposed model was validated on a clinical dataset comprising MRI images from 135 patients. Experimental results demonstrate that the model outperforms other classical models in multiple core performance metrics. Specifically, the model achieved an accuracy of 96.6%, precision of 94.2%, recall of 90.8%, and an F1-score of 92.5%. This work provides reliable technical support for the precise diagnosis of spinal tumors, spinal brucellosis, and spinal tuberculosis.
- [1] X. Chen, Y. Sun, J. Ju, and Y. Zheng, “Diagonistic and prognostic analysis of olfactory neuroblastoma,” J. Clin. Otorhinolaryngol. Head Neck Surg., Vol.35, No.3, pp. 224-228, 2021 (in Chinese). https://doi.org/10.13201/j.issn.2096-7993.2021.03.007
- [2] P. Klimo, Jr. and M. H. Schmidt, “Surgical management of spinal metastases,” Oncologist, Vol.9, No.2, pp. 188-196, 2004. https://doi.org/10.1634/theoncologist.9-2-188
- [3] D. M. Sciubba et al., “Diagnosis and management of metastatic spine disease: A review,” J. Neurosurg. Spine, Vol.13, No.1, pp. 94-108, 2010. https://doi.org/10.3171/2010.3.SPINE09202
- [4] A. Hosny et al., “Deep learning for lung cancer prognostication: A retrospective multi-cohort radiomics study,” PLOS Med., Vol.15, No.11, Article No.e1002711, 2018. https://doi.org/10.1371/journal.pmed.1002711
- [5] S. Boriani, J. N. Weinstein, and R. Biagini, “Primary bone tumors of the spine: Terminology and surgical staging,” Spine, Vol.22, No.9, pp. 1036-1044, 1997. https://doi.org/10.1097/00007632-199705010-00020
- [6] A. Mesfin, M. H. El Dafrawy, A. Jain, H. Hassanzadeh, and K. M. Kebaish, “Total en bloc spondylectomy for primary and metastatic spine tumors,” Orthopedics, Vol.38, No.11, pp. e995-e1000, 2015. https://doi.org/10.3928/01477447-20151020-08
- [7] Y. Li and W. Ping, “Cancer metastasis detection with neural conditional random field,” arXiv:1806.07064, 2018. https://doi.org/10.48550/arXiv.1806.07064
- [8] Q. Shao, L. Gong, K. Ma, H. Liu, and Y. Zheng, “Attentive CT lesion detection using deep pyramid inference with Multi-Scale Booster,” Proc. 22nd Int. Conf. Med. Image Comput. Comput.-Assist. Interv. (MICCAI 2019), Part VI, pp. 301-309, 2019. https://doi.org/10.1007/978-3-030-32226-7_34
- [9] M. I. Sharif, M. A. Khan, M. Alhussein, K. Aurangzeb, and M. Raza, “A decision support system for multimodal brain tumor classification using deep learning,” Complex Intell. Syst., Vol.8, No.4, pp. 3007-3020, 2022. https://doi.org/10.1007/s40747-021-00321-0
- [10] J. Coburger et al., “Low-grade glioma surgery in intraoperative magnetic resonance imaging: Results of a multicenter retrospective assessment of the German Study Group for Intraoperative Magnetic Resonance Imaging,” Neurosurgery, Vol.78, No.6, pp. 775-786, 2016. https://doi.org/10.1227/NEU.0000000000001081
- [11] N. Lang et al., “Differentiation of spinal metastases originated from lung and other cancers using radiomics and deep learning based on DCE-MRI,” Magn. Reson. Imaging, Vol.64, pp. 4-12, 2019. https://doi.org/10.1016/j.mri.2019.02.013
- [12] V. Chianca et al., “Radiomic machine learning classifiers in spine bone tumors: A multi-software, multi-scanner study,” Eur. J. Radiol., Vol.137, Article No.109586, 2021. https://doi.org/10.1016/j.ejrad.2021.109586
- [13] J. O. B. Diniz, P. H. B. Diniz, T. L. A. Valente, A. C. Silva, and A. C. Paiva, “Spinal cord detection in planning CT for radiotherapy through adaptive template matching, IMSLIC and convolutional neural networks,” Comput. Methods Programs Biomed., Vol.170, pp. 53-67, 2019. https://doi.org/10.1016/j.cmpb.2019.01.005
- [14] Z. Li et al., “Computer-aided diagnosis of spinal tuberculosis from CT images based on deep learning with multimodal feature fusion,” Front. Microbiol., Vol.13, Article No.823324, 2022. https://doi.org/10.3389/fmicb.2022.823324
- [15] S. R. S. Arends et al., “Clinical utility of convolutional neural networks for treatment planning in radiotherapy for spinal metastases,” Phys. Imaging Radiat. Oncol., Vol.21, pp. 42-47, 2022. https://doi.org/10.1016/j.phro.2022.02.003
- [16] J. Olczak et al., “Artificial intelligence for analyzing orthopedic trauma radiographs,” Acta Orthop., Vol.88, No.6, pp. 581-586, 2017. https://doi.org/10.1080/17453674.2017.1344459
- [17] S. L. Goldenberg, G. Nir, and S. E. Salcudean, “A new era: Artificial intelligence and machine learning in prostate cancer,” Nat. Rev. Urol., Vol.16, No.7, pp. 391-403, 2019. https://doi.org/10.1038/s41585-019-0193-3
- [18] G. Ghiasi, T.-Y. Lin, and Q. V. Le, “NAS-FPN: Learning scalable feature pyramid architecture for object detection,” Proc. 2019 IEEE/CVF Conf. Comput. Vis. Pattern Recognit. (CVPR), pp. 7029-7038, 2019. https://doi.org/10.1109/CVPR.2019.00720
- [19] Y.-L. Tian, Y.-T. Wang, J.-G. Wang, X. Wang, and F.-Y. Wang, “Key problems and progress of vision Transformers: The state of the art and prospects,” Acta Autom. Sin., Vol.48, No.4, pp. 957-979, 2022 (in Chinese). https://doi.org/10.16383/j.aas.c220027
- [20] L. Wen, X. Li, X. Li, and L. Gao, “A new transfer learning based on VGG-19 network for fault diagnosis,” 2019 IEEE 23rd Int. Conf. Comput. Support. Coop. Work Des. (CSCWD), pp. 205-209, 2019. https://doi.org/10.1109/CSCWD.2019.8791884
- [21] Y. Zhu and S. Newsam, “DenseNet for dense flow,” 2017 IEEE Int. Conf. Image Process. (ICIP), pp. 790-794, 2017. https://doi.org/10.1109/ICIP.2017.8296389
- [22] M. Kang, X. Leng, Z. Lin, and K. Ji, “A modified faster R-CNN based on CFAR algorithm for SAR ship detection,” 2017 Int. Workshop Remote Sens. Intell. Process. (RSIP), 2017. https://doi.org/10.1109/RSIP.2017.7958815
- [23] J. Dai et al., “Deformable convolutional networks,” 2017 IEEE Int. Conf. Comput. Vis. (ICCV), pp. 764-773, 2017. https://doi.org/10.1109/ICCV.2017.89
- [24] G. Wang et al., “UAV-YOLOv8: A small-object-detection model based on improved YOLOv8 for UAV aerial photography scenarios,” Sensors, Vol.23, No.16, Article No.7190, 2023. https://doi.org/10.3390/s23167190
- [25] Y. Chen, J. Wang, Y. Zhang, Y. Liu, and J. Wang, “P2RNet: Fast maritime object detection from key points to region proposals in large-scale remote sensing images,” IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens., Vol.17, pp. 9294-9308, 2024. https://doi.org/10.1109/JSTARS.2024.3392635
- [26] Y. Liu et al., “Image semantic segmentation approach based on DeepLabV3 plus network with an attention mechanism,” Eng. Appl. Artif. Intell., Vol.127, Part A, Article No.107260, 2024. https://doi.org/10.1016/j.engappai.2023.107260
- [27] Z. Zhou, M. M. R. Siddiquee, N. Tajbakhsh, and J. Liang, “UNet++: A nested U-Net architecture for medical image segmentation,” Proc. 4th Int. Workshop Deep Learn. Med. Image Anal. 8th Multimodal Learn. Clin. Decis. Support (DLMIA/ML-CDS 2018), pp. 3-11, 2018. https://doi.org/10.1007/978-3-030-00889-5_1
- [28] X. Du et al., “SpineNet: Learning scale-permuted backbone for recognition and localization,” 2020 IEEE/CVF Conf. Comput. Vis. Pattern Recognit. (CVPR), pp. 11589-11598, 2020. https://doi.org/10.1109/CVPR42600.2020.01161
- [29] H. Law and J. Deng, “CornerNet: Detecting objects as paired keypoints,” Int. J. Comput. Vis., Vol.128, No.3, pp. 642-656, 2020. https://doi.org/10.1007/s11263-019-01204-1
- [30] Y. Zhao et al., “DETRs beat YOLOs on real-time object detection,” 2024 IEEE/CVF Conf. Comput. Vis. Pattern Recognit. (CVPR), pp. 16965-16974, 2024. https://doi.org/10.1109/CVPR52733.2024.01605
This article is published under a Creative Commons Attribution-NoDerivatives 4.0 Internationa License.