Research Paper:
DRGCN Multitasking for Aspect-Based Sentiment Analysis
Mengyang Du*,**,*** and Hongbin Wang*,**,***,
*School of Information Engineering, Xinjiang Institute of Technology
1 Xuefu West Road, Wensu County, Aksu, Xinjiang 735400, China
**Faculty of Information Engineering and Automation, Kunming University of Science and Technology
727 Jingming South Road, Chenggong District, Kunming, Yunnan 650500, China
***Key Laboratory of Artificial Intelligence in Yunnan Province, Kunming University of Science and Technology
727 Jingming South Road, Chenggong District, Kunming, Yunnan 650500, China
Corresponding author
Existing aspect-based sentiment analysis (ABSA) methods do not sufficiently enhance multiple subtasks with syntactic knowledge in a joint framework. In this paper, we propose an ABSA method that utilizes a multitask learning framework to enhance syntactic knowledge fully. The method first builds on a dependency relation embedded graph convolutional network to learn syntactic dependencies and the dependency types between words in a sentence fully. Second, to make better use of the syntactic information between aspect and opinion words, we extend the adjacency matrix based on dependency parsing to establish the direct relationship between aspect and opinion words. Finally, an information passing mechanism is exploited to ensure that our model learns from multiple related tasks in a multitask learning framework. The results of experiments on three public datasets, namely LAP14, REST14, and REST15, show that the proposed method has better performance than the baseline method.

Utilizes a multitask learning framework
- [1] H. Peng et al., “Knowing what, how and why: A near complete solution for aspect-based sentiment analysis,” Proc. of the AAAI Conf. on Artificial Intelligence, Vol.34, No.5, pp. 8600-8607, 2020. https://doi.org/10.1609/aaai.v34i05.6383
- [2] X. Li, L. Bing, P. Li, and W. Lam, “A unified model for opinion target extraction and target sentiment prediction,” Proc. of the AAAI Conf. on Artificial Intelligence, Vol.33, No.1, pp. 6714-6721, 2019. https://doi.org/10.1609/aaai.v33i01.33016714
- [3] X. Li, L. Bing, W. Zhang, and W. Lam, “Exploiting BERT for end-to-end aspect-based sentiment analysis,” Proc. of the 5th Workshop on Noisy User-generated Text (W-NUT 2019), pp. 34-41, 2019. https://doi.org/10.18653/v1/D19-5505
- [4] R. He, W. S. Lee, H. T. Ng, and D. Dahlmeier, “An interactive multi-task learning network for end-to-end aspect-based sentiment analysis,” Proc. of the 57th Annual Meeting of the Association for Computational Linguistics, pp. 504-515, 2019. https://doi.org/10.18653/v1/P19-1048
- [5] Z. Fan, Z. Wu, X.-Y. Dai, S. Huang, and J. Chen, “Target-oriented opinion words extraction with target-fused neural sequence labeling,” Proc. of the 2019 Conf. of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Vol.1, pp. 2509-2518, 2019. https://doi.org/10.18653/v1/N19-1259
- [6] H. Luo, T. Li, B. Liu, and J. Zhang, “DOER: Dual cross-shared RNN for aspect term-polarity co-extraction,” Proc. of the 57th Annual Meeting of the Association for Computational Linguistics, pp. 591-601, 2019. https://doi.org/10.18653/v1/P19-1056
- [7] L. Xu, X. Pang, J. Wu, M. Cai, and J. Peng, “Learn from structural scope: Improving aspect-level sentiment analysis with hybrid graph convolutional networks,” Neurocomputing, Vol.518, pp. 373-383, 2023. https://doi.org/10.1016/j.neucom.2022.10.071
- [8] S. Liang, W. Wei, X.-L. Mao, F. Wang, and Z. He, “BiSyn-GAT+: Bi-Syntax Aware Graph Attention Network for aspect-based sentiment analysis,” Findings of the Association for Computational Linguistics (ACL 2022), pp. 1835-1848, 2022. https://doi.org/10.18653/v1/2022.findings-acl.144
- [9] Q. Zhong et al., “Knowledge graph augmented network towards multiview representation learning for aspect-based sentiment analysis,” IEEE Trans. on Knowledge and Data Engineering, Vol.35, No.10, pp. 10098-10111, 2023. https://doi.org/10.1109/TKDE.2023.3250499
- [10] M. H. Phan and P. O. Ogunbona, “Modelling context and syntactical features for aspect-based sentiment analysis,” Proc. of the 58th Annual Meeting of the Association for Computational Linguistics, pp. 3211-3220, 2020. https://doi.org/10.18653/v1/2020.acl-main.293
- [11] M. Schlichtkrull et al., “Modeling relational data with graph convolutional networks,” Proc. of the 15th Int. Semantic Web Conf., pp. 593-607, 2018. https://doi.org/10.1007/978-3-319-93417-4_38
- [12] M. Pontiki et al., “SemEval-2014 Task 4: Aspect based sentiment analysis,” Proc. of the 8th Int. Workshop on Semantic Evaluation, pp. 27-35, 2014. https://doi.org/10.3115/v1/S14-2004
- [13] M. Pontiki, D. Galanis, H. Papageorgiou, S. Manandhar, and I. Androutsopoulos, “SemEval-2015 Task 12: Aspect based sentiment analysis,” Proc. of the 9th Int. Workshop on Semantic Evaluation, pp. 486-495, 2015. https://doi.org/10.18653/v1/S15-2082
- [14] Y. Wang, M. Huang, X. Zhu, and L. Zhao, “Attention-based LSTM for aspect-level sentiment classification,” Proc. of the 2016 Conf. on Empirical Methods in Natural Language Processing, pp. 606-615, 2016. https://doi.org/10.18653/v1/D16-1058
- [15] J. Pennington, R. Socher, and C. Manning, “GloVe: Global vectors for word representation,” Proc. of the 2014 Conf. on Empirical Methods in Natural Language Processing, pp. 1532-1543, 2014. https://doi.org/10.3115/v1/D14-1162
- [16] W. Wang, S. J. Pan, D. Dahlmeier, and X. Xiao, “Coupled multi-layer attentions for co-extraction of aspect and opinion terms,” Proc. of the AAAI Conf. on Artificial Intelligence, Vol.31, No.1, pp. 3316-3322, 2017. https://doi.org/10.1609/aaai.v31i1.10974
- [17] H. Xu, B. Liu, L. Shu, and P. S. Yu, “Double embeddings and CNN-based sequence labeling for aspect extraction,” Proc. of the 56th Annual Meeting of the Association for Computational Linguistics, Vol.2, pp. 592-598, 2018. https://doi.org/10.18653/v1/P18-2094
- [18] R. He, W. S. Lee, H. T. Ng, and D. Dahlmeier, “Exploiting document knowledge for aspect-level sentiment classification,” Proc. of the 56th Annual Meeting of the Association for Computational Linguistics, Vol.2, pp. 579-585, 2018. https://doi.org/10.18653/v1/P18-2092
- [19] F. Wang, M. Lan, and W. Wang, “Towards a one-stop solution to both aspect extraction and sentiment analysis tasks with neural multi-task learning,” 2018 Int. Joint Conf. on Neural Networks, 2018. https://doi.org/10.1109/IJCNN.2018.8489042
- [20] B. Li et al., “Triple GNNs: Introducing syntactic and semantic information for conversational aspect-based quadruple sentiment analysis,” 27th Int. Conf. on Computer Supported Cooperative Work in Design, pp. 998-1003, 2024. https://doi.org/10.1109/CSCWD61410.2024.10580730
- [21] J. Barnes, R. Kurtz, S. Oepen, L. Øvrelid, and E. Velldal, “Structured sentiment analysis as dependency graph parsing,” arXiv:2105.14504, 2021. https://doi.org/10.48550/arXiv.2105.14504
- [22] H. Cai, R. Xia, and J. Yu, “Aspect-category-opinion-sentiment quadruple extraction with implicit aspects and opinions,” Proc. of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th Int. Joint Conf. on Natural Language Processing, Vol.1, pp. 340-350, 2021. https://doi.org/10.18653/v1/2021.acl-long.29
- [23] L. Xu, Y. K. Chia, and L. Bing, “Learning span-level interactions for aspect sentiment triplet extraction,” arXiv:2107.12214, 2021. https://doi.org/10.48550/arXiv.2107.12214
- [24] M. Eberts and A. Ulges, “Span-based joint entity and relation extraction with transformer pre-training,” 24th European Conf. on Artificial Intelligence, pp. 2006-2013, 2020. https://doi.org/10.3233/FAIA200321
- [25] W. Zhang et al., “Aspect sentiment quad prediction as paraphrase generation,” arXiv:2110.00796, 2021. https://doi.org/10.48550/arXiv.2110.00796
- [26] N. Majumder et al., “DialogueRNN: An attentive RNN for emotion detection in conversations,” Proc. of the AAAI Conf. on Artificial Intelligence, Vol.33, No.1, pp. 6818-6825, 2019. https://doi.org/10.1609/aaai.v33i01.33016818
- [27] B. Li et al., “DiaASQ: A benchmark of conversational aspect-based sentiment quadruple analysis,” Findings of the Association for Computational Linguistics (ACL 2023), pp. 13449-13467, 2023. https://doi.org/10.18653/v1/2023.findings-acl.849
This article is published under a Creative Commons Attribution-NoDerivatives 4.0 Internationa License.