Research Paper:
Enhanced Stance Detection for Arabic Tweets
Abeer Almasoudi, Muhammad Arif
, Ahlam Hashem, and Esraa Samkari

Department of Computer Science and Artificial Intelligence, Umm Al-Qura University
Abdiyah, Makkah 75650, Saudi Arabia
Corresponding author
Social media platforms are becoming increasingly integrated into daily life, enabling individuals to express their beliefs and perspectives. Stance detection is an automated process for determining the viewpoint of a text on a particular topic; this is in high demand because of the increasing number of texts on social media. Most stance detection research has focused on the English language. Recent efforts have been made to generate datasets for stance detection in languages other than English. However, no comparable initiatives exist in Arabic. This study utilized the MAWQIF dataset and sequential multi-task learning (SMTL), which combines sarcasm detection and sentiment analysis tasks to enhance stance detection performance. In our SMTL, task dependency modeling is employed to establish a flow of information from the sarcasm task to the sentiment task, and then from these two tasks to the stance detection task, ensuring that the stance detection task benefits from the information derived from sarcasm and sentiment. Many experiments have been conducted to investigate the performance of multi-target classifiers in comparison to target-specific classifiers, as well as the impact of training order on the task. State-of-the-art performance is achieved by the multi-target SMTL model, which utilizes a hierarchical task weighting technique. This model was initially trained on the sarcasm task and then further trained on sentiment. The average F1 score on the testing dataset was 88.3%, which was better than the published results. Our study highlights the importance of multi-task learning in stance detection and investigates the relationship between sentiment, sarcasm, and stance.
- [1] S. Mohammad, S. Kiritchenko, P. Sobhani, X. Zhu, and C. Cherry, “SemEval-2016 Task 6: Detecting Stance in Tweets,” Proc. of the 10th Int. Workshop on Semantic Evaluation (SemEval-2016), pp. 31-41, 2016. https://doi.org/10.18653/v1/S16-1003
- [2] P. Sobhani, D. Inkpen, and X. Zhu, “A Dataset for Multi-Target Stance Detection,” Proc. of the 15th Conf. of the European Chapter of the Association for Computational Linguistics, Vol.2, Short Papers, pp. 551-557, 2017.
- [3] A. AlDayel and W. Magdy, “Stance detection on social media: State of the art and trends,” Information Processing & Management, Vol.58, Issue 4, Article No.102597, 2021. https://doi.org/10.1016/j.ipm.2021.102597
- [4] M. Tutek, I. Sekulić, P. Gombar, I. Paljak, F. Čulinović, F. Boltužić, V. M. Karan, D. Alagić, and J. Šnajder, “TakeLab at SemEval-2016 Task 6: Stance Classification in Tweets Using a Genetic Algorithm Based Ensemble,” Proc. of the 10th Int. Workshop on Semantic Evaluation (SemEval-2016), pp. 464-468, 2016. https://doi.org/10.18653/v1/S16-1075
- [5] N. Alturayeif, H. Luqman, and M. Ahmed, “A systematic review of machine learning techniques for stance detection and its applications,” Neural Computing and Applications, Vol.35, No.7, pp. 5113-5144, 2023. https://doi.org/10.1007/s00521-023-08285-7
- [6] I. Alsmadi, I. Alazzam, M. Al-Ramahi, and M. Zarour, “Stance Detection in the Context of Fake News—A New Approach,” Future Internet, Vol.16, Issue 10, Article No.364, 2024. https://doi.org/10.3390/fi16100364
- [7] L. Derczynski, K. Bontcheva, M. Liakata, R. Procter, G. W. S. Hoi, and A. Zubiaga, “SemEval-2017 Task 8: RumourEval: Determining rumour veracity and support for rumours,” Proc. of the 11th Int. Workshop on Semantic Evaluation (SemEval-2017), pp. 69-76, 2017. https://doi.org/10.18653/v1/S17-2006
- [8] N. S. Alturayeif, H. A. Luqman, and M. A. K. Ahmed, “MAWQIF: A Multi-label Arabic Dataset for Target-specific Stance Detection,” Proc. of the 7th Arabic Natural Language Processing Workshop (WANLP), pp. 174-184, 2022. https://doi.org/10.18653/v1/2022.wanlp-1.16
- [9] R. Wang, D. Zhou, M. Jiang, J. Si, and Y. Yang, “A Survey on Opinion Mining: From Stance to Product Aspect,” IEEE Access, Vol.7, pp. 41101-41124, 2019. https://doi.org/10.1109/ACCESS.2019.2906754
- [10] G. Zarrella and A. Marsh, “MITRE at SemEval-2016 Task 6: Transfer Learning for Stance Detection,” Proc. of the 10th Int. Workshop on Semantic Evaluation (SemEval-2016), pp. 458-463, 2016. https://doi.org/10.18653/v1/S16-1074
- [11] I. Augenstein, T. Rocktäschel, A. Vlachos, and K. Bontcheva, “Stance Detection with Bidirectional Conditional Encoding,” Proc. of the 2016 Conf. on Empirical Methods in Natural Language Processing, pp. 876-885, 2016. https://doi.org/10.18653/v1/D16-1084
- [12] S. M. Mohammad, P. Sobhani, and S. Kiritchenko, “Stance and sentiment in tweets,” ACM Trans. on Internet Technology (TOIT), Vol.17, Issue 3, Article No.26, 2017. https://doi.org/10.1145/3003433
- [13] G. Gadek, J. Betsholtz, A. Pauchet, S. Brunessaux, N. Malandain, and L. Vercouter, “Extracting Contextonyms from Twitter for Stance Detection,” Proc. of the 9th Int. Conf. on Agents and Artificial Intelligence (ICAART), Vol.1, pp. 132-141, 2017. https://doi.org/10.5220/0006190901320141
- [14] K. Dey, R. Shrivastava, and S. Kaushik, “Twitter Stance Detection—A Subjectivity and Sentiment Polarity Inspired Two-Phase Approach,” 2017 IEEE Int. Conf. on Data Mining Workshops (ICDMW), pp. 365-372, 2017. https://doi.org/10.1109/ICDMW.2017.53
- [15] M. Lai, D. I. H. Farías, V. Patti, and P. Rosso, “Friends and Enemies of Clinton and Trump: Using Context for Detecting Stance in Political Tweets,” Advances in Computational Intelligence: 15th Mexican Int. Conf. on Artificial Intelligence, Part I, pp. 155-168, 2017. https://doi.org/10.1007/978-3-319-62434-1_13
- [16] J. Du, R. Xu, Y. He, and L. Gui, “Stance Classification With Target-Specific Neural Attention Networks,” Proc. of the 26th Int. Joint Conf. on Artificial Intelligence (IJCAI), pp. 3988-3994, 2017. https://doi.org/10.24963/ijcai.2017/557
- [17] K. Dey, R. Shrivastava, and S. Kaushik, “Topical Stance Detection for Twitter: A Two-Phase LSTM Model Using Attention,” Advances in Information Retrieval: 40th European Conf. on IR Research (ECIR) 2018, pp. 529-536, 2018. https://doi.org/10.1007/978-3-319-76941-7_40
- [18] W. Wei, X. Zhang, X. Liu, W. Chen, and T. Wang, “pkudblab at SemEval-2016 Task 6: A Specific Convolutional Neural Network System for Effective Stance Detection,” Proc. of the 10th Int. Workshop on Semantic Evaluation (SemEval-2016), pp. 384-388, 2016. https://doi.org/10.18653/v1/S16-1062
- [19] Y. Igarashi, H. Komatsu, S. Kobayashi, N. Okazaki, and K. Inui, “Tohoku at SemEval-2016 Task 6: Feature-based Model versus Convolutional Neural Network for Stance Detection,” Proc. of the 10th Int. Workshop on Semantic Evaluation (SemEval-2016), pp. 401-407, 2016. https://doi.org/10.18653/v1/S16-1065
- [20] A. Sen, M. Sinha, S. Mannarswamy, and S. Roy, “Stance classification of multi-perspective consumer health information,” Proc. of the ACM India Joint Int. Conf. on Data Science and Management of Data, pp. 273-281, 2018. https://doi.org/10.1145/3152494.3152518
- [21] D. S. Chauhan, R. Kumar, and A. Ekbal, “Attention Based Shared Representation for Multi-task Stance Detection and Sentiment Analysis,” 26th Int. Conf. on Neural Information Processing (ICONIP 2019), Part V, pp. 661-669, 2019. https://doi.org/10.1007/978-3-030-36802-9_70
- [22] D. Hazarika, G. Krishnamurthy, S. Poria, and R. Zimmermann, “Multi-task Learning for Detecting Stance in Tweets,” Int. Conf. on Computational Linguistics and Intelligent Text Processing, pp. 222-235, 2019. https://doi.org/10.1007/978-3-031-24340-0_17
- [23] T. Alqurashi, “Stance Analysis of Distance Education in the Kingdom of Saudi Arabia during the COVID-19 Pandemic Using Arabic Twitter Data,” Sensors, Vol.22, Issue 3, Article No.1006, 2022. https://doi.org/10.3390/s22031006
- [24] J. Khouja, “Stance Prediction and Claim Verification: An Arabic Perspective,” Proc. of the 3rd Workshop on Fact Extraction and VERification (FEVER), pp. 8-17, 2020. https://doi.org/10.18653/v1/2020.fever-1.2
- [25] R. Baly, M. Mohtarami, J. Glass, L. Màrquez, A. Moschitti, and P. Nakov, “Integrating Stance Detection and Fact Checking in a Unified Corpus,” Proc. of the 2018 Conf. of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Vol.2 (Short Papers), pp. 21-27, 2018. https://doi.org/10.18653/v1/N18-2004
- [26] S. M. Alzanin, A. Gumaei, M. A. Haque, and A. Y. Muaad, “An Optimized Arabic Multilabel Text Classification Approach Using Genetic Algorithm and Ensemble Learning,” Applied Sciences, Vol.13, Issue 18, Article No.10264, 2023. https://doi.org/10.3390/app131810264
- [27] M. M. Jaziriyan, A. Akbari, and H. Karbasi, “ExaASC: A General Target-Based Stance Detection Corpus in Arabic Language,” 11th Int. Conf. on Computer Engineering and Knowledge (ICCKE), pp. 424-429, 2021.
- [28] H. Mubarak, S. Hassan, S. A. Chowdhury, and F. Alam, “ArCovidVac: Analyzing Arabic Tweets About COVID-19 Vaccination,” Proc. of the 13th Language Resources and Evaluation Conf., pp. 3220-3230, 2022.
- [29] M. Ibrahim, “CUFE at StanceEval2024: Arabic Stance Detection with Fine-Tuned Llama-3 Model,” Proc. of the 2nd Arabic Natural Language Processing Conf., pp. 807-810, 2024. https://doi.org/10.18653/v1/2024.arabicnlp-1.93
- [30] R. K. AlRowais and D. Alsaeed, “Arabic stance detection of COVID-19 vaccination using transformer-based approaches: A comparison study,” Arab Gulf J. of Scientific Research, Vol.42, Issue 4, pp. 1319-1339, 2024. https://doi.org/10.1108/AGJSR-01-2023-0001
- [31] N. Alturayeif, H. Luqman, and M. Ahmed, “Enhancing stance detection through sequential weighted multi-task learning,” Social Network Analysis and Mining, Vol.14, No.1, Article No.7, 2023. https://doi.org/10.1007/s13278-023-01169-7
- [32] M. Badran, M. Hamdy, M. Torki, and N. El-Makky, “AlexUNLP-BH at StanceEval2024: Multiple Contrastive Losses Ensemble Strategy with Multi-Task Learning for Stance Detection in Arabic,” Proc. of the 2nd Arabic Natural Language Processing Conf., pp. 823-827, 2024. https://doi.org/10.18653/v1/2024.arabicnlp-1.96
- [33] A. Hasanaath and A. Alansari, “StanceCrafters at StanceEval2024: Multi-task Stance Detection using BERT Ensemble with Attention Based Aggregation,” Proc. of the 2nd Arabic Natural Language Processing Conf., pp. 811-815, 2024. https://doi.org/10.18653/v1/2024.arabicnlp-1.94
- [34] P. Gera and T. Neal, “A Comparative Analysis of Stance Detection Approaches and Datasets,” Proc. of the 3rd Workshop on Evaluation and Comparison of NLP Systems, pp. 58-69, 2022. https://doi.org/10.18653/v1/2022.eval4nlp-1.7
- [35] S. Ghosh, P. Singhania, S. Singh, K. Rudra, and S. Ghosh, “Stance Detection in Web and Social Media: A Comparative Study,” Experimental IR Meets Multilinguality, Multimodality, and Interaction: 10th Int. Conf. of the CLEF Association, pp. 75-87, 2019. https://doi.org/10.1007/978-3-030-28577-7_4
- [36] M. Mets, A. Karjus, I. Ibrus, and M. Schich, “Automated stance detection in complex topics and small languages: The challenging case of immigration in polarizing news media,” PLOS one, Vol.19, No.4, Article No.e0302380, 2024. https://doi.org/10.1371/journal.pone.0302380
- [37] Y. Wu, M. Schuster, Z. Chen, Q. V. Le, M. Norouzi, W. Macherey, M. Krikun, Y. Cao, Q. Gao, K. Macherey et al., “Google’s Neural Machine Translation System: Bridging the Gap between Human and Machine Translation,” arXiv preprint, arXiv:1609.08144, 2016. https://doi.org/10.48550/arXiv.1609.08144
This article is published under a Creative Commons Attribution-NoDerivatives 4.0 Internationa License.