single-jc.php

JACIII Vol.27 No.1 pp. 84-95
doi: 10.20965/jaciii.2023.p0084
(2023)

Review:

Beyond Sentiment Analysis: A Review of Recent Trends in Text Based Sentiment Analysis and Emotion Detection

Lai Po Hung and Suraya Alias

Universiti Malaysia Sabah
Jalan UMS, Kota Kinabalu, Sabah 88400, Malaysia

Corresponding author

Received:
September 17, 2021
Accepted:
August 23, 2022
Published:
January 20, 2023
Keywords:
sentiment analysis, emotion detection, text, machine learning, deep learning
Abstract

Sentiment Analysis is probably one of the best-known area in text mining. However, in recent years, as big data rose in popularity more areas of text classification are being explored. Perhaps the next task to catch on is emotion detection, the task of identifying emotions. This is because emotions are the finer grained information which could be extracted from opinions. So besides writer sentiments, writer emotion is also a valuable data. Emotion detection can be done using text, facial expressions, verbal communications and brain waves; however, the focus of this review is on text-based sentiment analysis and emotion detection. The internet has provided an avenue for the public to express their opinions easily. These expressions not only contain positive or negative sentiments, it contains emotions as well. These emotions can help in social behaviour analysis, decision and policy makings for companies and the country. Emotion detection can further support other tasks such as opinion mining and early depression detection. This review provides a comprehensive analysis of the shift in recent trends from text sentiment analysis to emotion detection and the challenges in these tasks. We summarize some of the recent works in the last five years and look at the methods they used. We also look at the models of emotion classes that are generally referenced. The trend of text-based emotion detection has shifted from the early keyword-based comparisons to machine learning and deep learning algorithms that provide more flexibility to the task and better performance.

Cite this article as:
L. Hung and S. Alias, “Beyond Sentiment Analysis: A Review of Recent Trends in Text Based Sentiment Analysis and Emotion Detection,” J. Adv. Comput. Intell. Intell. Inform., Vol.27 No.1, pp. 84-95, 2023.
Data files:
References
  1. [1] S. Shayaa et al., “Sentiment Analysis of Big Data: Methods, Applications, and Open Challenges,” IEEE Access, Vol.6, pp. 37807-37827, 2018. https://doi.org/10.1109/ACCESS.2018.2851311
  2. [2] K. Sailunaz and R. Alhajj, “Emotion and Sentiment Analysis from Twitter Text,” J. of Computational Science, Vol.36, Article No.101003, 2019. https://doi.org/10.1016/j.jocs.2019.05.009
  3. [3] F. Song, S. Liu, and J. Yang, “A comparative study on text representation schemes in text categorization,” Pattern Analysis and Application, Vol.8, pp. 199-209, 2005. https://doi.org/10.1007/s10044-005-0256-3
  4. [4] B. S. Harish, D. S. Guru, and S. Manjunath, “Representation and Classification of Text Documents: A Brief Review,” IJCA Special Issue on Recent Trends in Image Processing and Pattern Recognition, No.2, pp. 110-119, 2010.
  5. [5] L. P. Hung, R. Alfred, M. H. Ahmad Hijazi, and A. A. Ag. Ibrahim, “A Review on the Ensemble Framework for Sentiment Analysis,” Advanced Science Letters, Vol.21, No.10, pp. 2957-2962, 2015. https://doi.org/10.1166/asl.2015.6494
  6. [6] O. Bruna, H. Avetisyan, and J. Holub, “Emotion models for textual emotion classification,” J. of Physics: Conf. Series, Vol.772, Article No.012063, 2016. https://doi.org/10.1088/1742-6596/772/1/012063
  7. [7] K. Oatley, D. Keltner, and J. M. Jenkins, “Understanding Emotions,” Blackwell Publishing, 2006.
  8. [8] S. Lee, “A Linguistic Analysis of Implicit Emotions,” Workshop on Chinese Lexical Semantics, pp. 185-194, 2015. https://doi.org/10.1007/978-3-319-27194-1_19
  9. [9] T. Baldwin et al., “How Noisy Social Media Text, How Diffrnt Social Media Sources?,” Proc. of Int. Joint Conf. on Natural Language Processing, pp. 356-364, 2013.
  10. [10] P. Ingole, S. Bhoir, and A. V. Vidhate, “Hybrid Model for Text Classification,” Proc. of 2nd Int. Conf. on Electronics, Communication and Aerospace Technology, pp. 7-15, 2018. https://doi.org/10.1109/ICECA.2018.8474738
  11. [11] J. K. Rout et al., “A Model for Sentiment and Emotion Analysis of Unstructured Social Media Text,” Electron. Commer. Res., Vol.18, pp. 181-199, 2018. https://doi.org/10.1109/MIS.2013.30
  12. [12] H. Saif, F. J. Ortega, M. Fernandez, and I. Cantador, “Sentiment Analysis in Social Streams,” Chapter in Emotions and Personality in Personalized Services, 2016. https://doi.org/10.1007/978-3-319-31413-6_7
  13. [13] F. Kateb and J. Kalita, “Classifying Short Text in Social Media: Twitter as Case Study,” Int. J. of Computer Applications, Vol.111, No.9, pp. 1-12, 2015. https://doi.org/10.5120/19563-1321
  14. [14] E. Kauffmann, J. Peral, D. Gil, A. Ferrández, R. Sellers, and H. Mora, “A framework for big data analytics in commercial social networks: A case study on sentiment analysis and fake review detection for marketing decision-making,” Industrial Marketing Management, Vol.90, pp. 523-537, 2020. https://doi.org/10.1016/j.indmarman.2019.08.003
  15. [15] L. Holla and K. Kavitha, “A comparative study on fake review detection techniques,” Int. J. of Engineering Research in Computer Science and Engineering (IJERCSE), Vol.5, No.4, 2018.
  16. [16] T. Hai, K. Shirai, and J. Velcin, “Sentiment analysis on social media for stock movement prediction,” Expert Syst. Appl., Vol.42, No.24, pp. 9603-9611, 2015. https://doi.org/10.1016/j.eswa.2015.07.052
  17. [17] R. Ren and D. D. Wu, “Forecasting stock market movement direction using sentiment analysis and support vector machine,” IEEE Syst. J., Vol.13, No.1, pp. 760-770, 2019. https://doi.org/10.1109/JSYST.2018.2794462
  18. [18] S. Sohangir, D. Wang, A. Pomeranets, and T. M. Khoshgoftaar, “Big Data: Deep Learning for Financial Sentiment Analysis,” J. of Big Data, Vol.5, No.3, 2018. https://doi.org/10.1186/s40537-017-0111-6
  19. [19] E. Georgiadou, S. Angelopoulos, and H. Drake, “Big data analytics and international negotiations: Sentiment analysis of Brexit negotiating outcomes,” Int. J. of Information Management, Vol.51, Article No.102048, 2020. https://doi.org/10.1016/j.ijinfomgt.2019.102048
  20. [20] J. R. Ragini, P. M. R. Anand, and V. Bhaskar, “Big data analytics for disaster response and recovery through sentiment analysis,” Int. J. of Information Management, Vol.42, pp. 13-24, 2018. https://doi.org/10.1016/j.ijinfomgt.2018.05.004
  21. [21] P. Turney, “Thumbs Up or Thumbs Down?: Semantic Orientation Applied to Unsupervised Classification of Reviews,” Proc. of the 40th Annual Meeting on Association for Computational Linguistics, pp. 417-424, 2002. https://doi.org/10.3115/1073083.1073153
  22. [22] A. M. Popescu and O. Etzioni, “Extracting Product Features and Opinions from Reviews,” Proc. of the Conf. on Human Language Technology and Empirical Methods in Natural Language Processing, pp. 339-346, 2005. https://doi.org/10.3115/1220575.1220618
  23. [23] B. Pang, L. Lee, and S. Vaithyanathan, “Thumbs Up? Sentiment Classification Using Machine Learning Techniques,” Proc. of the Conf. on Empirical Methods in Natural Language Processing (EMNLP), pp. 79-86, 2002. https://aclanthology.org/W02-1011
  24. [24] O. Appel, F. Chiclana, J. Carter, and H. Fujita, “A hybrid approach to the sentiment analysis problem at the sentence level,” Knowledge-Based Systems, Vol.108, pp. 110-124, 2016. https://doi.org/10.1016/j.knosys.2016.05.040
  25. [25] F. Khan, U. Qamar, and S. Bashir, “eSAP: A decision support framework for enhanced sentiment analysis and polarity classification,” Information Sciences, Vol.367-368, pp. 862-873, 2016. https://doi.org/10.1016/j.ins.2016.07.028
  26. [26] D. Tang et al., “Sentiment Embeddings with Applications to Sentiment Analysis,” IEEE Trans. on Knowledge and Data Engineering, Vol.28, No.2, pp. 496-509, 2016. https://doi.org/10.1109/TKDE.2015.2489653
  27. [27] A. Tripathy, A. Agrawal, and S. K. Rath, “Classification of sentiment reviews using N-gram machine learning approach,” Expert Systems with Applications, Vol.57, pp. 117-126, 2016. https://doi.org/10.1016/j.eswa.2016.03.028
  28. [28] S. Poria, I. Chaturvedi, E. Cambria, and A. Hussain, “Convolutional MKL Based Multimodal Emotion Recognition and Sentiment Analysis,” Proc. of 2016 IEEE 16th Int. Conf. on Data Mining, pp. 439-448, 2016. https://doi.org/10.1109/ICDM.2016.0055
  29. [29] A. Onan, S. Korukoglu, and H. Bulut, “A Multiobjective Weighted Voting Ensemble Based on Differential Evolution Algorithm for Text Sentiment Classification,” Expert Systems with Applications, Vol.62, pp. 1-16, 2016. https://doi.org/10.1016/j.eswa.2016.06.005
  30. [30] M. T. Al-Sharuee, F. Liu, and M. Pratama, “Sentiment Analysis: An Automatic Contextual Analysis and Ensemble Clustering Approach and Comparison,” Data & Knowledge Engineering, Vol.115, pp. 194-213, 2018. https://doi.org/10.1016/j.datak.2018.04.001
  31. [31] S. Xiong, H. Lv, W. Zhao, and D. Ji, “Towards Twitter sentiment classification by multi-level sentiment-enriched word embeddings,” Neurocomputing, Vol.275, pp. 2459-2466, 2018. https://doi.org/10.1016/j.neucom.2017.11.023
  32. [32] N. S. Ankit, “An Ensemble Classification System for Twitter Sentiment Analysis,” Proc. of Int. Conf. on Computational Intelligence and Data Science (ICCIDS 2018), pp. 937-946, 2018. https://doi.org/10.1016/j.procs.2018.05.109
  33. [33] J. Akilandeswari and G. Jothi, “Sentiment Classification of Tweets with Non-Language Features,” Procedia Computer Science, Vol.143, pp. 426-433, 2018. https://doi.org/10.1016/j.procs.2018.10.414
  34. [34] A. S. Imran, S. M. Daudpota, Z. Kastrati, and R. Batra, “Cross-Cultural Polarity and Emotion Detection Using Sentiment Analysis and Deep Learning on COVID-19 Related Tweets,” IEEE Access, Vol.8, pp. 181074-181090, 2020. https://doi.org/10.1109/ACCESS.2020.3027350
  35. [35] E. Ohman, M. Pamies, K. Kajava, and J. Tiedemanm, “XED: A Multilingual Dataset for Sentiment Analysis and Emotion Detection,” Proc. of the 28th Int. Conf. on Computational Linguitics, 2020. https://doi.org/10.18653/v1/2020.coling-main.575
  36. [36] Scholarly Analysis, https://www.lens.org/lens/search/scholar/analysis?q=sentiment%20analysis%20and%20emotion%20detection&preview=true&publishedDate.from=2016-01-01&publishedDate.to=2021-12-31 [Accessed August 24, 2021]
  37. [37] P. Ekman, “Basic Emotions,” Handb. Cogn. Emot., pp. 45-60, 1999.
  38. [38] R. Plutchik, “The Nature of Emotions,” Am. Sci., Vol.89, No.4, pp. 344-350, 2001.
  39. [39] W. G. Parrott, “Emotions in Social Psychology: Essential Readings,” Psychology Press, 2001.
  40. [40] P. Shaver et al., “Emotion knowledge: Further exploration of a prototype approach,” J. Pers. Soc. Psychol., Vol.52, No.6, Article No.1061, 1987. https://doi.org/10.1037//0022-3514.52.6.1061
  41. [41] A. Ortony, G. Clore, and A. Collins, “The Cognitive Structure of Emotions,” Cambridge University Press, 1988. https://doi.org/10.1017/CBO9780511571299
  42. [42] A. Yadollahi, A. G. Shahraki, and O. R. Zaiane, “Current State of Text Sentiment Analysis from Opinion to Emotion Mining,” ACM Computing Surveys, Vol.50, No.2, pp. 1-33, 2017. https://doi.org/10.1145/3057270
  43. [43] B. Gaind, V. Syal, and S. Padgalwar, “Emotion Detection and Analysis on Social Media,” Proc. of the Int. Conf. on Recent Trends in Computational Engineering and Technologies, 2018.
  44. [44] I. Perikos and I. Hatzilygeroudis, “Recognizing emotions in text using ensemble of classifiers,” Engineering Applications of Artificial Intelligence, Vol.51, pp. 191-201, 2016. https://doi.org/10.1016/j.engappai.2016.01.012
  45. [45] N. Shelke, “Approaches of emotion detection from text,” Int. J. Comput. Sci. Inf. Technol. Res., Vol.2, No.2, pp. 123-128, 2014.
  46. [46] L. Canales and P. Martinez-Barco, “Emotion detection from text: A survey,” Proc. of the Workshop on Natural Language Processing in the 5th Information Systems Research Working Days (JISIC), pp. 37-43, 2014. https://doi.org/10.3115/v1/W14-6905
  47. [47] H. Binali, C. Wu, and V. Potdar, “Computational Approaches for Emotion Detection in Text,” Proc. of the 4th IEEE Int. Conf. on Digital Ecosystems and Technologies (IEEE DEST 2010), pp. 172-177, 2010. https://doi.org/10.1109/DEST.2010.5610650
  48. [48] J. A. Russell, “A Circumplex Model of Affect,” J. Pers. Soc. Psychol., Vol.39, No.6, Article No.1161, 1980. https://doi.org/10.1037/h0077714
  49. [49] E. Kao et al., “Towards text-based emotion detection: a survey and possible improvements,” Int. Conf. on Information Management and Engineering (ICIME’09), pp. 70-74, 2009. https://doi.org/10.1109/ICIME.2009.113
  50. [50] R. Hirat and N. Mittal, “A Survey On Emotion Detection Techniques Using Text in Blogspots,” Int. Bulletin of Mathematical Research, Vol.2, No.1, pp. 180-187, 2015.
  51. [51] C. H. Wu, Z. J. Chuang, and Y. C. Lin, “Emotion Recognition from Text Using Semantic Labels and Separable Mixture Models,” ACM Trans. on Asian Language Information Processing (TALIP), Vol.5, No.2, pp. 165-183, 2006. https://doi.org/10.1145/1165255.1165259
  52. [52] M. Chunling, H. Prendinger, and M. Ishizuka, “Emotion Estimation and Reasoning Based on Affective Textual Interaction,” Affective Computing and Intelligent Interaction, Vol.3784, pp. 622-628, 2005. https://doi.org/10.1007/11573548_80
  53. [53] J. Hancock, C. Landrigan, and C. Silver, “Expressing emotion in text-based communication,” Proc. of the SIGCHI Conf. on Human Factors in Computing Systems (CHI 2007), pp. 929-932, 2007. https://doi.org/10.1145/1240624.1240764
  54. [54] H. Li, N. Pang, and S. Guo, “Research on Textual Emotion Recognition Incorporating Personality Factor,” Int. Conf. on Robotics and Biomimetics, pp. 2222-2227, 2007. https://doi.org/10.1109/ROBIO.2007.4522515
  55. [55] C. Strapparava and R. Mihalcea, “Learning to identify emotions in text,” ACM Symp. on Applied Computing (SAC’08), pp. 1556-1560, 2008. https://doi.org/10.1145/1363686.1364052
  56. [56] A. Agrawal and A. An, “Unsupervised emotion detection from text using sematic and syntactic relations,” The 2012 IEEE/WIC/ACM Int. Joint Conf. on Web Intelligence and Intelligent Agent Technology, Vol.1, pp. 346-353, 2012. https://doi.org/10.1109/WI-IAT.2012.170
  57. [57] C. Alm, D. Roth, and R. Sproat, “Emotions from Text: Machine Learning for Text-Based Emotion Prediction,” Proc. of Human Language Technology Conf. and Conf. on Empirical Methods in Natural Language Processing, pp. 579-586, 2005. https://doi.org/10.3115/1220575.1220648
  58. [58] Z. Teng, F. Ren, and S. Kuroiwa, “Recognition of Emotion with SVMs,” D.-S. Huang, K. Li, and G. W. Irwin (Eds.), “Lecture Notes of Artificial Intelligence 4114,” pp. 701-710, Springer, 2006.
  59. [59] C. Yang, K. H. Y. Lin, and H. H. Chen, “Emotion classification using web blog corpora,” Proc. of the IEEE/WIC/ACM Int. Conf. on Web Intelligence. IEEE Computer Society, pp. 275-278, 2007. https://doi.org/10.1109/WI.2007.51
  60. [60] Y. Wang and A. Pal, “Detecting Emotions in Social Media: A Constrained Optimization Approach,” Proc. of the 24th Int. Joint Conf. on Artificial Intelligence (IJCAI 2015), pp. 996-1002, 2015.
  61. [61] S. Shivhare, S. Garg, and A. Mishra, “EmotionFinder: Detecting Emotion from Blogs and Textual Documents,” Int. Conf. on Computing, Communication and Automation (ICCCA2015), pp. 52-57, 2015. https://doi.org/10.1109/CCAA.2015.7148343
  62. [62] Y. Douili, M. Hajar, and H. A. Moatassime, “Using Youtube comments for text-based emotion recognition,” Procedia Comput Science, Vol.83, pp. 292-299, 2016. https://doi.org/10.1016/j.procs.2016.04.128
  63. [63] J. Herzig, M. Shmueli-Scheuer, and D. Konopnicki, “Emotion Detection from Text via Ensemble Classification Using Word Embeddings,” Proc. of the ACM SIGIR Int. Conf. on Theory of Information Retrieval (ICTIR’17), pp. 269-272, 2017. https://doi.org/10.1145/3121050.3121093
  64. [64] S. Mohammad and F. Bravo-Marquez, “Emotion Intensities in Tweets,” Proc. of the 6th Joint Conf. on Lexical and Computational Smeantics (*SEM 2017), pp. 65-77, 2017. https://doi.org/10.18653/v1/S17-1007
  65. [65] S. X. Mashal and K. Asnani, “Emotion Intensity Detection for Social Media Data,” Proc. of the IEEE 2017 Int. Conf. on Computing Methodologies and Communication, pp. 155-158, 2017. https://doi.org/10.1109/ICCMC.2017.8282664
  66. [66] R. V. Kumar, S. Rahmanian, and H. AlBalooshi, “EmotionX-SmartDubai_NLP: Detecting User Emotions In Social Media Text,” Proc. of the 6th Int. Workshop on Natural Language Processing for Social Media, pp. 45-49, 2018. https://doi.org/10.18653/v1/W18-3508
  67. [67] W. Witon, P. Colombo, A. Modi, and M. Kapadia, “Disney at IEST 2018: Predicting Emotions Using an Ensemble,” Proc. of the 9th Workshop on Computational Approaches to Subjectivity, Sentiment and Social Media Analysis, Assoc. for Computational Linguistics, pp. 248-253, 2018. https://aclanthology.org/W18-6236
  68. [68] B. Kratzwaldet al., “Deep learning for affective computing: Text-based emotion recognition in Decision Support,” Decision Support Systems, Vol.115, pp. 24-35, 2018. https://doi.org/10.1016/j.dss.2018.09.002
  69. [69] S. S. Ibraheim, S. S. Ismail, K. A. Bahnasy, and M. M. Aref, “Convolutional Neural Network Multi-Emotion Classifiers,” Jordanian J. of Computers and Information Technology (JJCIT), Vol.5, No.2, pp. 79-108, 2019. https://doi.org/10.5455/jjcit.71-1555697775
  70. [70] E. Batbaatar, M. Li, and K. Ryu, “Semantic-Emotion Neural Network for Emotion Recognition from Text,” IEEE Access, Vol.7, pp. 111866-111878, 2019. https://doi.org/10.1109/ACCESS.2019.2934529
  71. [71] M. Baali and N. Ghneim, “Emotion Analysis of Arabic Tweets Using Deep Learning Approach,” J. of Big Data, Vol.6, No.89, 2019. https://doi.org/10.1186/s40537-019-0252-x
  72. [72] K. S. N. Tan, T. M. Lim, and Y. M. Lim, “Emotion Analysis Using Self-Training on Malaysian Code-Mixed Twitter Data,” Proc. of Int. Conf. ICT Society and Human Beings, pp. 181-188, 2020. https://doi.org/10.33965/ict_csc_wbc_2020_202008l022
  73. [73] Z. Erenel, O. Adegboye, and H. Kusetogullari, “A New Feature Selection Scheme for Emotion Recognition from Text,” Applied Sciences, Vol.10, No.15, 2020. https://doi.org/10.3390/app10155351
  74. [74] S. Zad and M. A. Finlayson, “Systematic Evaluation of a Framework for Unsupervised Emotion Recognition for Narrative Text,” Proc. of the 1st Joint Workshop on Narrative Understanding, Storylines, and Events, pp. 26-37, 2020. https://doi.org/10.18653/v1/2020.nuse-1.4
  75. [75] C. S. A. Razak, S. H. A. Hamid, H. Meon, H. A. Subramaniam, and N. B. Anuar, “Two-Step Model for Emotion Detection on Twitter Users: A COVID-19 Case Study in Malaysia,” Malaysian J. of Computer Science, Vol.34, No.4, pp. 374-388, 2021. https://doi.org/10.22452/mjcs.vol34no4.4
  76. [76] A. Chowanda, R. Sutoyo, M. Meiliana, and S. Tanachutiwat, “Exploring Text-Based Emotions Recognition Machine Learning Techniques on Social Media Conversation,” Procedia Computer Science, Vol.179, pp. 821-828, 2021. https://doi.org/10.1016/j.procs.2021.01.099
  77. [77] R. Xia, C. Zong, and S. Li, “Ensemble of feature sets and classification algorithms for sentiment classification,” Information Sciences, Vol.181, No.6, pp. 1138-1152, 2011. https://doi.org/10.1016/j.ins.2010.11.023
  78. [78] P. Lai and R. Alfred, “A Performance Comparison of Feature Extraction Methods for Sentiment Analysis,” Advanced Topics in Intelligent Information and Database Systems, Studies in Computational Intelligence, Vol.710, pp. 379-390, 2017. https://doi.org/10.1007/978-3-319-56660-3_33
  79. [79] P. H. Lai, J. Y. Chan, and K. O. Chin, “Ensembles for Text-Based Sarcasm Detection,” Proc. of 19th IEEE Student Conf. on Research and Development, pp. 284-289, 2021. https://doi.org/10.1109/SCOReD53546.2021.9652768

*This site is desgined based on HTML5 and CSS3 for modern browsers, e.g. Chrome, Firefox, Safari, Edge, Opera.

Last updated on Apr. 22, 2024