Prottasha, Nusrat Jahan and Sami, Abdullah As and Kowsher, Md and Murad, Saydul Akbar and Bairagi, Anupam Kumar and Masud, Mehedi and Baz, Mohammed (2022) Transfer learning for sentiment analysis using bert based supervised fine-tuning. Sensors, 22 (11). pp. 1-19. ISSN 1424-8220. (Published)
|
Pdf
Transfer learning for sentiment analysis using bert based supervised fine-tuning.pdf Available under License Creative Commons Attribution. Download (1MB) | Preview |
Abstract
The growth of the Internet has expanded the amount of data expressed by users across multiple platforms. The availability of these different worldviews and individuals’ emotions em-powers sentiment analysis. However, sentiment analysis becomes even more challenging due to a scarcity of standardized labeled data in the Bangla NLP domain. The majority of the existing Bangla research has relied on models of deep learning that significantly focus on context-independent word embeddings, such as Word2Vec, GloVe, and fastText, in which each word has a fixed representation irrespective of its context. Meanwhile, context-based pre-trained language models such as BERT have recently revolutionized the state of natural language processing. In this work, we utilized BERT’s transfer learning ability to a deep integrated model CNN-BiLSTM for enhanced performance of decision-making in sentiment analysis. In addition, we also introduced the ability of transfer learning to classical machine learning algorithms for the performance comparison of CNN-BiLSTM. Additionally, we explore various word embedding techniques, such as Word2Vec, GloVe, and fastText, and compare their performance to the BERT transfer learning strategy. As a result, we have shown a state-of-the-art binary classification performance for Bangla sentiment analysis that significantly outperforms all embedding and algorithms.
| Item Type: | Article |
|---|---|
| Additional Information: | Indexed by Scopus |
| Uncontrolled Keywords: | Bangla NLP; Bangla-BERT; Sentiment analysis; Transfer learning; Transformer; Word embedding |
| Subjects: | Q Science > QA Mathematics > QA75 Electronic computers. Computer science Q Science > QA Mathematics > QA76 Computer software T Technology > T Technology (General) |
| Faculty/Division: | Faculty of Computing Institute of Postgraduate Studies |
| Depositing User: | Mr Muhamad Firdaus Janih@Jaini |
| Date Deposited: | 08 Nov 2022 08:42 |
| Last Modified: | 08 Nov 2022 08:42 |
| URI: | http://umpir.ump.edu.my/id/eprint/34888 |
| Download Statistic: | View Download Statistics |
Actions (login required)
 |
View Item |