Transfer learning for sentiment analysis using bert based supervised fine-tuning

Prottasha, Nusrat Jahan and Sami, Abdullah As and Kowsher, Md and Murad, Saydul Akbar and Bairagi, Anupam Kumar and Masud, Mehedi and Baz, Mohammed (2022) Transfer learning for sentiment analysis using bert based supervised fine-tuning. Sensors, 22 (11). pp. 1-19. ISSN 1424-8220. (Published)

Transfer learning for sentiment analysis using bert based supervised fine-tuning.pdf
Available under License Creative Commons Attribution.

Download (1MB) | Preview


The growth of the Internet has expanded the amount of data expressed by users across multiple platforms. The availability of these different worldviews and individuals’ emotions em-powers sentiment analysis. However, sentiment analysis becomes even more challenging due to a scarcity of standardized labeled data in the Bangla NLP domain. The majority of the existing Bangla research has relied on models of deep learning that significantly focus on context-independent word embeddings, such as Word2Vec, GloVe, and fastText, in which each word has a fixed representation irrespective of its context. Meanwhile, context-based pre-trained language models such as BERT have recently revolutionized the state of natural language processing. In this work, we utilized BERT’s transfer learning ability to a deep integrated model CNN-BiLSTM for enhanced performance of decision-making in sentiment analysis. In addition, we also introduced the ability of transfer learning to classical machine learning algorithms for the performance comparison of CNN-BiLSTM. Additionally, we explore various word embedding techniques, such as Word2Vec, GloVe, and fastText, and compare their performance to the BERT transfer learning strategy. As a result, we have shown a state-of-the-art binary classification performance for Bangla sentiment analysis that significantly outperforms all embedding and algorithms.

Item Type: Article
Additional Information: Indexed by Scopus
Uncontrolled Keywords: Bangla NLP; Bangla-BERT; Sentiment analysis; Transfer learning; Transformer; Word embedding
Subjects: Q Science > QA Mathematics > QA75 Electronic computers. Computer science
Q Science > QA Mathematics > QA76 Computer software
T Technology > T Technology (General)
Faculty/Division: Faculty of Computing
Institute of Postgraduate Studies
Depositing User: Mr Muhamad Firdaus Janih@Jaini
Date Deposited: 08 Nov 2022 08:42
Last Modified: 08 Nov 2022 08:42
Download Statistic: View Download Statistics

Actions (login required)

View Item View Item