Open AccessArticle
Bengali Emotion Classification from Social Media Text Using Deep Learning and Transformer‑Based Models with Explainability
by Mujtahid Alam1
, Shuhena Salam Aonty*2, Sha Newaz Mahmud2, Nahid Riaz Swachha2 and Ahmed Talal Wazih3
, Shuhena Salam Aonty*2, Sha Newaz Mahmud2, Nahid Riaz Swachha2 and Ahmed Talal Wazih31 Department of CSE, University of Liberal Arts Bangladesh (ULAB), Dhaka, Bangladesh
2 Department of CSE, Chittagong University of Engineering and Technology (CUET), Chattogram, Bangladesh
3 2Department of CSE, Chittagong University of Engineering and Technology (CUET), Chattogram, Bangladesh
*whom correspondence should be addressed. E-mail: shuhena@cuet.ac.bd
Received: 21 April 2026, Revised: 5 June 2026, Accepted: 7 June 2026, Published Online: 18 June 2026
(This article belongs to the Special Issue on SP8 (Special Issue on Digital and Engineering Transformations in Science and Technology (SI-DETST-26)) and the Section Artificial Intelligence – Computer Science (AIC))
Export Citations
Cite
APA Style
Alam, M. , Aonty, S. S. , Mahmud, S. N. , Swachha, N. R. and Wazih, A. T. (2026). Bengali Emotion Classification from Social Media Text Using Deep Learning and Transformer‑Based Models with Explainability. Journal of Engineering Research and Sciences, 05(06), 39–55. https://doi.org/10.55708/js0506004
Alam, M. , Aonty, S. S. , Mahmud, S. N. , Swachha, N. R. and Wazih, A. T. (2026). Bengali Emotion Classification from Social Media Text Using Deep Learning and Transformer‑Based Models with Explainability. Journal of Engineering Research and Sciences, 05(06), 39–55. https://doi.org/10.55708/js0506004
Chicago/Turabian Style
Mujtahid Alam, Shuhena Salam Aonty, Sha Newaz Mahmud, Nahid Riaz Swachha and Ahmed Talal Wazih. "Bengali Emotion Classification from Social Media Text Using Deep Learning and Transformer‑Based Models with Explainability." Journal of Engineering Research and Sciences 05, no. 06 (June 2026): 39–55. https://doi.org/10.55708/js0506004
Mujtahid Alam, Shuhena Salam Aonty, Sha Newaz Mahmud, Nahid Riaz Swachha and Ahmed Talal Wazih. "Bengali Emotion Classification from Social Media Text Using Deep Learning and Transformer‑Based Models with Explainability." Journal of Engineering Research and Sciences 05, no. 06 (June 2026): 39–55. https://doi.org/10.55708/js0506004
IEEE Style
M. Alam, S.S. Aonty, S.N. Mahmud, N.R. Swachha and A.T. Wazih, "Bengali Emotion Classification from Social Media Text Using Deep Learning and Transformer‑Based Models with Explainability," Journal of Engineering Research and Sciences, vol. 05, no. 06, pp. 39–55, Jun. 2026, doi: 10.55708/js0506004.
M. Alam, S.S. Aonty, S.N. Mahmud, N.R. Swachha and A.T. Wazih, "Bengali Emotion Classification from Social Media Text Using Deep Learning and Transformer‑Based Models with Explainability," Journal of Engineering Research and Sciences, vol. 05, no. 06, pp. 39–55, Jun. 2026, doi: 10.55708/js0506004.
19 Downloads
Abstract
Full Text
References
Cited By
Metrics
Related Articles
Abstract
Bengali emotion classification remains challenging due to limited annotated resources, informal social media language, and the lack of comprehensive evaluations of modern transformer architectures. This study presents a unified framework for six‑class Bengali emotion classification using a corpus of 5,401 manually annotated social media comments. We systematically compare recurrent neural networks, transformer‑based models, and hybrid architectures, and propose a soft‑voting ensemble that integrates complementary contextual representations. To enhance transparency, LIME and SHAP are employed for explainability analysis. Experimental results show that the proposed ensemble achieves 91.31% accuracy and a weighted F1‑score of 0.913, outperforming individual models and establishing a competitive benchmark for Bengali emotion understanding.
Full Text
References
- P. Ekman, “An argument for basic emotions”, Cognition and Emotion, vol. 6, no. 3-4, pp. 169–200, 1992, doi:10.1080/02699939208411068.
- S. Sazzed, “Cross-lingual sentiment classification in low-resource Bengali language”, W. Xu, A. Ritter, T. Baldwin, A. Rahimi, eds., “Proceedings of the Sixth Workshop on Noisy User-generated Text (W-NUT 2020)”, pp. 50–60, Association for Computational Linguistics, Online, 2020, doi:10.18653/v1/2020.wnut-1.8.
- N. R. Swachha, M. Alam, S. S. Aonty, “Fusion-based model for detection and classification of human sentiments from bengali text”, “2025 International Conference on Electrical, Computer and Communication Engineering (ECCE)”, pp. 1–6, 2025, doi:10.1109/ECCE64574.2025.11013265.
- M. Al-Amin, M. S. Islam, S. Das Uzzal, “Sentiment analysis of bengali comments with word2vec and sentiment information of words”, “2017 International Conference on Electrical, Computer and Communication Engineering (ECCE)”, pp. 186–190, 2017, doi:10.1109/ECACE.2017.7912903.
- M. Z. Hossain, M. A. Rahman, M. S. Islam, S. Kar, “BanFakeNews: A dataset for detecting fake news in Bangla”, N. Calzolari, F. Béchet, P. Blache, K. Choukri, C. Cieri, T. Declerck, S. Goggi, H. Isahara, B. Maegaard, J. Mariani, H. Mazo, A. Moreno, J. Odijk, S. Piperidis, eds., “Proceedings of the Twelfth Language Resources and Evaluation Conference”, pp. 2862–2871, European Language Resources Association, Marseille, France, 2020.
- S. N. Mahmud, N. R. Swachha, A. T. Wazih, S. Saha, S. Paul, S. S. Aonty, “Bengali human sentiment detection and classification using attention based bidirectional lstm”, “2025 2nd International Conference on Next-Generation Computing, IoT and Machine Learning (NCIM)”, pp. 1–6, 2025, doi:10.1109/NCIM65934.2025.11160248.
- N. Irtiza Tripto, M. Eunus Ali, “Detecting multilabel sentiment and emotions from bangla youtube comments”, “2018 International Conference on Bangla Speech and Language Processing (ICBSLP)”, pp. 1–6, 2018, doi:10.1109/ICBSLP.2018.8554875.
- M. S. Islam, M. A. Islam, M. A. Hossain, J. J. Dey, “Supervised approach of sentimentality extraction from bengali facebook status”, “2016 19th International Conference on Computer and Information Technology (ICCIT)”, pp. 383–387, 2016, doi:10.1109/ICCITECHN.2016.7860228.
- T. Samin, N. A. Mouri, F. Haque, M. S. Islam, “Sentiment analysis of bangladeshi digital newspaper by using machine learning and natural language processing”, “2024 6th International Conference on Electrical Engineering and Information & Communication Technology (ICEEICT)”, pp. 149–153, 2024, doi:10.1109/ICEEICT62016.2024.10534481.
- S. Azmin, K. Dhar, “Emotion detection from bangla text corpus using naïve bayes classifier”, “2019 4th International Conference on Electrical Information and Communication Technology (EICT)”, pp. 1–5, 2019, doi:10.1109/EICT48899.2019.9068797.
- M. A. Rahman, M. H. Seddiqui, “Comparison of classical machine learning approaches on bangla textual emotion analysis”, arXiv preprint arXiv:1907.07826, 2019.
- N. R. Bhowmik, M. Arifuzzaman, M. R. H. Mondal, M. S. Islam, “Bangla text sentiment analysis using supervised machine learning with extended lexicon dictionary”, Natural Language Processing Research, vol. 1, pp. 34–45, 2021, doi:10.2991/nlpr.d.210316.001.
- A. Aziz Sharfuddin, M. Nafis Tihami, M. Saiful Islam, “A deep recurrent neural network with bilstm model for sentiment classification”, “2018 International Conference on Bangla Speech and Language Processing (ICBSLP)”, pp. 1–4, 2018, doi:10.1109/ICBSLP.2018.8554396.
- N. R. Bhowmik, M. Arifuzzaman, M. R. H. Mondal, “Sentiment analysis on bangla text using extended lexicon dictionary and deep learning algorithms”, Array, vol. 13, p. 100123, 2022, doi:10.1016/j.array.2021.100123.
- J. Devlin, M.-W. Chang, K. Lee, K. Toutanova, “BERT: Pre-training of deep bidirectional transformers for language understanding”, J. Burstein, C. Doran, T. Solorio, eds., “Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers)”, pp. 4171–4186, Association for Computational Linguistics, Minneapolis, Minnesota, 2019, doi:10.18653/v1/N19-1423.
- A. Bhattacharjee, T. Hasan, W. Ahmad, K. S. Mubasshir, M. S. Islam, A. Iqbal, M. S. Rahman, R. Shahriyar, “BanglaBERT: Language model pretraining and benchmarks for low-resource language understanding evaluation in Bangla”, M. Carpuat, M.-C. de Marneffe, I. V. Meza Ruiz, eds., “Findings of the Association for Computational Linguistics: NAACL 2022”, pp. 1318–1327, Association for Computational Linguistics, Seattle, United States, 2022, doi:10.18653/v1/2022.findings-naacl.98.
- S. Khanuja, D. Bansal, S. Mehtani, S. Khosla, A. Dey, et al., “Muril: Multilingual representations for indian languages”, arXiv preprint arXiv:2103.10730, 2021.
- A. Conneau, K. Khandelwal, N. Goyal, V. Chaudhary, G. Wenzek, F. Guzmán, E. Grave, M. Ott, L. Zettlemoyer, V. Stoyanov, “Unsupervised cross-lingual representation learning at scale”, D. Jurafsky, J. Chai, N. Schluter, J. Tetreault, eds., “Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics”, pp. 8440–8451, Association for Computational Linguistics, Online, 2020, doi:10.18653/v1/2020.acl-main.747.
- S. Woo, J. Park, J.-Y. Lee, I. S. Kweon, “Cbam: Convolutional block attention module”, V. Ferrari, M. Hebert, C. Sminchisescu, Y. Weiss, eds., “Computer Vision – ECCV 2018”, pp. 3–19, Springer International Publishing, Cham, 2018.
- C. Zhou, C. Sun, Z. Liu, F. C. M. Lau, “A c-lstm neural network for text classification”, arXiv preprint arXiv:1511.08630, 2015.
- M. T. Ribeiro, S. Singh, C. Guestrin, “Why should I trust you?: Explaining the predictions of any classifier”, “Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining”, KDD ’16, pp. 1135–1144, Association for Computing Machinery, New York, NY, USA, 2016, doi:10.1145/2939672.2939778.
- S. M. Lundberg, S.-I. Lee, “A unified approach to interpreting model predictions”, “Neural Information Processing Systems”, 2017.
- G. Eysenbach, J. E. Till, “Ethical issues in qualitative research on internet communities”, BMJ, vol. 323, no. 7321, pp. 1103–1105, 2001, doi:10.1136/bmj.323.7321.1103.
- J. R. Landis, G. G. Koch, “The measurement of observer agreement for categorical data”, Biometrics, vol. 33, no. 1, pp. 159–174, 1977, doi:10.2307/2529310.
- B. Han, T. Baldwin, “Lexical normalisation of short text messages: Makn sens a #twitter”, D. Lin, Y. Matsumoto, R. Mihalcea, eds., “Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies”, pp. 368–378, Association for Computational Linguistics, Portland, Oregon, USA, 2011.
- A. Fernández, S. García, F. Herrera, N. Chawla, “Smote for learning from imbalanced data: Progress and challenges, marking the 15-year anniversary”, J. Artif. Intell. Res., vol. 61, pp. 863–905, 2018, doi:10.1613/JAIR.1.11192.
- N. Kalchbrenner, E. Grefenstette, P. Blunsom, “A convolutional neural network for modelling sentences”, K. Toutanova, H. Wu, eds., “Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)”, pp. 655–665, Association for Computational Linguistics, Baltimore, Maryland, 2014, doi:10.3115/v1/P14-1062.
- S. Hochreiter, J. Schmidhuber, “Long short-term memory”, Neural Computation, vol. 9, no. 8, pp. 1735–1780, 1997, doi:10.1162/neco.1997.9.8.1735.
- D. Bahdanau, K. Cho, Y. Bengio, “Neural machine translation by jointly learning to align and translate”, CoRR, vol. abs/1409.0473, 2014.
- Z. Yang, D. Yang, C. Dyer, X. He, A. Smola, E. Hovy, “Hierarchical attention networks for document classification”, K. Knight, A. Nenkova, O. Rambow, eds., “Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies”, pp. 1480–1489, Association for Computational Linguistics, San Diego, California, 2016, doi:10.18653/v1/N16-1174.
- W. Yin, J. Hay, D. Roth, “Benchmarking zero-shot text classification: Datasets, evaluation and entailment approach”, K. Inui, J. Jiang, V. Ng, X. Wan, eds., “Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP)”, pp. 3914–3923, Association for Computational Linguistics, Hong Kong, China, 2019, doi:10.18653/v1/D19-1404.
- N. Reimers, I. Gurevych, “Sentence-BERT: Sentence embeddings using Siamese BERT-networks”, K. Inui, J. Jiang, V. Ng, X. Wan, eds., “Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP)”, pp. 3982–3992, Association for Computational Linguistics, Hong Kong, China, 2019, doi:10.18653/v1/D19-1410.
- T. Brown, B. Mann, N. Ryder, M. Subbiah, J. D. Kaplan, P. Dhariwal, A. Neelakantan, P. Shyam, G. Sastry, A. Askell, et al., “Language models are few-shot learners”, H. Larochelle, M. Ranzato, R. Hadsell, M. Balcan, H. Lin, eds., “Advances in Neural Information Processing Systems”, vol. 33, pp. 1877–1901, Curran Associates, Inc., 2020, doi:10.48550/arXiv.2005.14165.
Cited By
Metrics
No. of Downloads Per MonthNo. of Downloads Per Country
Related Articles