Developing a Chatbot for Soft Skills Education: Comparing ReLU-LSTM and GloAT-Transformer Models
Open Access
- 11 September 2026
- journal article
- Published by International Association of Online Engineering (IAOE) in International Journal of Interactive Mobile Technologies (iJIM)
- Vol. 20 (17) , 4–25
Abstract
Recently, soft skills, like communication, teamwork, and problem-solving, have become more important in higher education. In Moroccan universities, fostering these skills is essential to better prepare students for the demands of the job market and modern work environments. However, traditional educational methods often lack interactive and personalized approaches to develop these competencies. This led us to develop a conversational AI system to support soft skills learning through intent classification using Natural Language Processing (NLP) and Neural Networks. Two deep learning models were developed and evaluated; a ReLU-Enhanced LSTM, optimized for stable sequential processing, and a GloAT-Transformer model leveraging global self-attention to capture contextual relationships.Keywords
This publication has 30 references indexed in Scilit:
- A Conversation on Artificial Intelligence, Chatbots, and Plagiarism in Higher EducationCellular and Molecular Bioengineering, 2023
- Learning towards conversational AI: A surveyAI Open, 2022
- Emerging-market consumers’ interactions with banking chatbotsTelematics and Informatics, 2021
- Exploring the impact of chatbots on consumer sentiment and expectations in retailJournal of Retailing and Consumer Services, 2021
- Chatbots applications in education: A systematic reviewComputers and Education: Artificial Intelligence, 2021
- Chatbots: History, technology, and applicationsMachine Learning with Applications, 2020
- A survey on construction and enhancement methods in service chatbots designCCF Transactions on Pervasive Computing and Interaction, 2019
- Financial time series forecasting model based on CEEMDAN and LSTMPhysica A: Statistical Mechanics and its Applications, 2019
- Deep learning with long short-term memory networks for financial market predictionsEuropean Journal of Operational Research, 2018
- Deep Neural Networks for Natural Language Processing2018