Jamalbek Tussupov
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Jamalbek Tussupov has a total of 96 co-authors. Here are the top co-authors by number of shared publications:
- Aisulu Ismailova
Institute of Business and Digital Technology, GEP Information Systems, S. Seifullin Kazakh Agrotechnical Research University, Astana 010000, Kazakhstan
6 shared publications - Moldir Yessenova
Department of Information Systems, L. N. Gumilyov Eurasian National University, Astana 010000, Kazakhstan
6 shared publications - Madina Sambetbayeva
Department of Information Systems, L.N. Gumilyov Eurasian National University
5 shared publications - Zhanar Azhibekova
Department of Information and communication technologies, S. Asfendiyarov Kazakh National Medical University, Almaty 010002, Kazakhstan
5 shared publications - Akmaral Kassymova
Department of Information Technology, Zhangir Khan University, Uralsk, 010009, Republic of Kazakhstan, Kazakhstan
4 shared publications - Gulzira Abdikerimova
Department of Information Systems, L. N. Gumilyov Eurasian National University, Astana 010000, Kazakhstan
4 shared publications
Latest Publications
- Open Access
- 3 July 2026
- Published by MDPI AG in Informatics
- Vol. 13 (7) , 105
Reliability Reserve: A Markov Chain-Based Metric for Real-Time Operator Decision Support in Ayran Fermentation
This study presents a Markov chain-based metric called the Reliability Reserve (τ), designed to estimate the time available for operator intervention during the ayran fermentation process. This indicator can be integrated into a digital twin forecast management system. The fermentation process was obtained using a DTMC (discrete-time Markov chain) and divided into five states according to pH (S1–S5). Laboratory samples were prepared from premium-grade cow’s milk sourced from the Zher-Ana farm and divided into three experimental groups: Control (without additives), Opt1 (3% additive), and Opt2 (4% additive). A sequence of states was created for the three studied groups (Control, Opt1, and Opt2), and the transition states of the matrix were calculated. The Reliability Reserve quantifies how much time is left before the system transitions from the target state to the acidification state. For the first group, P45 was 0.200, corresponding to τ = 26.9 min. The incorporation of functional additives increased P45 to 0.250, reducing τ to 20.9 min and shortening the operator intervention window by approximately 6 min. Markov chains were constructed using 101 interpolated time points obtained from five experimental pH measurements for each group. The original pH values were recorded at 2, 4, 6, 8, and 10 h of fermentation and linearly interpolated with a step size of 0.1 h to improve temporal resolution. Model robustness was evaluated using sensitivity analysis (±0.05 pH boundary shifts) and bootstrap resampling (n = 1000, 95% confidence intervals). The concept of Reliability Reserve is a practical decision-making tool in real time. It offers an alternative to traditional reliability indicators such as MTTF and allows integration into digital twin-based control systems.
- 3 July 2026
- Published by MDPI AG in Informatics
- Vol. 13 (7) , 105
Open AccessReliability Reserve: A Markov Chain-Based Metric for Real-Time Operator Decision Support in Ayran Fermentation
This study presents a Markov chain-based metric called the Reliability Reserve (τ), designed to estimate the time available for operator intervention during the ayran fermentation process. This indicator can be integrated into a digital twin forecast management system. The fermentation process was obtained using a DTMC (discrete-time Markov chain) and divided into five states according to pH (S1–S5). Laboratory samples were prepared from premium-grade cow’s milk sourced from the Zher-Ana farm and divided into three experimental groups: Control (without additives), Opt1 (3% additive), and Opt2 (4% additive). A sequence of states was created for the three studied groups (Control, Opt1, and Opt2), and the transition states of the matrix were calculated. The Reliability Reserve quantifies how much time is left before the system transitions from the target state to the acidification state. For the first group, P45 was 0.200, corresponding to τ = 26.9 min. The incorporation of functional additives increased P45 to 0.250, reducing τ to 20.9 min and shortening the operator intervention window by approximately 6 min. Markov chains were constructed using 101 interpolated time points obtained from five experimental pH measurements for each group. The original pH values were recorded at 2, 4, 6, 8, and 10 h of fermentation and linearly interpolated with a step size of 0.1 h to improve temporal resolution. Model robustness was evaluated using sensitivity analysis (±0.05 pH boundary shifts) and bootstrap resampling (n = 1000, 95% confidence intervals). The concept of Reliability Reserve is a practical decision-making tool in real time. It offers an alternative to traditional reliability indicators such as MTTF and allows integration into digital twin-based control systems.
- Open Access
- 30 June 2026
- Published by Astana IT University in Scientific Journal of Astana IT University
- Vol. 26 (2) , 263-278
A BREAKPOINT MODEL FOR DATA VOLUME AND NETWORK CAPACITY IN INTERNET OF THINGS
The migration from fifth generation (5G) to sixth generation (6G) mobile networks is driven by the Massive Internet of Things (IoT), which targets device densities of up to ten million units per square kilometer. Two scaling limits govern such systems: a data-volume limit, beyond which batch analytics must give way to distributed streaming, and a network-capacity limit, beyond which the radio access network can no longer carry the aggregate uplink. These limits have so far been treated independently, and no empirical anchor exists for Central Asia. This study makes three contributions. First, it derives a closed-form, dimensionless separation ratio that couples the two breakpoints through shared system parameters and determines which limit binds first. Second, the model is instantiated using 145 regulated 5G New Radio measurements from the commercial Tele2 network in Astana, Kazakhstan, across five load scenarios spanning 13 to 100,000 emulated devices. Third, the closed-form structure of the ratio suggests the splitting is a general trait of uplink-bound IoT domains, though this study empirically instantiates only the vertical-farming case. The instantiated model yields a separation ratio of about thirty-two, with breakpoints at twenty-eight nodes for network capacity and eight hundred eighty for data volume. The measured round-trip time of 124.8 milliseconds and the measured uplink of 0.19 megabits per second miss the International Mobile Telecommunications-2030 (IMT-2030) targets by factors of 1248 and about 5.3 × 10⁵, respectively. Because the network-capacity limit binds first, the analytics regime required for dense deployment is unreachable on 5G. For the measured single-operator deployment, 6G is a precondition rather than an enhancement; generalization to other operators and sites requires further measurement.
- 30 June 2026
- Published by Astana IT University in Scientific Journal of Astana IT University
- Vol. 26 (2) , 263-278
Open AccessA BREAKPOINT MODEL FOR DATA VOLUME AND NETWORK CAPACITY IN INTERNET OF THINGS
The migration from fifth generation (5G) to sixth generation (6G) mobile networks is driven by the Massive Internet of Things (IoT), which targets device densities of up to ten million units per square kilometer. Two scaling limits govern such systems: a data-volume limit, beyond which batch analytics must give way to distributed streaming, and a network-capacity limit, beyond which the radio access network can no longer carry the aggregate uplink. These limits have so far been treated independently, and no empirical anchor exists for Central Asia. This study makes three contributions. First, it derives a closed-form, dimensionless separation ratio that couples the two breakpoints through shared system parameters and determines which limit binds first. Second, the model is instantiated using 145 regulated 5G New Radio measurements from the commercial Tele2 network in Astana, Kazakhstan, across five load scenarios spanning 13 to 100,000 emulated devices. Third, the closed-form structure of the ratio suggests the splitting is a general trait of uplink-bound IoT domains, though this study empirically instantiates only the vertical-farming case. The instantiated model yields a separation ratio of about thirty-two, with breakpoints at twenty-eight nodes for network capacity and eight hundred eighty for data volume. The measured round-trip time of 124.8 milliseconds and the measured uplink of 0.19 megabits per second miss the International Mobile Telecommunications-2030 (IMT-2030) targets by factors of 1248 and about 5.3 × 10⁵, respectively. Because the network-capacity limit binds first, the analytics regime required for dense deployment is unreachable on 5G. For the measured single-operator deployment, 6G is a precondition rather than an enhancement; generalization to other operators and sites requires further measurement.
- 30 March 2026
- Published by Karagandy University of the name of academician E.A. Buketov in BULLETIN OF THE KARAGANDA UNIVERSITY-MATHEMATICS
- Vol. 121 (1)
On Triggers of Order
It is shown that the concepts of heir and coheir, introduced by D. Lascar and B. Poizat, play a fundamental role in model theory, particularly in classification theory. The related notions of proper heir and proper coheir are introduced, containing important constructs within themselves. Poizat’s lemma on the existence of a proper heir of any non-definable type over a model is presented as an important fact of existence in unstable theories. The concept of an order trigger in a model is then introduced as the skeleton of an algorithmic device that produces ω-evidence of the order property in it. This evidence is constructed using a method very similar to the “back and forth” method of classical model theory, where at each step two possibilities for choosing elements are alternated. As an example of use, a simplified proof of the characterization theorem of the class of unstable theories using these concepts is explained. It is pointed out that applications of more advanced constructions, such as order triggers, can help in solving problems related to the classification of small, countable and minimal models of unstable theories.
- 30 March 2026
- Published by Karagandy University of the name of academician E.A. Buketov in BULLETIN OF THE KARAGANDA UNIVERSITY-MATHEMATICS
- Vol. 121 (1)
On Triggers of Order
It is shown that the concepts of heir and coheir, introduced by D. Lascar and B. Poizat, play a fundamental role in model theory, particularly in classification theory. The related notions of proper heir and proper coheir are introduced, containing important constructs within themselves. Poizat’s lemma on the existence of a proper heir of any non-definable type over a model is presented as an important fact of existence in unstable theories. The concept of an order trigger in a model is then introduced as the skeleton of an algorithmic device that produces ω-evidence of the order property in it. This evidence is constructed using a method very similar to the “back and forth” method of classical model theory, where at each step two possibilities for choosing elements are alternated. As an example of use, a simplified proof of the characterization theorem of the class of unstable theories using these concepts is explained. It is pointed out that applications of more advanced constructions, such as order triggers, can help in solving problems related to the classification of small, countable and minimal models of unstable theories.
- Open Access
A Hybrid Ensemble Framework for Rare Event Detection in Large-Scale Tabular Data
Rare event detection in large tabular data remains a computationally challenging problem due to class imbalance, heterogeneous feature distributions, and unstable thresholds. Traditional machine learning approaches based on individual models and fixed thresholds often exhibit limited robustness and reproducibility in such settings. This paper proposes a hybrid ensemble framework for rare event detection that integrates heterogeneous machine learning models through threshold-aware probabilistic aggregation. The framework combines gradient-boosted decision trees, regularized linear models, and neural networks, leveraging their complementary inductive biases. To ensure reproducibility and robust performance evaluation under severe class imbalance, a leaky-controlled evaluation protocol is employed, including rootwise summation, probability calibration, and validation-based threshold optimization. The proposed approach is evaluated on a large tabular dataset containing approximately 50,000 observations. Experimental results demonstrate improved rare event detection and robust generalization performance compared to individual baseline models. Explainability is achieved through Shapley Additive Explanations (SHAP)-based attribution analysis and clustering in the explanation space, enabling transparent analysis of ensemble decision-making behavior. The proposed framework represents a general-purpose computational solution for rare event detection and can be applied to a wide range of data-driven decision-making and anomaly detection problems.
Open AccessA Hybrid Ensemble Framework for Rare Event Detection in Large-Scale Tabular Data
Rare event detection in large tabular data remains a computationally challenging problem due to class imbalance, heterogeneous feature distributions, and unstable thresholds. Traditional machine learning approaches based on individual models and fixed thresholds often exhibit limited robustness and reproducibility in such settings. This paper proposes a hybrid ensemble framework for rare event detection that integrates heterogeneous machine learning models through threshold-aware probabilistic aggregation. The framework combines gradient-boosted decision trees, regularized linear models, and neural networks, leveraging their complementary inductive biases. To ensure reproducibility and robust performance evaluation under severe class imbalance, a leaky-controlled evaluation protocol is employed, including rootwise summation, probability calibration, and validation-based threshold optimization. The proposed approach is evaluated on a large tabular dataset containing approximately 50,000 observations. Experimental results demonstrate improved rare event detection and robust generalization performance compared to individual baseline models. Explainability is achieved through Shapley Additive Explanations (SHAP)-based attribution analysis and clustering in the explanation space, enabling transparent analysis of ensemble decision-making behavior. The proposed framework represents a general-purpose computational solution for rare event detection and can be applied to a wide range of data-driven decision-making and anomaly detection problems.
- Open Access
- 22 December 2025
- Published by MDPI AG in Applied System Innovation
- Vol. 9 (1) , 3
A System-Level Approach to Pixel-Based Crop Segmentation from Ultra-High-Resolution UAV Imagery
This paper proposed a two-level hybrid stacking model for the classification of crops—wheat, soybean, and barley—based on multispectral orthomosaics obtained from uncrewed aerial vehicles. The proposed method unites gradient boosting algorithms (LightGBM, XGBoost, CatBoost) and tree ensembles (RandomForest, ExtraTrees, Attention-MLP deep neural network), whose predictions fuse at the meta-level using ExtraTreesClassifier. Spectral channels, along with a wide range of vegetation indices and their statistical characteristics, are used to construct the feature space. Experiments on an open dataset showed that the proposed model achieves high classification accuracy (Accuracy ≈ 95%, macro-F1 ≈ 0.95) and significantly outperforms individual algorithms across all key metrics. An analysis of the seasonal dynamics of vegetation indices confirmed the feasibility of monitoring phenological phases and early detection of stress factors. Furthermore, spatial segmentation of orthomosaics achieved approximately 99% accuracy in constructing crop maps, making the developed approach a promising tool for precision farming. The study’s results showed the high potential of hybrid ensembles for scaling to other crops and regions, as well as for integrating them into digital agricultural information systems.
- 22 December 2025
- Published by MDPI AG in Applied System Innovation
- Vol. 9 (1) , 3
Open AccessA System-Level Approach to Pixel-Based Crop Segmentation from Ultra-High-Resolution UAV Imagery
This paper proposed a two-level hybrid stacking model for the classification of crops—wheat, soybean, and barley—based on multispectral orthomosaics obtained from uncrewed aerial vehicles. The proposed method unites gradient boosting algorithms (LightGBM, XGBoost, CatBoost) and tree ensembles (RandomForest, ExtraTrees, Attention-MLP deep neural network), whose predictions fuse at the meta-level using ExtraTreesClassifier. Spectral channels, along with a wide range of vegetation indices and their statistical characteristics, are used to construct the feature space. Experiments on an open dataset showed that the proposed model achieves high classification accuracy (Accuracy ≈ 95%, macro-F1 ≈ 0.95) and significantly outperforms individual algorithms across all key metrics. An analysis of the seasonal dynamics of vegetation indices confirmed the feasibility of monitoring phenological phases and early detection of stress factors. Furthermore, spatial segmentation of orthomosaics achieved approximately 99% accuracy in constructing crop maps, making the developed approach a promising tool for precision farming. The study’s results showed the high potential of hybrid ensembles for scaling to other crops and regions, as well as for integrating them into digital agricultural information systems.
- Open Access
- 18 November 2025
- Published by MDPI AG in Preprints.org
An Intelligent Decision-Support Framework for AST Risk Prediction Using Explainable Ensemble Learning
This paper proposes an intelligent and explainable ensemble system for predicting as-partate aminotransferase (AST) levels based on routine biochemical and demographic data from the NHANES dataset. The framework integrates robust preprocessing, adaptive feature encoding, and multi-level ensemble learning within a nested cross-validation (5×3) structure to ensure reproducibility and prevent data leakage. Several regression mod-els—including Random Forest, XGBoost, CatBoost, and stacking ensembles—were sys-tematically compared using R², RMSE, MAE, and MAPE metrics. The results show that the Stacking v2 architecture, combining CatBoost, LightGBM, and Ridge meta-regression, achieves the highest predictive accuracy and stability. Explainable AI analysis using SHAP revealed key biochemical and lifestyle factors influencing AST variability. The pro-posed system provides a modular, interpretable, and reproducible foundation for deci-sion-support applications in intelligent healthcare analytics, aligning with the goals of applied system innovation.
- 18 November 2025
- Published by MDPI AG in Preprints.org
Open AccessAn Intelligent Decision-Support Framework for AST Risk Prediction Using Explainable Ensemble Learning
This paper proposes an intelligent and explainable ensemble system for predicting as-partate aminotransferase (AST) levels based on routine biochemical and demographic data from the NHANES dataset. The framework integrates robust preprocessing, adaptive feature encoding, and multi-level ensemble learning within a nested cross-validation (5×3) structure to ensure reproducibility and prevent data leakage. Several regression mod-els—including Random Forest, XGBoost, CatBoost, and stacking ensembles—were sys-tematically compared using R², RMSE, MAE, and MAPE metrics. The results show that the Stacking v2 architecture, combining CatBoost, LightGBM, and Ridge meta-regression, achieves the highest predictive accuracy and stability. Explainable AI analysis using SHAP revealed key biochemical and lifestyle factors influencing AST variability. The pro-posed system provides a modular, interpretable, and reproducible foundation for deci-sion-support applications in intelligent healthcare analytics, aligning with the goals of applied system innovation.
- Open Access
- 4 November 2025
- Published by MDPI AG in Preprints.org
Crop Classification Using Vegetation Indices and Ensemble Algorithms on UAV Orthomosaic Data
This paper proposed a two-level hybrid stacking model for the classification of crops—wheat, soybean, and barley—based on multispectral orthomosaics obtained from uncrewed aerial vehicles. The proposed method unites gradient boosting algorithms: LightGBM, XGBoost, CatBoost, and tree ensembles: RandomForest, ExtraTrees, Attention-MLP deep neural network, whose predictions fuse at the meta-level using ExtraTreesClassifier. Spectral channels, along with a wide range of vegetation indices and their statistical characteristics, are used to construct the feature space. Experiments on an open dataset showed that the proposed model achieves high classification accuracy (Accuracy ≈ 95%, macro-F1 ≈ 0.95) and significantly outperforms individual algorithms across all key metrics. An analysis of the seasonal dynamics of vegetation indices confirmed the feasibility of monitoring phenological phases and early detection of stress factors. Furthermore, spatial segmentation of orthomosaics achieved approximately 99% accuracy in constructing crop maps, making the developed approach a promising tool for precision farming. The study's results showed the high potential of hybrid ensembles for scaling to other crops and regions, as well as for integrating them into digital agricultural information systems.
- 4 November 2025
- Published by MDPI AG in Preprints.org
Open AccessCrop Classification Using Vegetation Indices and Ensemble Algorithms on UAV Orthomosaic Data
This paper proposed a two-level hybrid stacking model for the classification of crops—wheat, soybean, and barley—based on multispectral orthomosaics obtained from uncrewed aerial vehicles. The proposed method unites gradient boosting algorithms: LightGBM, XGBoost, CatBoost, and tree ensembles: RandomForest, ExtraTrees, Attention-MLP deep neural network, whose predictions fuse at the meta-level using ExtraTreesClassifier. Spectral channels, along with a wide range of vegetation indices and their statistical characteristics, are used to construct the feature space. Experiments on an open dataset showed that the proposed model achieves high classification accuracy (Accuracy ≈ 95%, macro-F1 ≈ 0.95) and significantly outperforms individual algorithms across all key metrics. An analysis of the seasonal dynamics of vegetation indices confirmed the feasibility of monitoring phenological phases and early detection of stress factors. Furthermore, spatial segmentation of orthomosaics achieved approximately 99% accuracy in constructing crop maps, making the developed approach a promising tool for precision farming. The study's results showed the high potential of hybrid ensembles for scaling to other crops and regions, as well as for integrating them into digital agricultural information systems.
- 1 September 2025
- Published by JSC "Academy of Civil Aviation" in Bulletin of the Civil Aviation Academy
- Vol. 38 (3)
INTELLIGENT COMPETENCE AND LEARNING OUTCOMES MANAGEMENT SYSTEM: ADAPTING EDUCATIONAL PROGRAMS TO THE LABOR MARKET
The article presents an intelligent information system (IIS) developed to automate the formation of competencies and learning outcomes based on professional standards. A distinctive feature of the IIS is the integration of professional standards with the Atlas of New Professions, which allows adapting educational programs to the dynamically changing requirements of the labor market and technological transformations. The key functional capabilities of the system are described, including user authentication, generation of competencies and learning outcomes for the design of educational programs. The implementation of the system includes an interactive JavaScript interface with support for asynchronous sending of requests to the server using AJAX technologies. OpenAI generative models are used to automatically generate competencies and learning outcomes. The presented system has a wide range of potential applications: from designing curricula based on competencies to creating career guidance systems, analyzing and forecasting changes in the labor market, as well as adapting educational programs to the requirements of high-tech industries. Thus, the developed model contributes to the digitalization of education, improving its quality and ensuring that educational standards meet the modern challenges of the knowledge economy.
- 1 September 2025
- Published by JSC "Academy of Civil Aviation" in Bulletin of the Civil Aviation Academy
- Vol. 38 (3)
INTELLIGENT COMPETENCE AND LEARNING OUTCOMES MANAGEMENT SYSTEM: ADAPTING EDUCATIONAL PROGRAMS TO THE LABOR MARKET
The article presents an intelligent information system (IIS) developed to automate the formation of competencies and learning outcomes based on professional standards. A distinctive feature of the IIS is the integration of professional standards with the Atlas of New Professions, which allows adapting educational programs to the dynamically changing requirements of the labor market and technological transformations. The key functional capabilities of the system are described, including user authentication, generation of competencies and learning outcomes for the design of educational programs. The implementation of the system includes an interactive JavaScript interface with support for asynchronous sending of requests to the server using AJAX technologies. OpenAI generative models are used to automatically generate competencies and learning outcomes. The presented system has a wide range of potential applications: from designing curricula based on competencies to creating career guidance systems, analyzing and forecasting changes in the labor market, as well as adapting educational programs to the requirements of high-tech industries. Thus, the developed model contributes to the digitalization of education, improving its quality and ensuring that educational standards meet the modern challenges of the knowledge economy.
- Open Access
- 27 June 2025
- Published by MDPI AG in Preprints.org
Efficient Assessment of the Risk of Elevated Aspartate Aminotransferase Using Machine Learning Methods Based on Routine Biochemical Markers
This study proposes an interpretable and high-accuracy ensemble learning framework for predicting aspartate aminotransferase (AST) levels using open-access biomedical datasets. Using a structured pipeline of preprocessing, feature selection, and model ensembling, we evaluated a series of regression algorithms including Random Forest, XGBoost, CatBoost, and three stacking architectures. The best-performing ensemble (Stacking_v2) achieved R² = 0.98 and RMSE = 1.23 on the validation set, surpassing conventional and single-model approaches. Feature importance was assessed using SHAP values, mutual information, and correlation analysis, revealing that gamma-glutamyl transferase, ferritin, and anthropometric markers had the greatest predictive impact. The proposed stacking-based model demonstrates excellent generalization, robust calibration, and high interpretability, and can serve as a benchmark for algorithmic evaluation in medical data modeling. The work highlights the effectiveness of ensemble regression and interpretable AI in real-world clinical prediction tasks using routine biomarkers.
- 27 June 2025
- Published by MDPI AG in Preprints.org
Open AccessEfficient Assessment of the Risk of Elevated Aspartate Aminotransferase Using Machine Learning Methods Based on Routine Biochemical Markers
This study proposes an interpretable and high-accuracy ensemble learning framework for predicting aspartate aminotransferase (AST) levels using open-access biomedical datasets. Using a structured pipeline of preprocessing, feature selection, and model ensembling, we evaluated a series of regression algorithms including Random Forest, XGBoost, CatBoost, and three stacking architectures. The best-performing ensemble (Stacking_v2) achieved R² = 0.98 and RMSE = 1.23 on the validation set, surpassing conventional and single-model approaches. Feature importance was assessed using SHAP values, mutual information, and correlation analysis, revealing that gamma-glutamyl transferase, ferritin, and anthropometric markers had the greatest predictive impact. The proposed stacking-based model demonstrates excellent generalization, robust calibration, and high interpretability, and can serve as a benchmark for algorithmic evaluation in medical data modeling. The work highlights the effectiveness of ensemble regression and interpretable AI in real-world clinical prediction tasks using routine biomarkers.
- Open Access
- 19 May 2025
- Published by MDPI AG in Algorithms
- Vol. 18 (5) , 289
Analysis of Short Texts Using Intelligent Clustering Methods
This article presents a comprehensive review of short text clustering using state-of-the-art methods: Bidirectional Encoder Representations from Transformers (BERT), Term Frequency-Inverse Document Frequency (TF-IDF), and the novel hybrid method Latent Dirichlet Allocation + BERT + Autoencoder (LDA + BERT + AE). The article begins by outlining the theoretical foundation of each technique and its merits and limitations. BERT is critiqued for its ability to understand word dependence in text, while TF-IDF is lauded for its applicability in terms of importance assessment. The experimental section compares the efficacy of these methods in clustering short texts, with a specific focus on the hybrid LDA + BERT + AE approach. A detailed examination of the LDA-BERT model’s training and validation loss over 200 epochs shows that the loss values start above 1.2 and quickly decrease to around 0.8 within the first 25 epochs, eventually stabilizing at approximately 0.4. The close alignment of these curves suggests the model’s practical learning and generalization capabilities, with minimal overfitting. The study demonstrates that the hybrid LDA + BERT + AE method significantly enhances text clustering quality compared to individual methods. Based on the findings, the study recommends the optimum choice and use of clustering methods for different short texts and natural language processing operations. The applications of these methods in industrial and educational settings, where successful text handling and categorization are critical, are also addressed. The study ends by emphasizing the importance of the holistic handling of short texts for deeper semantic comprehension and effective information retrieval.
- 19 May 2025
- Published by MDPI AG in Algorithms
- Vol. 18 (5) , 289
Open AccessAnalysis of Short Texts Using Intelligent Clustering Methods
This article presents a comprehensive review of short text clustering using state-of-the-art methods: Bidirectional Encoder Representations from Transformers (BERT), Term Frequency-Inverse Document Frequency (TF-IDF), and the novel hybrid method Latent Dirichlet Allocation + BERT + Autoencoder (LDA + BERT + AE). The article begins by outlining the theoretical foundation of each technique and its merits and limitations. BERT is critiqued for its ability to understand word dependence in text, while TF-IDF is lauded for its applicability in terms of importance assessment. The experimental section compares the efficacy of these methods in clustering short texts, with a specific focus on the hybrid LDA + BERT + AE approach. A detailed examination of the LDA-BERT model’s training and validation loss over 200 epochs shows that the loss values start above 1.2 and quickly decrease to around 0.8 within the first 25 epochs, eventually stabilizing at approximately 0.4. The close alignment of these curves suggests the model’s practical learning and generalization capabilities, with minimal overfitting. The study demonstrates that the hybrid LDA + BERT + AE method significantly enhances text clustering quality compared to individual methods. Based on the findings, the study recommends the optimum choice and use of clustering methods for different short texts and natural language processing operations. The applications of these methods in industrial and educational settings, where successful text handling and categorization are critical, are also addressed. The study ends by emphasizing the importance of the holistic handling of short texts for deeper semantic comprehension and effective information retrieval.