Topic-Modeling Guided Semantic Clustering for Enhancing CNN-Based Image Classification Using Scale-Invariant Feature Transform and Block Gabor Filtering
Open Access
- 9 February 2026
- journal article
- research article
- Published by MDPI AG in Journal of Imaging
- Vol. 12 (2) , 70
Abstract
This study proposes a topic-modeling guided framework that enhances image classification by introducing semantic clustering prior to CNN training. Images are processed through two key-point extraction pipelines: Scale-Invariant Feature Transform (SIFT) with Sobel edge detection and Block Gabor Filtering (BGF), to obtain local feature descriptors. These descriptors are clustered using K-means to build a visual vocabulary. Bag of Words histograms then represent each image as a visual document. Latent Dirichlet Allocation is applied to uncover latent semantic topics, generating coherent image clusters. Cluster-specific CNN models, including AlexNet, GoogLeNet, and several ResNet variants, are trained under identical conditions to identify the most suitable architecture for each cluster. Two topic guided integration strategies, the Maximum Proportion Topic (MPT) and the Weight Proportion Topic (WPT), are then used to assign test images to the corresponding specialized model. Experimental results show that both the SIFT-based and BGF-based pipelines outperform non-clustered CNN models and a baseline method using Incremental PCA, K-means, Same-Cluster Prediction, and unweighted Ensemble Voting. The SIFT pipeline achieves the highest accuracy of 95.24% with the MPT strategy, while the BGF pipeline achieves 93.76% with the WPT strategy. These findings confirm that semantic structure introduced through topic modeling substantially improves CNN classification performance.Keywords
This publication has 12 references indexed in Scilit:
- Enhancing tumor deepfake detection in MRI scans using adversarial feature fusion ensemblesScientific Reports, 2025
- A novel pruning-enhanced hybrid approach for efficient and accurate brain tumor diagnosisBiomedical Signal Processing and Control, 2025
- Adaptive clustering for medical image analysis using the improved separation indexScientific Reports, 2025
- Artificial intelligence for healthcare: restrained development despite impressive applicationsInfectious Diseases of Poverty, 2025
- Content based medical image retrieval using topic and location modelJournal of Biomedical Informatics, 2019
- An Approach for Multimodal Medical Image Retrieval using Latent Dirichlet Allocation2019
- Breast Histopathological Image Retrieval Based on Latent Dirichlet AllocationIEEE Journal of Biomedical and Health Informatics, 2016
- Geometric Latent Dirichlet Allocation on a Matching Graph for Large-scale Image DatasetsInternational Journal of Computer Vision, 2010
- A Bayesian Hierarchical Model for Learning Natural Scene Categories2005
- Distinctive Image Features from Scale-Invariant KeypointsInternational Journal of Computer Vision, 2004