Enhancing Vision Transformer Performance with Rotation Based Augmentation for Classifying Images of Colon Cancer Pathology
Open Access
- 12 July 2025
- journal article
- Published by Universitas Nusantara PGRI Kediri in INTENSIF: Jurnal Ilmiah Penelitian dan Penerapan Teknologi Sistem Informasi
- Vol. 9 (2) , 235-249
Abstract
Background: In medical imaging, classifying images of colon cancer pathology is still an essential challenge, especially for facilitating early diagnosis and successful intervention. Recently, Vision Transformer (ViT) models have demonstrated great promise for a variety of computer vision tasks, including the classification of medical images. However, the lack of annotated medical datasets and the intrinsic unpredictability of histopathology pictures sometimes restrict their performance. Objective: This study aims to enhance the performance of ViT models in colon cancer pathology classification by introducing a targeted data augmentation strategy, with a particular focus on rotation-based augmentation. Methods: We proposed a data augmentation pipeline that uses controlled changes to improve the number and diversity of training data. Like Rotation, Flip and Geometry are emphasized to replicate the real-world tissue orientation variations that are frequently seen in colon pathology slides. 10,000 JPEG pictures of colon cancer pathology, each with a resolution of 768 x 768 pixels, are used to train the models. We use models trained with and without the suggested augmentation pipeline to compare ViT performance across accuracy, sensitivity, and specificity in order to assess the impact of augmentation. Results: According to study results, rotation-based augmentation enhances ViT performance, achieving up to 99.30% accuracy and 99.50% sensitivity while preserving training times. In real-world pathology settings, where slide orientation varies greatly and can affect categorization consistency, these enhancements are especially pertinent. Conclusion: The proposed rotation-centric data augmentation technique enhances the performance of the ViT model in the classification of images showing colon cancer pathology.Keywords
This publication has 27 references indexed in Scilit:
- Multimodal representations of biomedical knowledge from limited training whole slide images and reports using deep learningMedical Image Analysis, 2024
- A novel convolution transformer-based network for histopathology-image classification using adaptive convolution and dynamic attentionEngineering Applications of Artificial Intelligence, 2024
- CellViT: Vision Transformers for precise cell segmentation and classificationMedical Image Analysis, 2024
- PolyDSS: computer-aided decision support system for multiclass polyp segmentation and classification using deep learningNeural Computing and Applications, 2023
- CaMeL-Net: Centroid-aware metric learning for efficient multi-class cancer classification in pathology imagesComputer Methods and Programs in Biomedicine, 2023
- Transfer learning for histopathology images: an empirical studyNeural Computing and Applications, 2022
- Diagnosing gastrointestinal diseases from endoscopy images through a multi-fused CNN with auxiliary layers, alpha dropouts, and a fusion residual blockBiomedical Signal Processing and Control, 2022
- Deep learning for colon cancer histopathological images analysisComputers in Biology and Medicine, 2021
- A comprehensive review of deep learning in colon cancerComputers in Biology and Medicine, 2020
- Mechanisms to improve clustering uncertain data with UKmeansData & Knowledge Engineering, 2018