Oscar Ondeng
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Oscar Ondeng has a total of 5 co-authors. Here are the top co-authors by number of shared publications:
Heywood Ouma
Department of Electrical and Information Engineering University of Nairobi Nairobi Kenya
2 shared publications- Heywood Ouma Absaloms
Electrical and Information Engineering, University of Nairobi, Nairobi, Kenya
1 shared publication Peter Akuon
1 shared publication- Peter Akuon
Department of Electrical and Information Engineering, University of Nairobi, Nairobi P.O. Box 30197-00100, Kenya
1 shared publication - Peter Odero Akuon
Department of Electrical and Information Engineering University of Nairobi Nairobi Kenya
1 shared publication
Latest Publications
- Open Access
- 1 January 2025
- Published by Institution of Engineering and Technology (IET) in IET Computer Vision
- Vol. 19 (1)
Frequency Domain Adaptive Filters in Vision Transformers for Small‐Scale Datasets
Transformers have achieved remarkable success in computer vision, but their reliance on self‐attention mechanisms poses challenges for small‐scale datasets due to high computational demands and data requirements. This paper introduces the Multi‐Head Adaptive Filter Frequency Vision Transformer (MAF‐FViT), a Vision Transformer model that replaces self‐attention with frequency‐domain adaptive filters. MAF‐FViT leverages multi‐head adaptive filtering in the frequency domain to capture essential features with reduced computational complexity, providing an efficient alternative for vision tasks on limited data. Training is carried out from scratch without the need for pretraining on large‐scale datasets. The proposed MAF‐FViT model demonstrates strong performance on various image classification tasks, achieving competitive accuracy with a lower parameter count and faster processing times compared to self‐attention‐based models and other models employing alternative token mixers. The multi‐head adaptive filters enable the model to capture complex image features effectively, preserving high classification accuracy while minimising computational load. The results demonstrate that frequency‐domain adaptive filters offer an effective alternative to self‐attention, enabling competitive performance on small‐scale datasets while reducing training time and memory requirements. MAF‐FViT opens avenues for resource‐efficient transformer models in vision applications, making it a promising solution for settings constrained by data or computational resources.
- 1 January 2025
- Published by Institution of Engineering and Technology (IET) in IET Computer Vision
- Vol. 19 (1)
Open AccessFrequency Domain Adaptive Filters in Vision Transformers for Small‐Scale Datasets
Transformers have achieved remarkable success in computer vision, but their reliance on self‐attention mechanisms poses challenges for small‐scale datasets due to high computational demands and data requirements. This paper introduces the Multi‐Head Adaptive Filter Frequency Vision Transformer (MAF‐FViT), a Vision Transformer model that replaces self‐attention with frequency‐domain adaptive filters. MAF‐FViT leverages multi‐head adaptive filtering in the frequency domain to capture essential features with reduced computational complexity, providing an efficient alternative for vision tasks on limited data. Training is carried out from scratch without the need for pretraining on large‐scale datasets. The proposed MAF‐FViT model demonstrates strong performance on various image classification tasks, achieving competitive accuracy with a lower parameter count and faster processing times compared to self‐attention‐based models and other models employing alternative token mixers. The multi‐head adaptive filters enable the model to capture complex image features effectively, preserving high classification accuracy while minimising computational load. The results demonstrate that frequency‐domain adaptive filters offer an effective alternative to self‐attention, enabling competitive performance on small‐scale datasets while reducing training time and memory requirements. MAF‐FViT opens avenues for resource‐efficient transformer models in vision applications, making it a promising solution for settings constrained by data or computational resources.
- 18 December 2024
- Published by Elsevier in Image and Vision Computing
- Vol. 154
Enriching visual feature representations for vision–language tasks using spectral transforms
- 18 December 2024
- Published by Elsevier in Image and Vision Computing
- Vol. 154
Enriching visual feature representations for vision–language tasks using spectral transforms
- Open Access
- 9 October 2023
- Published by MDPI AG in Applied Sciences
- Vol. 13 (19) , 11103
A Review of Transformer-Based Approaches for Image Captioning
Visual understanding is a research area that bridges the gap between computer vision and natural language processing. Image captioning is a visual understanding task in which natural language descriptions of images are automatically generated using vision-language models. The transformer architecture was initially developed in the context of natural language processing and quickly found application in the domain of computer vision. Its recent application to the task of image captioning has resulted in markedly improved performance. In this paper, we briefly look at the transformer architecture and its genesis in attention mechanisms. We more extensively review a number of transformer-based image captioning models, including those employing vision-language pre-training, which has resulted in several state-of-the-art models. We give a brief presentation of the commonly used datasets for image captioning and also carry out an analysis and comparison of the transformer-based captioning models. We conclude by giving some insights into challenges as well as future directions for research in this area.
- 9 October 2023
- Published by MDPI AG in Applied Sciences
- Vol. 13 (19) , 11103
Open AccessA Review of Transformer-Based Approaches for Image Captioning
Visual understanding is a research area that bridges the gap between computer vision and natural language processing. Image captioning is a visual understanding task in which natural language descriptions of images are automatically generated using vision-language models. The transformer architecture was initially developed in the context of natural language processing and quickly found application in the domain of computer vision. Its recent application to the task of image captioning has resulted in markedly improved performance. In this paper, we briefly look at the transformer architecture and its genesis in attention mechanisms. We more extensively review a number of transformer-based image captioning models, including those employing vision-language pre-training, which has resulted in several state-of-the-art models. We give a brief presentation of the commonly used datasets for image captioning and also carry out an analysis and comparison of the transformer-based captioning models. We conclude by giving some insights into challenges as well as future directions for research in this area.