Deep Learning Approaches To Image Classification: Exploring The Future Of Visual Data Analysis
Open Access
- 1 January 2022
- journal article
- Published by Green Publication
- p. 331-345
Abstract
Over the past decade, deep learning has emerged as a revolutionary technology for the analysis of visual data, particularly images. This master's thesis focuses on deep learning approaches to image classification, which is a key task in many applications using visual data analysis. A state-of-the-art deep learning model, namely the Vision Transformer (ViT), is explored for image classification. ViT is trained using transfer-learning techniques on a new dataset of over 350,000 photographs of European buildings in eight cities, obtained across two separate flights from a drone-mounted camera. Initial results demonstrate that models pre-trained on large datasets such as JFT-300M can achieve performance competitively with the fine-tuning of models trained from scratch on smaller datasets and that ViT outperforms convolutional neural networks for drone-captured images. Further, the prospects of deep learning for image classification are discussed, highlighting the potential impact of new research directions within the architectural vision transformer domain (e.g., Swin-Transformer, CrossViTs, T2T-vision Transformer) and new training techniques (e.g., Vision-Language Pre-training models, multi-modality input). The exponential increase in data generated by cameras, mobile devices, and Internet-of-Things (IoT) sensors has escalated the need for automated processing and analysis of visual data. Furthermore, images and video frames are a popular medium for data collection across various domains, including commercial and industrial. Image classification, or finding the most relevant label for a given photograph, is one key task in many applications using visual data analysis. Popular applications include multimedia search engines, mobile applications navigating to points of interest (POI), and anomaly detection in industrial cameras. As a consequence, many datasets have been assembled, containing millions of photographs collected and labeled according to city, object, or scene. Deep neural networks trained end-to-end directly on pixels have become state-of-the-art image classification technology. More recently, architectures based solely on attention mechanisms, eschewing convolutions, have challenged the long-standing dominance of convolutional neural networks.Keywords
This publication has 15 references indexed in Scilit:
- Towards a Resilient Automotive Industry: AIDriven Strategies for Predictive Maintenance and Supply Chain OptimizationIARJSET, 2024
- Improving operational efficiency and productivity through the fusion of DevOps and SRE practices in multi-cloud operationsInternational Journal of Cloud Computing and Database Management, 2022
- Optimizing Data Stream Processing Pipelines: Using In-Memory DB and Change Data Capture for Low - Latency EnrichmentInternational Journal of Science and Research (IJSR), 2022
- Advancing Predictive Failure Analytics in Automotive Safety: AI-Driven Approaches for School Buses and Commercial TrucksJournal of Artificial Intelligence and Big Data, 2022
- A Comprehensive Review on Generative Models for Anomaly Detection in Financial DataInternational Journal of Science and Research (IJSR), 2021
- A Review on Continuous Integration and Continuous Deployment (CI/CD) for Machine LearningInternational Journal of Science and Research (IJSR), 2021
- Leveraging AI and ML for Enhanced Efficiency and Innovation in Manufacturing: A Comparative AnalysisJournal of Artificial Intelligence and Big Data, 2021
- Minimize Downtime: Container Failover with Distributed Locks in Multi - Region Cloud Deployments for Low - Latency ApplicationsInternational Journal of Science and Research (IJSR), 2020
- Optimizing Fleet Performance: A Deep Learning Approach on AWS IoT and Kafka Streams for Predictive Maintenance of Heavy - Duty EnginesInternational Journal of Science and Research (IJSR), 2019
- From Reactive to Proactive: Employing AI and ML in Automotive Brakes and Parking Systems to Enhance Road SafetyInternational Journal of Science and Research (IJSR), 2018