A ViT‐Based Adaptive Recurrent Mobilenet With Attention Network for Video Compression and Bit‐Rate Reduction Using Improved Heuristic Approach Under Versatile Video Coding
Authors:
- 10 December 2024
- journal article
- research article
- Published by Wiley in Computational Intelligence
- Vol. 40 (6)
Abstract
Video compression received attention from the communities of video processing and deep learning. Modern learning‐aided mechanisms use a hybrid coding approach to reduce redundancy in pixel space across time and space, improving motion compensation accuracy. The experiments in video compression have important improvements in past years. The Versatile Video Coding (VVC) is the primary enhancing standard of video compression which is also referred to as H. 226. The VVC codec is a block‐assisted hybrid codec, making it highly capable and complex. Video coding effectively compresses data while reducing compression artifacts, enhancing the quality and functionality of AI video technologies. However, the traditional models suffer from the incorrect compression of the motion and ineffective compensation frameworks of the motion leading to compression faults with a minimal trade‐off of the rate distortion. This work implements an automated and effective video compression task under VVC using a deep learning approach. Motion estimation is conducted using the Motion Vector (MV) encoder‐decoder model to track movements in the video. Based on these MV, the reconstruction of the frame is carried out to compensate for the motions. The residual images are obtained by using Vision Transformer‐based Adaptive Recurrent MobileNet with Attention Network (ViT‐ARMAN). The parameters optimization of the ViT‐ARMAN is done using the Opposition‐based Golden Tortoise Beetle Optimizer (OGTBO). Entropy coding is used in the training phase of the developed work to find the bit rate of residual images. Extensive experiments were conducted to demonstrate the effectiveness of the developed deep learning‐based method for video compression and bit rate reduction under VVC.Keywords
This publication has 40 references indexed in Scilit:
- Multi-feature fusion for efficient inter prediction in versatile video codingJournal of Real-Time Image Processing, 2024
- iHELP: a model for instant learning of video coding in VR/AR real-time applicationsMultimedia Tools and Applications, 2024
- An efficient hardware architecture of integer motion estimation based on early termination and data reuse for Versatile video codingExpert Systems with Applications, 2023
- Optimized video compression with residual split attention and swin-block artifact contractionJournal of Visual Communication and Image Representation, 2022
- Blind quality scalable video compression algorithm for low bit-rate codingMultimedia Tools and Applications, 2022
- Honey Badger Algorithm: New metaheuristic algorithm for solving optimization problemsMathematics and Computers in Simulation, 2022
- An efficient low-complexity block partition scheme for VVC intra codingJournal of Real-Time Image Processing, 2021
- A frame-level MLP-based bit-rate controller for real-time video transmission using VVC standardJournal of Real-Time Image Processing, 2020
- TSA: Tree-seed algorithm for continuous optimizationExpert Systems with Applications, 2015
- Lion Optimization Algorithm (LOA): A nature-inspired metaheuristic algorithmJournal of Computational Design and Engineering, 2015