RyNet: Multi-Level Attention for Rich and Complementary Feature Representation in CNNs

Authors:

Abstract
Convolutional neural networks (CNNs) excel at extracting spatial and channel-wise features, but reliance on final-layer activations often underutilizes intermediate representations and weakens hierarchical cues. We propose RyNet, a theoretically grounded, modular, and CNN-agnostic dual-attention framework that integrates dynamic channel refinement with multi-level feature fusion in a single backbone. RyNet aggregates low-, mid-, and high-level feature maps, applies channel squeezing with learnable channel-wise attention scores to promote selective activation, and fuses recalibrated features via a lightweight summation strategy. This yields stage-to-stage coupling with implicit spatial emphasis at negligible computational cost. RyNet achieves hierarchical complementarity without branch duplication or concatenation–projection stacks. Integrated into VGG16 and ResNet18, RyNet improves CIFAR-10 test accuracy from 89.90% to 90.84% (a relative improvement of 1.04%) and from 90.42% to 91.74% (a relative improvement of 1.50%), respectively, On the PlantVillage (tomato) dataset, a custom CNN-based model integrated with RyNet achieves 99.61% accuracy, representing a relative improvement of 1.54%. Under identical datasets and training conditions, RyNet consistently and statistically outperforms SE and CBAM, and beyond this, demonstrates superiority over recent CNN–Transformer hybrids and other state-of-the-art methods. Feature-space analysis reveals a 121.9% increase in inter-class separability, while visualizations and interpretability evaluations confirm the effectiveness of dynamic channel selection under multi-level fusion. These results provide strong theoretical, empirical, and statistical validation for the proposed design. Overall, RyNet emerges as a principled, lightweight, and easily integrable module for enhancing CNN representations in resource-constrained environments, with significant performance gains and improved model explainability.