Multispectral Classification based on H20 and H20 with NaOH Using Image Segmentation and Ensemble Learning EfficientNetV2, Resnet50, MobileNetV3
Open Access
- 1 August 2025
- journal article
- Published by Poltekkes Kemenkes Surabaya in Journal of Electronics, Electromedical Engineering, and Medical Informatics
- Vol. 7 (4) , 1045-1059
Abstract
High Multispectral imaging has become a promising approach in liquid classification, particularly in distinguishing visually similar but subtly spectrally distinct solutions, such as pure water (H₂O) and water mixed with sodium hydroxide (H₂O with NaOH). This study proposed a classification system based on image segmentation and deep learning, utilizing three leading Convolutional Neural Network (CNN) architectures: ResNet 50, EfficientNetV2, and MobileNetV3. Before classification, each multispectral image was processed through color segmentation in HSV space to highlight the dominant spectral, especially in the hue range of 110 170. The model was trained using a data augmentation scheme and optimized with the Adam algorithm, a batch size of 32, and a sigmoid activation function. The dataset consists of 807 images, including 295 H₂O images and 512 H₂O with NaOH images, which were divided into training (64%), validation (16%), and testing (20%) data. Experimental results show that ResNet50 achieves the highest performance, with an accuracy of 93.83% and an F1 score of 93.67%, particularly in identifying alkaline pollution. EfficientNetV2 achieved the lowest loss (0.2001) and exhibited balanced performance across classes, while MobileNetV3, despite being a lightweight model, remained competitive with a recall of 0.97 in the H₂O with NaOH class. Further evaluation with Grad CAM reveals that all models focus on the most critical spectral areas of the segmentation results. These findings support the effectiveness of combining color-based segmentation and CNN in the spectral classification of liquids. This research is expected to serve as a stepping stone in the development of an efficient and accurate automatic liquid classification system for both laboratory and industrial applications.Keywords
This publication has 19 references indexed in Scilit:
- A novel deep learning model for spectral analysis: Lightweight ResNet-CNN with adaptive feature compression for oil spill type identificationSpectrochimica Acta Part A: Molecular and Biomolecular Spectroscopy, 2024
- Deep spectral improvement for unsupervised image instance segmentationPLOS ONE, 2024
- Identification of the best method for detecting surface water in Sentinel-2 multispectral satellite imageryRemote Sensing Applications: Society and Environment, 2024
- Few-shot learning to identify atypical endometrial hyperplasia and endometrial cancer based on transvaginal ultrasonic imagesHeliyon, 2024
- A lightweight method for face expression recognition based on improved MobileNetV3IET Image Processing, 2023
- Research on water seepage detection technology of tunnel asphalt pavement based on deep learning and digital image processingScientific Reports, 2022
- Deep Ensemble CNN Method Based on Sample Expansion for Hyperspectral Image ClassificationIEEE Transactions on Geoscience and Remote Sensing, 2022
- Water Body Extraction from High-resolution Remote Sensing images Based on Scaling EfficientNetsJournal of Physics: Conference Series, 2021
- Grouped data analysis of H2O and H2O mixed with NaOH on multi spectral high fluctuation pattern2017
- Analysis of consistence level using new method of statistical transformation approach in multi-spectral fluctuation pattern2016