Current Organizations / Institutes

The organizations/institutes from the scholar's latest article


Nikita Stasenko has a total of 21 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Open Access

    Deep Learning in Precision Agriculture: Artificially Generated VNIR Images Segmentation for Early Postharvest Decay Prediction in Apples

    by Nikita Stasenko, Islomjon Shukhratov, Maxim Savinov, Dmitrii Shadrin, Andrey Somov

    Food quality control is an important task in the agricultural domain at the postharvest stage for avoiding food losses. The latest achievements in image processing with deep learning (DL) and computer vision (CV) approaches provide a number of effective tools based on the image colorization and image-to-image translation for plant quality control at the postharvest stage. In this article, we propose the approach based on Generative Adversarial Network (GAN) and Convolutional Neural Network (CNN) techniques to use synthesized and segmented VNIR imaging data for early postharvest decay and fungal zone predictions as well as the quality assessment of stored apples. The Pix2PixHD model achieved higher results in terms of VNIR images translation from RGB (SSIM = 0.972). Mask R-CNN model was selected as a CNN technique for VNIR images segmentation and achieved 58.861 for postharvest decay zones, 40.968 for fungal zones and 94.800 for both the decayed and fungal zones detection and prediction in stored apples in terms of F1-score metric. In order to verify the effectiveness of this approach, a unique paired dataset containing 1305 RGB and VNIR images of apples of four varieties was obtained. It is further utilized for a GAN model selection. Additionally, we acquired 1029 VNIR images of apples for training and testing a CNN model. We conducted validation on an embedded system equipped with a graphical processing unit. Using Pix2PixHD, 100 VNIR images from RGB images were generated at a rate of 17 frames per second (FPS). Subsequently, these images were segmented using Mask R-CNN at a rate of 0.42 FPS. The achieved results are promising for enhancing the food study and control during the postharvest stage.


  • Dynamic Mode Decomposition and Deep Learning for Postharvest Decay Prediction in Apples

    by Nikita Stasenko, Dmitry Shadrin, Alexandr Katrutsa, Andrey Somov

    The damages and diseases that may occur in apples during the storage and cannot be seen visually at early stages is a significant problem in precision agriculture leading to the loss of the lion share of crop. The difficulty of predicting postharvest degradation of apples while in storage is addressed in this article. For the prediction of postharvest decay zones, we used the Dynamic Mode Decomposition (DMD) method in conjunction with the Mask R-CNN model based on Convolutional Neural Networks (CNNs). For validating this idea we have designed a small greenhouse equipped with necessary sensors and actuators for simulating storage conditions for apples. We collected a dataset which includes 552 images of apples stored under the extreme temperatures and humidity. For DMD reconstructed images demonstrating the growth dynamics of decay in apples, the proposed approach achieves 0.999 Structural Similarity Index Measure (SSIM) and 66.813 Peak Signal to Noise Ratio (PSNR). Mask R-CNN predicted postharvest decay zones in apples with an Average Precision (AP) of 83.809% and F1-score with 83.307%. The proposed method is promising for enhancing food storage and postharvest control in precision agriculture since it is based on contactless sensing with video cameras.


  • Deep Learning for Postharvest Decay Prediction in Apples

    by Nikita Stasenko, Maxim Savinov, Valeriy Burlutskiy, Maria Pukalchik, Andrey Somov

    Artificial Intelligence (AI) is a widely used tool in precision agriculture for estimating the quality of food. It is especially relevant while assessing crops at various harvest and postharvest stages. Crop disease and damage detection is a task of top priority: some postharvest diseases or damages, e.g. decay, may destroy the crops and create toxins harmful to human beings. In this work, we apply U-Net, Deeplab, and Mask R-CNN models based on Convolutional Neural Networks (CNNs) for detecting and predicting the postharvest decay areas in stored apple fruits. Novelty of our approach is separate segmentation and prediction of postharvest decay and non-decay areas in apples. Images were acquired with a custom-made testbed consisting of a digital camera, stepper drivers pallet for apples, and the PC. The dataset of the acquired time-sequenced images of the postharvest apples includes 4440 images and is available online. Mask R-CNN demonstrated the best performance and achieved 98.81% of the mean Average Precision (mAP) for apples and 43.60% of the mAP for postharvest decay zones. The proposed approach is promising for improving the food storage process in precision agriculture.


  • A New Multi-objective Approach to Optimize Irrigation Using a Crop Simulation Model and Weather History

    by Mikhail Gasanov, Daniil Merkulov, Artyom Nikitin, Sergey Matveev, Nikita Stasenko, Anna Petrovskaia, Mariia Pukalchik, Ivan Oseledets


  • Deep Learning for improving the storage process: Accurate and automatic segmentation of spoiled areas on apples

    by Nikita Stasenko, Elizaveta Chernova, Dmitrii Shadrin, George Ovchinnikov, Ivan Krivolapov, Mariia Pukalchik

    Artificial Intelligence (AI) methods and technologies have been successfully applied for recognizing objects, detecting and segmenting RGB images. Today, such technologies are widely used in precision agriculture to estimate food quality, especially when assessing plants and fruits at various harvest stages. There are also several processes taking place in food during the postharvest stages, such as decay and moldy. However, the number of AI approaches allowing for assessing the postharvest food conditions is limited. In this work, we trained U-Net and Deeplab models based on Convolutional Neural Networks (CNNs) to detect and predict decay areas in postharvest apples stored at room temperatures. The models were trained on a dataset that includes 4440 images of apples with segmented decay areas. Images were captured by a digital camera mounted on a custom-made testbed. We achieved 99.71% of the mean Intersection over Union (mIoU) at the testing stage for the U-Net model and 99.99% of the mIoU at the testing stage for the Deeplab model trained on 651 images. We also presented the first masks for decay areas in apples predicted by U-Net. Our approach seems to be promising for improving the food storage process in precision agriculture by enabling the automatic detection and quantification of the decayed areas.