Current Organizations / Institutes

The organizations/institutes from the scholar's latest article

Previous Organizations / Institutes

The organizations / institutes from the scholar's other articles in the past ten years


Varun Aggarwal has a total of 17 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Open Access

    SAUCF: A Framework for Secure, Natural-Language-Guided UAS Control

    by Nihar Shah, Varun Aggarwal, Dharmendra Saraswat

    Precision agriculture increasingly recognizes the transformative potential of unmanned aerial systems (UASs) for crop monitoring and field assessment, yet research consistently highlights significant usability barriers as the main constraints to widespread adoption. Complex mission planning processes, including detailed flight plan creation and way point management, pose substantial technical challenges that mainly affect non-expert operators. Farmers and their teams generally prefer user-friendly, straightforward tools, as evidenced by the rapid adoption of GPS guidance systems, which underscores the need for simpler mission planning in UAS operations. To enhance accessibility and safety in UAS control, especially for non-expert operators in agriculture and related fields, we propose a Secure UAS Control Framework (SAUCF): a comprehensive system for natural-language-driven UAS mission management with integrated dual-factor biometric authentication. The framework converts spoken user instructions into executable flight plans by leveraging a language-model-powered mission planner that interprets transcribed voice commands and generates context-aware operational directives, including takeoff, location monitoring, return-to-home, and landing operations. Mission orchestration is performed through a large language model (LLM) agent, coupled with a human-in-the-loop supervision mechanism that enables operators to review, adjust, or confirm mission plans before deployment. Additionally, SAUCF offers a manual override feature, allowing users to assume direct control or interrupt missions at any stage, ensuring safety and adaptability in dynamic environments. Proof-of-concept demonstrations on a UAS plat-form with on-board computing validated reliable speech-to-text transcription, biometric verification via voice matching and face authentication, and effective Sim2Real transfer of natural-language-driven mission plans from simulation environments to physical UAS operations. Initial evaluations showed that SAUCF reduced mission planning time, minimized command errors, and simplified complex multi-objective workflows compared to traditional waypoint-based tools, though comprehensive field validation remains necessary to confirm these preliminary findings. The integration of natural-language-based interaction, real-time identity verification, human-in-the-loop LLM orchestration, and manual override capabilities allows SAUCF to significantly lower the technical barrier to UAS operation while ensuring mission security, operational reliability, and operator agency in real-world conditions. These findings lay the groundwork for systematic field trials and suggest that prioritizing ease of operation in mission planning can drive broader deployment of UAS technologies.

  • Open Access

    GeoDLS: A Deep Learning-Based Corn Disease Tracking and Location System Using RTK Geolocated UAS Imagery

    by Aanis Ahmad, Varun Aggarwal, Dharmendra Saraswat, Aly El Gamal, Gurmukh S. Johal

    Deep learning-based solutions for precision agriculture have recently achieved promising results. Deep learning has been used to identify crop diseases at the initial stages of disease development in an effort to create effective disease management systems. However, the use of deep learning and unmanned aerial system (UAS) imagery to track the spread of diseases, identify diseased regions within cornfields, and notify users with actionable information remains a research gap. Therefore, in this study, high-resolution, UAS-acquired, real-time kinematic (RTK) geotagged, RGB imagery at an altitude of 12 m above ground level (AGL) was used to develop the Geo Disease Location System (GeoDLS), a deep learning-based system for tracking diseased regions in corn fields. UAS images (resolution 8192 × 5460 pixels) were acquired in cornfields located at Purdue University’s Agronomy Center for Research and Education (ACRE), using a DJI Matrice 300 RTK UAS mounted with a 45-megapixel DJI Zenmuse P1 camera during corn stages V14 to R4. A dataset of 5076 images was created by splitting the UAS-acquired images using tile and simple linear iterative clustering (SLIC) segmentation. For tile segmentation, the images were split into tiles of sizes 250 × 250 pixels, 500 × 500 pixels, and 1000 × 1000 pixels, resulting in 1804, 1112, and 570 image tiles, respectively. For SLIC segmentation, 865 and 725 superpixel images were obtained using compactness (m) values of 5 and 10, respectively. Five deep neural network architectures, VGG16, ResNet50, InceptionV3, DenseNet169, and Xception, were trained to identify diseased, healthy, and background regions in corn fields. DenseNet169 identified diseased, healthy, and background regions with the highest testing accuracy of 100.00% when trained on images of tile size 1000 × 1000 pixels. Using a sliding window approach, the trained DenseNet169 model was then used to calculate the percentage of diseased regions present within each UAS image. Finally, the RTK geolocation information for each image was used to update users with the location of diseased regions with an accuracy of within 2 cm through a web application, a smartphone application, and email notifications. The GeoDLS could be a potential tool for an automated disease management system to track the spread of crop diseases, identify diseased regions, and provide actionable information to the users.


  • Open Access

    4Weed Dataset: Annotated Imagery Weeds Dataset

    by Varun Aggarwal, Aanis Ahmad, Aaron Etienne, Dharmendra Saraswat

    Weeds are a major threat to crops and are responsible for reducing crop yield worldwide. To mitigate their negative effect, it is advantageous to accurately identify them early in the season to prevent their spread throughout the field. Traditionally, farmers rely on manually scouting fields and applying herbicides for different weeds. However, it is easy to confuse between crops with weeds during the early growth stages. Recently, deep learning-based weed identification has become popular as deep learning relies on convolutional neural networks that are capable of learning important distinguishable features between weeds and crops. However, training robust deep learning models requires access to large imagery datasets. Therefore, an early-season weeds dataset was acquired under field conditions. The dataset consists of 159 Cocklebur images, 139 Foxtail images, 170 Redroot Pigweed images and 150 Giant Ragweed images corresponding to four common weed species found in corn and soybean production systems.. Bounding box annotations were created for each image to prepare the dataset for training both image classification and object detection deep learning networks capable of accurately locating and identifying weeds within corn and soybean fields. (https://osf.io/w9v3j/)


  • Open Access

    Deep Learning-Based Object Detection System for Identifying Weeds Using UAS Imagery

    by Aaron Etienne, Aanis Ahmad, Varun Aggarwal, Dharmendra Saraswat

    Current methods of broadcast herbicide application cause a negative environmental and economic impact. Computer vision methods, specifically those related to object detection, have been reported to aid in site-specific weed management procedures for targeted herbicide application within a field. However, a major challenge to developing a weed detection system is the requirement for a properly annotated database to differentiate between weeds and crops under field conditions. This research involved creating an annotated database of 374 red, green, and blue (RGB) color images organized into monocot and dicot weed classes. The images were acquired from corn and soybean research plots located in north-central Indiana using an unmanned aerial system (UAS) flown at 30 and 10 m heights above ground level (AGL). A total of 25,560 individual weed instances were manually annotated. The annotated database consisted of four different subsets (Training Image Sets 1–4) to train the You Only Look Once version 3 (YOLOv3) deep learning model for five separate experiments. The best results were observed with Training Image Set 4, consisting of images acquired at 10 m AGL. For monocot and dicot weeds, respectively, an average precision (AP) score of 91.48 % and 86.13% was observed at a 25% IoU threshold (AP @ T = 0.25), as well as 63.37% and 45.13% at a 50% IoU threshold (AP @ T = 0.5). This research has demonstrated a need to develop large, annotated weed databases to evaluate deep learning models for weed identification under field conditions. It also affirms the findings of other limited research studies utilizing object detection for weed identification under field conditions.


  • Open Access

    Question Independent Grading using Machine Learning

    by Gursimran Singh, Shashank Srikant, Varun Aggarwal

    Learning supervised models to grade open-ended responses is an expensive process. A model has to be trained for every prompt/question separately, which in turn requires graded samples. In automatic programming evaluation specifically, the focus of this work, this issue is amplified. The models have to be trained not only for every question but also for every language the question is offered in. Moreover, the availability and time taken by experts to create a labeled set of programs for each question is a major bottleneck in scaling such a system. We address this issue by presenting a method to grade computer programs which requires no manually assigned labeled samples for grading responses to a new, unseen question. We extend our previous work [25] wherein we introduced a grammar of features to learn question specific models. In this work, we propose a method to transform those features into a set of features that maintain their structural relation with the labels across questions. Using these features we learn one supervised model, across questions for a given language, which can then be applied to an ungraded response to an unseen question. We show that our method rivals the performance of both, question specific models and the consensus among human experts while substantially outperforming extant ways of evaluating codes. We demonstrate the system single s value by deploying it to grade programs in a high stakes assessment. The learning from this work is transferable to other grading tasks such as math question grading and also provides a new variation to the supervised learning approach.


  • Situational Judgment Test

    by Steven E. Stemler, Varun Aggarwal, Siddharth Nithyanand

  • Open Access

    Spoken English Grading

    by Vinay Shashidhar, Nishant Pandey, Varun Aggarwal

    In this paper, we address the problem of grading spontaneous speech using a combination of machine learning and crowdsourcing. Traditional machine learning techniques solve the stated problem inadequately as automatic speaker-independent speech transcription is inaccurate. The features derived from it are also inaccurate and so is the machine learning model developed for speech evaluation. We propose a framework that combines machine learning with crowdsourcing. This entails identifying human intelligence tasks in the feature derivation step and using crowdsourcing to get them completed. We post the task of speech transcription to a large community of online workers (crowd). We also get spoken English grades from the crowd. We achieve 95% transcription accuracy by combining transcriptions from multiple crowd workers. Speech and prosody features are derived by force aligning the speech samples on these highly accurate transcriptions. Additionally, we derive surface and semantic level features directly from the transcription. We demonstrate the efficacy of our approach by predicting expert graded speech sample of 566 adult non-native speakers across two different countries - India and Philippines. Using the regression modeling technique, we are able achieve a Pearson correlation of 0.79 on the Philippines set and 0.74 on the Indian set with expert grades, an accuracy much higher than any previously reported machine learning approach. Our approach has an accuracy that rivals that of expert agreement. We show the value of the system through a case study in a real-world industrial deployment. This work is timely given the huge requirement of spoken English training and assessment.