Current Organizations / Institutes

The organizations/institutes from the scholar's latest article

Previous Organizations / Institutes

The organizations / institutes from the scholar's other articles in the past ten years


Jingjing Ji has a total of 47 co-authors. Here are the top co-authors by number of shared publications:

  • Kok-Meng Lee

    George W. Woodruff School of Mechanical Engineering, Georgia Institute of Technology, Atlanta, GA, USA

    8 shared publications
  • Bangyan Niu

    State Key Laboratory of Intelligent Manufacturing Equipment and Technology, Huazhong University of Science and Technology, Wuhan, China

    3 shared publications
  • Huan Ma

    State Key Laboratory of Intelligent Manufacturing Equipment and Technology, Huazhong University of Science and Technology, Wuhan, China

    3 shared publications
  • Jiaoying Jiang

    State Key Laboratory of Intelligent Manufacturing Equipment and Technology, Huazhong University of Science and Technology, Wuhan, China

    3 shared publications
  • Jin Lu

    State Key Laboratory of Intelligent Manufacturing Equipment and Technology, Huazhong University of Science and Technology, Hubei, Wuhan, China

    3 shared publications
  • Jiafeng Zhu

    State Key Laboratory of Intelligent Manufacturing Equipment and Technology, Huazhong University of Science and Technology, Hubei, Wuhan, China

    2 shared publications

Latest Publications

  • A Bilateral, Flexible Sensing Skin Integrated In Situ Self-Compensation for Multi-Modal Measurement of Morphing Wings

    by Dongliang Guo, Mingxuan Hao, Fan Zhang, Xiaodong Lv, Zhangyu Xu, Chao Hou, Jinghui Ling, Weixing Guo, Jingjing Ji, Wuxing Lai

    The utilization of morphing technology in aircraft represents a highly effective approach to improving aerodynamic performance and minimizing energy consumption. However, the deformation of morphing wings requires aerodynamic sensing technology to be versatile and deformable. Flexible electronic technology, characterized by its extreme flexibility and adaptability to irregular surfaces, can be used as a flexible sensing skin for morphing wings. Here, a bilateral, flexible sensing skin integrated in-situ self-compensation is proposed to address these challenges. The multiple sensing units for strain, temperature, and shear-stress are seamlessly integrated on both sides of a flexible substrate through a film modification process involving high-temperature annealing and a double-sided lithography process with laser peeling. Furthermore, a progressive compensation strategy is introduced to mitigate the interference of strain during deformation on the measurements of temperature and shear-stress units. The flexible sensing skin is designed with an "island-bridge" structure to allow for surface stretching. Experiments performed on a morphing wing demonstrate the superiority of the proposed design, suggesting significant potential for future aircraft testing applications.


  • A Mesh-Type Topology Pattern for Robust Marker Tracking in Visuotactile Sensor

    by Huan Ma, Bangyan Niu, Jingjing Ji

    Visuotactile sensors (VTS) perceive the tactile information through the elastomer deformation captured by the embedded camera. Markers are commonly added to the elastomer surface for VTS to get physical process sensing capabilities, whatever the imaging environment. Consequently, the success of marker tracking is a prerequisite for VTS perception. Marker missing and mismatching become one of the biggest limitations of VTS performance improvement. In this paper, a mesh-type topology pattern-based frame-independent marker tracking method is proposed to enhance the tracking robustness, particularly when large deformation occurs. The mesh pattern provides connectivity between different markers and the corresponding algorithm fully utilizes the inherent topological relations of all neighboring markers within the mesh for marker tracking. The effectiveness of the proposed method is validated both numerically and experimentally. The tracking accuracy is qualitatively analyzed by comparing it with traditional tracking methods and further evaluated based on a VTS prototype. Results confirmed that the proposed method significantly enhances the tracking robustness under large deformations and its compatibility with texture perception in photometric stereo environment.

  • Full-Array Markers Tracking Adapted to Large Contact Distortion in Visuotactile Sensing

    by Huan Ma, Jingjing Ji

    Visuotactile sensors (VTS) achieve tactile sensing based on camera-captured images, where the problem of losing markers during tracking may lead to inferior sensor performance. This paper proposes a methodology adapted to large contact distortion in VTS sensing, including the geometric constrained marker pattern design, and the dynamic full-array markers tracking method. The tracking method couples the traditional sparse optical flow (SOF) and the lost marker relocation algorithm, thus it maintains high accuracy in the non-contact region, while the complementary markers are patched in the contact region ensuring the integrity of tracking markers when localized large distortion occurs. Based on the numerical benchmark, the proposed method is compared with the conventional SOF method (two marker patterns with array or checkerboard markers). The results show that, in the case of large deformation, the leakage rate of the tracking markers with the proposed method (0%) is significantly lower compared to that of SOF methods (>10%). Furthermore, a compact binocular VTS is prototyped, where the press-release tests with multiple types of objects are performed, and the contact sensing performance is analyzed. Full-array markers can be tracked dynamically with root mean square error of tracking at the sub-pixel level (0.26 pixels). In terms of dynamic force sensing, the proposed method is capable of tracking sudden changes in contact force by relocating the lost markers, whereas the traditional methods are usually ineffective.


  • Full-Field Deformation Perception via Flexible Sensing Film Integrating Modified Inverse Finite Element Method

    by Jingjing Ji, Jiafeng Zhu, Bangyan Niu, Jin Lu, YongAn Huang

    Full-field deformation can support the adjustment of morphing aircraft’ shape which has significant impacts on the aerodynamic performance. A deformation perception system (DPS) combining an intelligent flexible sensing film (iFlexSense) and a displacement reconstruction algorithm is proposed. The iFlexSense features ultra-thin, low elastic modulus, and geometric conformality. A strain observation has been realized simply by pasting the sensing film to the inner surface of the wing skin. A single-side inverse finite element method (ssiFEM), is proposed for displacement reconstruction from discrete strain observations on just one side of the target structural component, circumventing the requirement of precisely paired sensors in the vanilla iFEM. The full-field displacement is formulated as a closed-form solution combining an offline quasi-stiffness matrix and discrete strain observations. Hence a rapid estimation for the displacement is achieved. The ssiFEM has been validated in simulations on a platy cantilever. The relative error of ssiFEM reaches no more than 3.5% at the maximum deflection point under two typical cases, and after a data densification (DD) step, the mean absolute error averaged the whole cantilever can be reduced. The DD-enhanced ssiFEM has been employed with the prototyped iFlexSense for a practical deformation perception system of a morphing wing skin. The peak error of the perception system was less than 2mm out of a ±30mm deflection range. The application prospects of the system for perceiving smooth shapes can be envisioned.


  • Effects of Differential Magnetic Field/Tensor and Redundant Measurements on Multi-DOF Motion Estimation of a Magnetic Sensing System

    by Jiaoying Jiang, Zixin Que, Kok-Meng Lee, Jingjing Ji

    This paper presents a multi-DOF motion sensing system consisting of a permanent magnet (PM) and a magnetic tensor sensor (MTS) comprising a 3×3 array of three-axis digital magnetic flux density (MFD) sensors, and the methods to measure their relative MTS-PM position/ orientation in a 3D space. The design enables redundant differential measurements of MFD vectors and gradient tensor components to account for the singularities due to matrix inversion, providing a basis to explore different methods for multi-DOF estimation of the PM position/ pose. Formulated as a two-stage linear least-square (LS) problem to take advantage of the dipole simplicity and exploit its physics revealed by its inverse model to guide the design of a fully connected artificial neural network (ANN) to account for the MTS measurement noise and un-modeled factors, a prototype multi-MTS system capable of 5-DOF motion measurements is developed and evaluated experimentally along with a study analyzing the parametric effects on the estimation accuracy; both stationary and moving sensor scenarios are considered. Enhanced with a fully connected ANN, an accuracy within a root-mean-square error (RMSE) of 40μm spatial position and 0.1° pose can be uniquely obtained without subtracting a predetermined geomagnetic field in both fixed and moving multi-MTS scenarios, representing a significant improvement over the (0.5mm, 1°) RMSE of the single-MTS.


  • Sparse Observation Assimilated Digital Image Correlation for High Fidelity Deformation Field Reconstruction

    by Bangyan Niu, Jingjing Ji

    Digital image correlation (DIC) is an image-based deformation measurement method, which has been widely used in multiple cutting-edge fields, benefitted from its noncontact, low cost and high robustness. However, achieving higher accuracy and overcoming the tradeoff between resolution and measurement uncertainty have been recognized as bottleneck problems for DIC. This article proposes a new method by assimilating sparse observations into DIC, constituting “Assimilated DIC,” to reconstruct deformation fields with high fidelity. In the proposed method, the subpixel registration process in the traditional DIC procedure is viewed as a dynamic model, which constitutes the basis for assimilation. Meanwhile, the sparse observation provides highly accurate guidance for correcting the dynamic model, thus facilitating the update of model data towards the ground-truth. In addition to effectively improving the measurement accuracy without lowering the computational efficiency, Assimilated DIC can obtain a higher resolution without compromising the accuracy performance. And the boundary regions of multiconnected structures, which are generally subject to large errors by traditional methods, can be precisely reconstructed by Assimilated DIC. In this article, the proposed method with two types of observations on strain and displacement has been experimentally validated under various deformation cases, including a rigid-body translation, a heterogeneous deformation, and an extension of a holed plate. These excellent properties of Assimilated DIC have been confirmed in comparison with those of a traditional DIC method.


  • Color Machine Vision Design Methodology of a Part-Presentation Algorithm for Automated Poultry Handling

    by Jin Lu, Kok-Meng Lee, Jingjing Ji

    This article offers an image processing method to optimize the design of a three-level color machine vision algorithm illustrated in the context of presenting a whole chicken carcass for subsequent handling, which overcomes some common problems in image segmentation, feature identification, and pose estimation for classifying, identifying, and locating poultry meat products. First, artificial color contrast and principal component analysis are optimized to enhance the contrast between similar colors to extract targeted regions more effectively. Second, the boundaries of poultry products are mostly smooth curves that are proposed as features for object recognition. Third, image feature points are found using template matching, from which the object (size, location, and pose) can be accurately determined. The algorithm simplifies the complex edges of a poultry product into a finite number of arc-centers, which greatly improves the efficiency/accuracy of the matching for part-presentation. Evaluated with 100 randomly posed samples, the algorithm has a success rate of 93%. The 7% failures were primarily due to missing points, which can be eliminated by incorporating more template points.


  • Wearable Magnetic Flexonic Sensor Nodes for Simultaneous Normal Force and Displacement Measurements

    by Jingjing Ji, Chengwei Qiu, Kok-Meng Lee

    Illustrated in the context of home-based stroke rehabilitation, this paper presents the design and development of magnetic flexonic sensor nodes (FSNs) with configurable parameters for simultaneous sensing of normal forces and displacement. The FSN is composed of a magnetic sensor in flexible elements that can be embedded in wearable devices and rapid-prototyped at a low cost to facilitate distributed force sensing applications. As an illustration, a shoe insole with 19 embedded FSN for monitoring the plantar force distribution and arch height has been designed, prototyped, and experimentally evaluated by comparing it with a commercial dynamometric platform. The FSN-embedded insole directly measures the arch height and captures the transients of the plantar forces in five different zones in real-time. Because of the simplicity and low cost, FSNs have the potential to facilitate fabricating low-cost sensing systems, for example, for home-based stroke rehabilitation where the insole stiffness and arch height of the embeddable electronic sensors can be configured according to the patient's specific abnormal plantar distribution to adapt to different range and distribution and wearable configuration during different rehabilitation state.