XLXinran Li

Xinran Li

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article


Xinran Li has a total of 18 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Open Access

    A Survey of Perceptual Hashing for Multimedia

    by Yuanding Zhou, Xinran Li, Cheng Xiong, Heng Yao, Chuan Qin

    Perceptual hashing is a cutting-edge technique in the field of digital multimedia security, which maps the perceptual content of multimedia information to a fixed-length hash sequence to achieve content authentication. This survey provides a systematic overview of the definition, basic steps, main characters, and application scenarios of perceptual hashing. According to the different authentication objects, representative schemes of perceptual image hashing, perceptual video hashing, and perceptual hashing for neural network models are introduced, respectively. Both perceptual image hashing and perceptual video hashing can be divided into classical methods-based schemes and learning-based schemes, where learning-based schemes can be subdivided into supervised and unsupervised. Classical methods-based image hashing schemes can be divided into four categories: local feature-based, transformation-based, statistical feature-based, and dimensionality reduction-based. Classical methods-based video hashing schemes are mainly categorized into spatial feature-based schemes and spatial-temporal feature-based schemes. Additionally, we introduce the dataset composition and hash distance metric strategies for perceptual hashing and analyze the performance of some representative schemes. Finally, we summarize the existing schemes and offer prospects for future research directions and development trends.


  • An End-to-End Two-Branch Network Towards Robust Video Fingerprinting

    by Yingying Xu, Yuanding Zhou, Xinran Li, Gejian Zhao, Chuan Qin

    With the increasing number of edited videos, many robust video fingerprinting schemes have been proposed to solve the problem of video content authentication. However, most of them either deal with the temporal and spatial features symmetrically or insufficiently consider the temporal information. In this work, an end-to-end two-branch network towards robust video fingerprinting ( RVFNet ) is proposed, where the two branches focus on the temporal and spatial information, respectively. The temporal branch aims to comprehensively capture complex motion patterns by combining subtle motion changes with the overall motion trend. The spatial branch exploits the pixel-level information obtained by multiple receptive fields while preserving significant structural features. Deep metric learning is employed in the training process, and we adopt hard triplet loss to constrain the generation of fingerprints. Furthermore, we construct a large-scale and complex dataset for the robust video fingerprinting task based on multiple video content-preserving manipulations in actual scenarios. The size of our dataset exceeds most datasets adopted in the current robust video fingerprinting schemes. Based on the proposed dataset, experimental results demonstrate that our scheme achieves outstanding performance improvements compared to the state-of-the-art.


  • Robust Image Hashing in Encrypted Domain

    by Xinran Li, Mengqi Guo, Zichi Wang, Jian Li, Chuan Qin

    In recent decades, a large number of robust image hashing methods have been designed for image authentication. However, existing hashing methods generate hash sequences from the plaintext images. To protect the privacy of image content, we propose a robust image hashing method for encrypted images in this article. In our method, the hash sequence of an image can be extracted from its encrypted version without decryption, and the obtained hash sequence is consistent with that extracted from the corresponding plaintext image. To achieve this, the plaintext image is encrypted using Paillier cryptosystem. Then, according to the homomorphism, hash sequence can be extracted using Walsh-Hadamard transform (WHT) and histogram statistic. For application, a general framework for image authentication in encrypted domain is also presented, including three main entities, i.e., image owner, cloud server and authentication user. An image can be efficiently authenticated by the cloud server without disclosing the image content of the image owner. Compared with typical hashing methods that designed for plaintext domain, our method achieves satisfactory privacy-preserving performance, and also has better performances of image authentication, i.e., robustness and discrimination.


  • Unified Performance Evaluation Method for Perceptual Image Hashing

    by Xinran Li, Chuan Qin, Zichi Wang, Zhenxing Qian, Xinpeng Zhang

    In recent decades, a large number of perceptual image hashing schemes have been designed to secure the authenticity and integrity of digital images. However, the feasible criterion to evaluate the performances of hashing schemes has not been developed yet. To this end, a unified performance evaluation method for perceptual image hashing schemes is proposed in this paper. The proposed evaluation method contains six modules: robustness, discrimination, tampering detection, security, computational efficiency and hash length. The order relationship analysis (ORA) is employed to assign the score proportion of each module in accordance with the relative importance of performance, which allows the customizability of user. The real scores of modules and the outputted final score can reflect the performances of perceptual image hashing schemes intuitively and convincingly. Experimental results demonstrate that the proposed evaluation method is practical and effective for the complete and comprehensive evaluation of perceptual image hashing schemes.


  • Open Access

    Perceptual Image Hashing Based on Multitask Neural Network

    by Cheng Xiong, Enli Liu, Xinran Li, Heng Yao, Lei Zhang, Chuan Qin

    With the advent of the era of multimedia and in-depth development, the whole human society has been produced and spread a huge amount of image data, but at the same time, in view of the digital image and tamper with the attack of piracy phenomenon also more and more serious, malicious attacks will produce serious social, military, and political influence, therefore, to protect the authenticity of the original image content, which is also more and more important. In order to further improve the performance of image hashing and enhance the protection of image data, we proposed an end-to-end dual-branch multitask neural network based on VGG-19 to produce a perceptual hash sequence and used prepart of network of pretrained VGG-19 model to extract image features, and then, the image features are transformed into a hash sequence through a convolutional and fully connected network. At the same time, in order to enhance the function of the network and improve the adaptability of the proposed network to using scenarios, the rest part of the network layer of the VGG-19 model was used as another branch for image classification, so as to realize the multitask characteristics of the network. Through the experiment of the testing set, the network can not only resist many kinds of attack operations (content retention operations), but also realize accurate classification about the image, and has a satisfactory tampering detection ability.


  • Criminisi Algorithm Applied to a GelSight Fingertip Sensor for Multi-modality Perception

    by Xinran Li, Wanlin Li, Yu Zheng, Kaspar Althoefer, Peng Qi

    Tactile sensing is an important perception mode for a robot to interact with the external environment and perform tasks such as object manipulation. However, there are still limitations for current artificial tactile sensing technologies to perform manipulation tasks as well as a human. In this paper, we propose a biomimetic tactile sensor based on the principle of the GelSight fingertip tactile sensor [1], but following a different architecture design and using a different image processing algorithm. The contribution of our proposed sensor is to concurrently detect contact force and rebuild the object shape. In this paper, we focus on generalizing the tactile-related information from the force-related information by using the Criminisi algorithm [2]. Concerning the hardware, we use a combination of a coated silicone elastomer (with a marker array across its surface) and an internal spring structure to determine force information. A camera placed at the bottom of the sensor housing captures the deformation of the elastomer surface illuminated by an internal light. With regards to the software, we analyze the position and shape changes of the marker array to distinguish different types of contact forces, however, the use of the markers causes interference in the shape-recognition step, so we apply the Criminisi algorithm to remove the force markers from the captured images and restore the object contour image. We use a Convolutional Neural Network (CNN) to determine the shape of the handled object based on the captured deformation; we achieve an accuracy of 89.6% for shape classification.