Ruiqi Luo
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Ruiqi Luo has a total of 7 co-authors. Here are the top co-authors by number of shared publications:
- Hao Cai
School of Computer Science and Artificial Intelligence, Wuhan Textile University, Wuhan, Hubei, China
1 shared publication - Jin Huang
School of Computer Science and Artificial Intelligence, Wuhan Textile University, Wuhan, China
1 shared publication - Jinxing Liang
School of Computer Science and Artificial Intelligence, Wuhan Textile University, Wuhan 430200, China
1 shared publication - Junjie Huang
School of Computer and Artificial Intelligence, Wuhan Textile University
1 shared publication - Tao Peng
School of Computer Science and Artificial Intelligence, Wuhan Textile University, Wuhan, China
1 shared publication - Xinrong Hu
Wuhan Textile University
1 shared publication
Latest Publications
- Open Access
- 27 December 2022
- Published by Association for Computing Machinery (ACM)
- p. 1-8
MMTrans: MultiModal Transformer for realistic video virtual try-on
Video virtual try-on methods aim to generate coherent, smooth, and realistic try-on videos, it matches the target clothing with the person in the video in a spatiotemporally consistent manner. Existing methods can match the human body with the clothing and then present it by the way of video, however it will cause the problem of excessive distortion of the grid and poor display effect at last. Given the problem, we found that was due to the neglect of the relationship between inputs lead to the loss of some features, while the conventional convolution operation is difficult to establish the remote information that is crucial in generating globally consistent results, restriction on clothing texture detail can lead to excessive deformation in the process of TPS fitting, make a lot of the try-on method in the final video rendering is not real. For the above problems, we reduce the excessive distortion of the garment during deformation by using a constraint function to regularize the TPS parameters; it also proposes a multimodal two-stage combinatorial Transformer: in the first stage, an interaction module is added, in which the long-distance relationship between people and clothing can be simulated, and then a better remote relationship can be obtained as well as contribute to the performance of TPS; in the second stage, an activation module is added, which can establish a global dependency, and this dependency can make the input important regions in the data are more prominent, which can provide more natural intermediate inputs for subsequent U-net networks. This paper’s method can bring better results for video virtual fitting, and experiments on the VVT dataset prove that the method outperforms previous methods in both quantitative and qualitative aspects.
- 27 December 2022
- Published by Association for Computing Machinery (ACM)
- p. 1-8
Open AccessMMTrans: MultiModal Transformer for realistic video virtual try-on
Video virtual try-on methods aim to generate coherent, smooth, and realistic try-on videos, it matches the target clothing with the person in the video in a spatiotemporally consistent manner. Existing methods can match the human body with the clothing and then present it by the way of video, however it will cause the problem of excessive distortion of the grid and poor display effect at last. Given the problem, we found that was due to the neglect of the relationship between inputs lead to the loss of some features, while the conventional convolution operation is difficult to establish the remote information that is crucial in generating globally consistent results, restriction on clothing texture detail can lead to excessive deformation in the process of TPS fitting, make a lot of the try-on method in the final video rendering is not real. For the above problems, we reduce the excessive distortion of the garment during deformation by using a constraint function to regularize the TPS parameters; it also proposes a multimodal two-stage combinatorial Transformer: in the first stage, an interaction module is added, in which the long-distance relationship between people and clothing can be simulated, and then a better remote relationship can be obtained as well as contribute to the performance of TPS; in the second stage, an activation module is added, which can establish a global dependency, and this dependency can make the input important regions in the data are more prominent, which can provide more natural intermediate inputs for subsequent U-net networks. This paper’s method can bring better results for video virtual fitting, and experiments on the VVT dataset prove that the method outperforms previous methods in both quantitative and qualitative aspects.