Yeon-Seung Choo
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Research Interests
Yeon-Seung Choo has a total of 3 co-authors. Here are the top co-authors by number of shared publications:
- Boeun Kim
University of Birmingham
2 shared publications - Hyun-Sik Kim
Korea Electronics Technology Institute, Seoul, Republic of Korea
2 shared publications - Yong-Suk Park
Korea Electronics Technology Institute, Seoul, Republic of Korea
2 shared publications
Latest Publications
- Open Access
- 10 November 2024
- Published by MDPI AG in Applied Sciences
- Vol. 14 (22) , 10322
Supervised Contrastive Learning for 3D Cross-Modal Retrieval
Interoperability between different virtual platforms requires the ability to search and transfer digital assets across platforms. Digital assets in virtual platforms are represented in different forms or modalities, such as images, meshes, and point clouds. The cross-modal retrieval of three-dimensional (3D) object representations is challenging due to data representation diversity, making common feature space discovery difficult. Recent studies have been focused on obtaining feature consistency within the same classes and modalities using cross-modal center loss. However, center features are sensitive to hyperparameter variations, making cross-modal center loss susceptible to performance degradation. This paper proposes a new 3D cross-modal retrieval method that uses cross-modal supervised contrastive learning (CSupCon) and the fixed projection head (FPH) strategy. Contrastive learning mitigates the influence of hyperparameters by maximizing feature distinctiveness. The FPH strategy prevents gradient updates in the projection network, enabling the focused training of the backbone networks. The proposed method shows a mean average precision (mAP) increase of 1.17 and 0.14 in 3D cross-modal object retrieval experiments using ModelNet10 and ModelNet40 datasets compared to state-of-the-art (SOTA) methods.
- 10 November 2024
- Published by MDPI AG in Applied Sciences
- Vol. 14 (22) , 10322
Open AccessSupervised Contrastive Learning for 3D Cross-Modal Retrieval
Interoperability between different virtual platforms requires the ability to search and transfer digital assets across platforms. Digital assets in virtual platforms are represented in different forms or modalities, such as images, meshes, and point clouds. The cross-modal retrieval of three-dimensional (3D) object representations is challenging due to data representation diversity, making common feature space discovery difficult. Recent studies have been focused on obtaining feature consistency within the same classes and modalities using cross-modal center loss. However, center features are sensitive to hyperparameter variations, making cross-modal center loss susceptible to performance degradation. This paper proposes a new 3D cross-modal retrieval method that uses cross-modal supervised contrastive learning (CSupCon) and the fixed projection head (FPH) strategy. Contrastive learning mitigates the influence of hyperparameters by maximizing feature distinctiveness. The FPH strategy prevents gradient updates in the projection network, enabling the focused training of the backbone networks. The proposed method shows a mean average precision (mAP) increase of 1.17 and 0.14 in 3D cross-modal object retrieval experiments using ModelNet10 and ModelNet40 datasets compared to state-of-the-art (SOTA) methods.
- 31 March 2024
- Published by Korean Society for Internet Information (KSII) in KSII Transactions on Internet and Information Systems
- Vol. 18 (3) , 670-684
3D Cross-Modal Retrieval Using Noisy Center Loss and SimSiam for Small Batch Training
KSII Transactions on Internet and Information Systems TIIS Paper Details
- 31 March 2024
- Published by Korean Society for Internet Information (KSII) in KSII Transactions on Internet and Information Systems
- Vol. 18 (3) , 670-684
3D Cross-Modal Retrieval Using Noisy Center Loss and SimSiam for Small Batch Training
KSII Transactions on Internet and Information Systems TIIS Paper Details