Region Embedding with Intra and Inter-View Contrastive Learning
Authors:
- Liang ZhangLZLiang Zhang
- Cheng LongCLCheng Long
- Gao CongGCGao Cong
Preprint
Abstract
Unsupervised region representation learning aims to extract dense and effective features from unlabeled urban data. While some efforts have been made for solving this problem based on multiple views, existing methods are still insufficient in extracting representations in a view and/or incorporating representations from different views. Motivated by the success of contrastive learning for representation learning, we propose to leverage it for multi-view region representation learning and design a model called ReMVC (Region Embedding with Multi-View Contrastive Learning) by following two guidelines: i) comparing a region with others within each view for effective representation extraction and ii) comparing a region with itself across different views for cross-view information sharing. We design the intra-view contrastive learning module which helps to learn distinguished region embeddings and the inter-view contrastive learning module which serves as a soft co-regularizer to constrain the embedding parameters and transfer knowledge across multi-views. We exploit the learned region embeddings in two downstream tasks named land usage clustering and region popularity prediction. Extensive experiments demonstrate that our model achieves impressive improvements compared with seven state-of-the-art baseline methods, and the margins are over 30% in the land usage clustering task.Keywords
All Related Versions
This publication has 8 references indexed in Scilit:
- Heterogeneous Graph Neural Network With Multi-View Representation LearningIEEE Transactions on Knowledge and Data Engineering, 2022
- Multiview Deep Graph Infomax to Achieve Unsupervised Graph EmbeddingIEEE Transactions on Cybernetics, 2022
- Towards Pointsets Representation Learning via Self-Supervised Learning and Set AugmentationIEEE Transactions on Pattern Analysis and Machine Intelligence, 2021
- Semantic embedding for regions of interestThe VLDB Journal, 2021
- Multi-View Joint Graph Representation Learning for Urban Region Embedding2020
- SkeletonNet: A Hybrid Network With a Skeleton-Embedding Process for Multi-View Image Representation LearningIEEE Transactions on Multimedia, 2019
- A Survey of Multi-View Representation LearningIEEE Transactions on Knowledge and Data Engineering, 2018
- Modeling User Activity Preference by Leveraging User Spatial Temporal Characteristics in LBSNsIEEE Transactions on Systems, Man, and Cybernetics: Systems, 2014