Hanqiao Yu
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Hanqiao Yu has a total of 5 co-authors. Here are the top co-authors by number of shared publications:
Chen Xu
Department of Mathematics and Statistics, University of Ottawa , Ottawa , ON K1N 6N5 , Canada
1 shared publication- Jianqing Fan
Department of Operations Research and Financial Engineering, Princeton University, Princeton, New Jersey 08544
1 shared publication Liwen Zhang
National Engineering Laboratory of Big Data Analytics, Xi’an Jiaotong University , Xi’an 710049 , China
1 shared publication- Shusen Yang
Xi’an Jiaotong University
1 shared publication - Zongben Xu
Xi’an Jiaotong University
1 shared publication
Latest Publications
- Open Access
- 8 October 2021
- Published by Oxford University Press (OUP) in National Science Review
- Vol. 9 (2) , nwab183
Massive data clustering by multi-scale psychological observations
Clustering is the discovery of latent group structure in data and is a fundamental problem in artificial intelligence, and a vital procedure in data-driven scientific research over all disciplines. Yet, existing methods have various limitations, especially weak cognitive interpretability and poor computational scalability, when it comes to clustering massive datasets that are increasingly available in all domains. Here, by simulating the multi-scale cognitive observation process of humans, we design a scalable algorithm to detect clusters hierarchically hidden in massive datasets. The observation scale changes, following the Weber–Fechner law to capture the gradually emerging meaningful grouping structure. We validated our approach in real datasets with up to a billion records and 2000 dimensions, including taxi trajectories, single-cell gene expressions, face images, computer logs and audios. Our approach outperformed popular methods in usability, efficiency, effectiveness and robustness across different domains.
- 8 October 2021
- Published by Oxford University Press (OUP) in National Science Review
- Vol. 9 (2) , nwab183
Open AccessMassive data clustering by multi-scale psychological observations
Clustering is the discovery of latent group structure in data and is a fundamental problem in artificial intelligence, and a vital procedure in data-driven scientific research over all disciplines. Yet, existing methods have various limitations, especially weak cognitive interpretability and poor computational scalability, when it comes to clustering massive datasets that are increasingly available in all domains. Here, by simulating the multi-scale cognitive observation process of humans, we design a scalable algorithm to detect clusters hierarchically hidden in massive datasets. The observation scale changes, following the Weber–Fechner law to capture the gradually emerging meaningful grouping structure. We validated our approach in real datasets with up to a billion records and 2000 dimensions, including taxi trajectories, single-cell gene expressions, face images, computer logs and audios. Our approach outperformed popular methods in usability, efficiency, effectiveness and robustness across different domains.