Hao Zhang
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Hao Zhang has a total of 11 co-authors. Here are the top co-authors by number of shared publications:
- Boyao Zhou
Department of Automation, Tsinghua University, Beijing, P.R.China
1 shared publication - Hanzhang Tu
Tsinghua University, Beijing, China
1 shared publication - Lili Chen
BOE Technology Group, China
1 shared publication - Meili Wang
BOE Technology Group, China
1 shared publication - Ruizhi Shao
Department of Automation, Tsinghua University, Beijing, P.R.China
1 shared publication - Shengping Zhang
Harbin Institute of Technology, Harbin, China
1 shared publication
Latest Publications
- Open Access
- 13 July 2024
- Published by Association for Computing Machinery (ACM)
- p. 1-12
Tele-Aloha: A Telepresence System with Low-budget and High-authenticity Using Sparse RGB Cameras
In this paper, we present a low-budget and high-authenticity bidirectional telepresence system, Tele-Aloha, targeting peer-to-peer communication scenarios. Compared to previous systems, Tele-Aloha utilizes only four sparse RGB cameras, one consumer-grade GPU, and one autostereoscopic screen to achieve high-resolution (2048x2048), real-time (30 fps), low-latency (less than 150ms) and robust distant communication. As the core of Tele-Aloha, we propose an efficient novel view synthesis algorithm for upper-body. Firstly, we design a cascaded disparity estimator for obtaining a robust geometry cue. Additionally a neural rasterizer via Gaussian Splatting is introduced to project latent features onto target view and to decode them into a reduced resolution. Further, given the high-quality captured data, we leverage weighted blending mechanism to refine the decoded image into the final resolution of 2K. Exploiting world-leading autostereoscopic display and low-latency iris tracking, users are able to experience a strong three-dimensional sense even without any wearable head-mounted display device. Altogether, our telepresence system demonstrates the sense of co-presence in real-life experiments, inspiring the next generation of communication.
- 13 July 2024
- Published by Association for Computing Machinery (ACM)
- p. 1-12
Open AccessTele-Aloha: A Telepresence System with Low-budget and High-authenticity Using Sparse RGB Cameras
In this paper, we present a low-budget and high-authenticity bidirectional telepresence system, Tele-Aloha, targeting peer-to-peer communication scenarios. Compared to previous systems, Tele-Aloha utilizes only four sparse RGB cameras, one consumer-grade GPU, and one autostereoscopic screen to achieve high-resolution (2048x2048), real-time (30 fps), low-latency (less than 150ms) and robust distant communication. As the core of Tele-Aloha, we propose an efficient novel view synthesis algorithm for upper-body. Firstly, we design a cascaded disparity estimator for obtaining a robust geometry cue. Additionally a neural rasterizer via Gaussian Splatting is introduced to project latent features onto target view and to decode them into a reduced resolution. Further, given the high-quality captured data, we leverage weighted blending mechanism to refine the decoded image into the final resolution of 2K. Exploiting world-leading autostereoscopic display and low-latency iris tracking, users are able to experience a strong three-dimensional sense even without any wearable head-mounted display device. Altogether, our telepresence system demonstrates the sense of co-presence in real-life experiments, inspiring the next generation of communication.