Bei Liu
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Bei Liu has a total of 17 co-authors. Here are the top co-authors by number of shared publications:
- Bo Wu
MIT-IBM Watson AI Lab, Cambridge, MA, USA
4 shared publications - Jia Wang
Guangdong Pharmaceutical University, Guangzhou, China
4 shared publications - Jiebo Luo
University of Rochester, Rochester, New York, USA
4 shared publications - Peiye Liu
Bytedance, San Jose, USA
4 shared publications - Qiushi Huang
University of Surrey, Guildford, United Kingdom
4 shared publications - Wen-Huang Cheng
National Taiwan University, Taipei, Taiwan
4 shared publications
Latest Publications
- Open Access
- 9 November 2026
- Published by Association for Computing Machinery (ACM)
- p. 17572-17576
SMP Challenge - Social Media Popularity Prediction for Images and Videos
- 9 November 2026
- Published by Association for Computing Machinery (ACM)
- p. 17572-17576
Open AccessSMP Challenge - Social Media Popularity Prediction for Images and Videos
- Open Access
- 27 October 2025
- Published by Association for Computing Machinery (ACM)
- p. 14055-14057
SMPV: Social Media Prediction for Videos
- 27 October 2025
- Published by Association for Computing Machinery (ACM)
- p. 14055-14057
Open AccessSMPV: Social Media Prediction for Videos
- Open Access
- 3 December 2024
- Published by Association for Computing Machinery (ACM)
- p. 1
ViCo: Engaging Video Comment Generation with Human Preference Rewards
- 3 December 2024
- Published by Association for Computing Machinery (ACM)
- p. 1
Open AccessViCo: Engaging Video Comment Generation with Human Preference Rewards
- Open Access
- 28 October 2024
- Published by Association for Computing Machinery (ACM)
- p. 11442-11444
SMP Challenge Summary: Social Media Prediction Challenge
SMP Challenge is an annual challenge that seeks top research teams to develop innovative forecasting methods that can enhance social and business applications. We define and introduce the Social Media Popularity Prediction (SMPP) task that predicting the future popularity of a post made by a specific user at a given time on social media. This task is pivotal in various applications and scenarios, such as online advertising, social recommendations, post ranking, and demand forecasting, etc. To motivate diverse perspectives of social media prediction researches, we built a large-scale benchmark Social Media Prediction Dataset (SMPD) that includes approximately 500K posts, along with associated 756 tags, visual-language data, and spatial-temporal information, and sourced from around 70K users and their profiles. With participation and contribution from top teams worldwide, the challenge has seen continuous performance improvements in recent years, driven by technological advancements. For the latest information, leaderboard or online evaluation, please visit the SMP Challenge Homepage: www.smp-challenge.com.
- 28 October 2024
- Published by Association for Computing Machinery (ACM)
- p. 11442-11444
Open AccessSMP Challenge Summary: Social Media Prediction Challenge
SMP Challenge is an annual challenge that seeks top research teams to develop innovative forecasting methods that can enhance social and business applications. We define and introduce the Social Media Popularity Prediction (SMPP) task that predicting the future popularity of a post made by a specific user at a given time on social media. This task is pivotal in various applications and scenarios, such as online advertising, social recommendations, post ranking, and demand forecasting, etc. To motivate diverse perspectives of social media prediction researches, we built a large-scale benchmark Social Media Prediction Dataset (SMPD) that includes approximately 500K posts, along with associated 756 tags, visual-language data, and spatial-temporal information, and sourced from around 70K users and their profiles. With participation and contribution from top teams worldwide, the challenge has seen continuous performance improvements in recent years, driven by technological advancements. For the latest information, leaderboard or online evaluation, please visit the SMP Challenge Homepage: www.smp-challenge.com.
- Open Access
- 26 October 2023
- Published by Association for Computing Machinery (ACM)
- p. 9651-9655
SMP Challenge: An Overview and Analysis of Social Media Prediction Challenge
Social Media Popularity Prediction (SMPP) is a crucial task that involves automatically predicting future popularity values of online posts, leveraging vast amounts of multimodal data available on social media platforms. Studying and investigating social media popularity becomes central to various online applications and requires novel methods of comprehensive analysis, multimodal comprehension, and accurate prediction. SMP Challenge is an annual research activity that has spurred academic exploration in this area. This paper summarizes the challenging task, data, and research progress. As a critical resource for evaluating and benchmarking predictive models, we have released a large-scale SMPD benchmark encompassing approximately half a million posts authored by around 70K users. The research progress analysis provides an overall analysis of the solutions and trends in recent years. The SMP Challenge website (www.smp-challenge.com) provides the latest information and news.
- 26 October 2023
- Published by Association for Computing Machinery (ACM)
- p. 9651-9655
Open AccessSMP Challenge: An Overview and Analysis of Social Media Prediction Challenge
Social Media Popularity Prediction (SMPP) is a crucial task that involves automatically predicting future popularity values of online posts, leveraging vast amounts of multimodal data available on social media platforms. Studying and investigating social media popularity becomes central to various online applications and requires novel methods of comprehensive analysis, multimodal comprehension, and accurate prediction. SMP Challenge is an annual research activity that has spurred academic exploration in this area. This paper summarizes the challenging task, data, and research progress. As a critical resource for evaluating and benchmarking predictive models, we have released a large-scale SMPD benchmark encompassing approximately half a million posts authored by around 70K users. The research progress analysis provides an overall analysis of the solutions and trends in recent years. The SMP Challenge website (www.smp-challenge.com) provides the latest information and news.
- 23 February 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Multimedia
- Vol. 25 (15209210) , 9216-9227
Language-Guided Face Animation by Recurrent StyleGAN-Based Generator
Recent works on language-guided image manipulation have shown great power of language in providing rich semantics, especially for face images. However, the other natural information, motions, in language is less explored. In this paper, we leverage the motion information and study a novel task, language-guided face animation, that aims to animate a static face image with the help of languages. To better utilize both semantics and motions from languages, we propose a simple yet effective framework. Specifically, we propose a recurrent motion generator to extract a series of semantic and motion information from the language and feed it along with visual information to a pre-trained StyleGAN to generate high-quality frames. To optimize the proposed framework, three carefully designed loss functions are proposed including a regularization loss to keep the face identity, a path length regularization loss to ensure motion smoothness, and a contrastive loss to enable video synthesis with various language guidance in one single model. Extensive experiments with both qualitative and quantitative evaluations on diverse domains ( e.g., human face, anime face, and dog face) demonstrate the superiority of our model in generating high-quality and realistic videos from one still image with the guidance of language. Code will be available at https://github.com/researchmm/language-guided-animation.git
- 23 February 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Multimedia
- Vol. 25 (15209210) , 9216-9227
Language-Guided Face Animation by Recurrent StyleGAN-Based Generator
Recent works on language-guided image manipulation have shown great power of language in providing rich semantics, especially for face images. However, the other natural information, motions, in language is less explored. In this paper, we leverage the motion information and study a novel task, language-guided face animation, that aims to animate a static face image with the help of languages. To better utilize both semantics and motions from languages, we propose a simple yet effective framework. Specifically, we propose a recurrent motion generator to extract a series of semantic and motion information from the language and feed it along with visual information to a pre-trained StyleGAN to generate high-quality frames. To optimize the proposed framework, three carefully designed loss functions are proposed including a regularization loss to keep the face identity, a path length regularization loss to ensure motion smoothness, and a contrastive loss to enable video synthesis with various language guidance in one single model. Extensive experiments with both qualitative and quantitative evaluations on diverse domains ( e.g., human face, anime face, and dog face) demonstrate the superiority of our model in generating high-quality and realistic videos from one still image with the guidance of language. Code will be available at https://github.com/researchmm/language-guided-animation.git
- 19 July 2021
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Image Processing
- Vol. 30 (10577149) , 6637-6647
Reference-Based Defect Detection Network
The defect detection task can be regarded as a realistic scenario of object detection in the computer vision field and it is widely used in the industrial field. Directly applying vanilla object detector to defect detection task can achieve promising results, while there still exists challenging issues that have not been solved. The first issue is the texture shift which means a trained defect detector model will be easily affected by unseen texture, and the second issue is partial visual confusion which indicates that a partial defect box is visually similar with a complete box. To tackle these two problems, we propose a Reference-based Defect Detection Network (RDDN). Specifically, we introduce template reference and context reference to against those two problems, respectively. Template reference can reduce the texture shift from image, feature or region levels, and encourage the detectors to focus more on the defective area as a result. We can use either well-aligned template images or the outputs of a pseudo template generator as template references in this work, and they are jointly trained with detectors by the supervision of normal samples. To solve the partial visual confusion issue, we propose to leverage the carried context information of context reference, which is the concentric bigger box of each region proposal, to perform more accurate region classification and regression. Experiments on two defect detection datasets demonstrate the effectiveness of our proposed approach.
- 19 July 2021
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Image Processing
- Vol. 30 (10577149) , 6637-6647
Reference-Based Defect Detection Network
The defect detection task can be regarded as a realistic scenario of object detection in the computer vision field and it is widely used in the industrial field. Directly applying vanilla object detector to defect detection task can achieve promising results, while there still exists challenging issues that have not been solved. The first issue is the texture shift which means a trained defect detector model will be easily affected by unseen texture, and the second issue is partial visual confusion which indicates that a partial defect box is visually similar with a complete box. To tackle these two problems, we propose a Reference-based Defect Detection Network (RDDN). Specifically, we introduce template reference and context reference to against those two problems, respectively. Template reference can reduce the texture shift from image, feature or region levels, and encourage the detectors to focus more on the defective area as a result. We can use either well-aligned template images or the outputs of a pseudo template generator as template references in this work, and they are jointly trained with detectors by the supervision of normal samples. To solve the partial visual confusion issue, we propose to leverage the carried context information of context reference, which is the concentric bigger box of each region proposal, to perform more accurate region classification and regression. Experiments on two defect detection datasets demonstrate the effectiveness of our proposed approach.