RLRui Liu

Rui Liu

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article


Rui Liu has a total of 26 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Open Access

    Curriculum Learning With Chaos-Aware Gating Mechanism for Infant Cardiorespiratory Status Prediction via Heart Rate Variability and Bedside Data

    by Mingjie Li, Rui Liu, Rosemary Sc Horne, Xiaojun Chang, Flora Y Wong

    Predicting the cardiorespiratory status of extremely preterm infants using signals from bedside monitors is critical for timely intervention in neonatal intensive care units (NICUs), potentially improving long-term outcomes. However, directly adapting existing time series data analysis methods to this task is challenged by the scarcity of neonatal data and the high noise levels inherent to physiological signals in this population. To address these challenges, we propose a novel hybrid neural network that integrates C urriculum L earning and a C haos-aware G ating mechanism, called CLCG. Given the long multivariate physiological sequences, we first apply a sliding-window strategy to segment the data into overlapping windows. For each window, a shared Convolutional Neural Network (CNN) fuses multi-modal signals and extracts localized representations. To increase data diversity and enhance generalization capability, we introduce a curriculum learning-based data augmentation scheme that progressively reduces the number of windows during training. This encourages the model to learn discriminative representations by exposing it to increasingly challenging scenarios with less temporal context. To further mitigate the impact of signal noise and improve temporal modeling, we extract handcrafted features, the Lyapunov exponent, from the heart rate variability (HRV) parameters. These features are incorporated into a novel chaos-aware gate mechanism within the Long Short-Term Memory (LSTM) network. This mechanism guides the gating process based on nonlinear dynamical properties, and suppresses noise-related fluctuations. Finally, a Multi-Layer Perceptron (MLP) predicts the respiratory and hypotensive status over the next five hours. We evaluate our model on two datasets: an in-house cohort of 55 extremely preterm infants from the Monash Children's Hospital, and the publicly available MC-MED dataset from emergency department patients. Our approach outperforms 6 other state-of-the-art time-series models for both datasets, achieving significantly higher F1 scores ( p <0.05). Ablation studies confirm the effectiveness of both curriculum learning and chaos-aware gating mechanism, highlighting the potential of our framework for clinical prediction in high-noise, low-data neonatal care settings.

  • Advancing In-Context Learning for Efficient and Stable Medical Report Generation

    by Mingjie Li, Rui Liu, Zeyi Shi, Mingfei Han, Lina Yao, Zhihui Li, Xiaojun Chang, Kilian M. Pohl, Tauhidul Islam, Lei Xing

    Vision-language models (VLMs) have shown strong generalization across multimodal tasks, but adapting them to medical report generation (MRG) often demands extensive paired image-text data that are limited due to data privacy and annotation cost. In-context learning (ICL) offers a promising training-free alternative, yet standard ICL approaches rely on long demonstration prompts that are computationally inefficient and often yield inconsistent or clinically inaccurate descriptions. To address these challenges, we propose Principal In-Context Vectors (PCVs), a compact latent-guidance framework that distills multimodal demonstrations into stable semantic representations. By extracting hidden states from auto-regressive VLMs and applying principal component analysis (PCA), we identify robust semantic directions that remain stable under input perturbations. These PCVs are then injected into new queries to steer generation toward accurate and clinically meaningful outputs without any model tuning. Extensive experiments on four MRG benchmark datasets show that our approach can enhance both zero-shot and fully supervised generation quality across diverse settings, including cross-center, cross-disease, and longitudinal scenarios. This work provides a lightweight and scalable approach to adapt pre-trained VLMs for practical clinical deployment.

  • Open Access

    You Can Only Tune Normalization: A Simple and Effective Approach to Parameter-Efficient Fine-Tuning

    by Lingyun Huang, Jianxu Mao, Junfei Yi, Ziming Tao, Ziyang Peng, Wei He, Rui Liu, Yaonan Wang

    To tackle the issue of excessive parameter volumes during fine-tuning of large-scale pre-trained models with full parameters, Parameter-Efficient Fine-Tuning (PEFT) methods have been introduced. The core concept involves freezing the backbone network of the model and updating only a small subset of parameters. This strategy not only decreases the number of parameters needed for training but also delivers performance comparable to Full-Tuning, even surpassing it on certain datasets. However, most popular PEFT methods introduce extra parameters or modules for fine-tuning, which come with inherent limitations. In response, we propose a straightforward and efficient PEFT method called You Can Only Tune Normalization (YONO). YONO focuses solely on tuning the normalization layer and the final classification layer of the model. This method avoids adding extra modules, making it easily applicable to any model without causing inference delays. We extensively tested YONO on 28 benchmark datasets, and the results indicate that it requires significantly fewer parameters compared to other advanced PEFT methods. Additionally, we validated YONO’s efficiency and generalizability across various vision models. Finally, we further explore the essence of PEFT methods, whether they learn new knowledge or expose the capabilities that a model has already learned. Our findings suggest that YONO is more sensitive to improvements in dataset quality, making it a promising candidate for future scaling to larger models.


  • Open Access

    Mitigating Data Redundancy to Revitalize Transformer-Based Long-Term Time Series Forecasting System

    by Mingjie Li, Rui Liu, Guangsi Shi, Mingfei Han, Changlin Li, Lina Yao, Xiaojun Chang, Ling Chen

    Long-term time series forecasting (LTSF) is fundamental to various real-world applications, where Transformer-based models have become the dominant framework due to their ability to capture long-range dependencies. However, these models often experience overfitting due to data redundancy in rolling forecasting settings, limiting their generalization ability particularly evident in longer sequences with highly similar adjacent data. In this work, we introduce CLMFormer, a novel framework that mitigates redundancy through curriculum learning and a memory-driven decoder. Specifically, we progressively introduce Bernoulli noise to the training samples, which effectively breaks the high similarity between adjacent data points. This curriculum-driven noise introduction aids the memory-driven decoder by supplying more diverse and representative training data, enhancing the decoder’s ability to model seasonal tendencies and dependencies in the time series data. To further enhance forecasting accuracy, we introduce a memory-driven decoder. This component enables the model to capture seasonal tendencies and dependencies in the time series data and leverages temporal relationships to facilitate the forecasting process. Extensive experiments on six real-world LTSF benchmarks show that CLMFormer consistently improves Transformer-based models by up to 30%, demonstrating its effectiveness in long-horizon forecasting.


  • Open Access

    In-Context Learning for Zero-shot Medical Report Generation

    by Rui Liu, Mingjie Li, Shen Zhao, Ling Chen, Xiaojun Chang, Lina Yao

    Medical report generation (MRG) has emerged as a pivotal research topic in the medical multi-modal field, given its potential to alleviate the heavy workloads of radiologists. Recently, advancements have been made with MRG systems that leverage large multimodal models (LMMs) to generate high-quality reports. To address the challenge of collecting large amounts of paired medical image-report data for training, this paper proposes a zero-shot report generation model based on in-context learning, we call it MCVGen. Departing from traditional in-context learning approaches that directly feed all demonstrations to a pre-trained large model, this work innovates by employing a multi-modal contextual vector (MCV) to represent the contextual information of demonstrations. Initially, we pre-train a medical large multi-modal model (Med-LMM) and secure the last hidden state of each demonstration through the forward pass in Med-LMM. Benefits from the auto-regressive mechanism, the last hidden state garners critical information to the targeted scenarios. Subsequently, we average the multiple MCVs and integrate them with the first hidden state on the new query, thereby shifting the latent states and guiding the model toward acquiring previously unlearned multi-modal contextual information. This approach has the advantage of regulating the number of prompts, thus reducing computational costs. We tested our model on the publicly available IU X-ray and MIMIC datasets, demonstrating its exceptional zero-shot capability on both cross-center and cross-disease evaluations. We hope it could be a viable solution for practical clinical applications.