Nuo Xu
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Nuo Xu has a total of 10 co-authors. Here are the top co-authors by number of shared publications:
- Chunhua Yang
Central South University
2 shared publications - Feifan Shen
NingboTech University
2 shared publications - Lingjian Ye
School of Engineering, Huzhou University, Huzhou, China
2 shared publications - Weihua Gui
Central South University
2 shared publications - Xiaofeng Yuan
Central South University
2 shared publications - Yalin Wang
Central South University
2 shared publications
Latest Publications
- 24 April 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Neural Networks and Learning Systems
- Vol. 36 (8) , 13794-13804
Hierarchical Self-Attention Network for Industrial Data Series Modeling With Different Sampling Rates Between the Input and Output Sequences
For industrial processes, it is significant to carry out the dynamic modeling of data series for quality prediction. However, there are often different sampling rates between the input and output sequences. For the most traditional data series models, they have to carefully select the labeled sample sequence to build the dynamic prediction model, while the massive unlabeled input sequences between labeled samples are directly discarded. Moreover, the interactions of the variables and samples are usually not fully considered for quality prediction at each labeled step. To handle these problems, a hierarchical self-attention network (HSAN) is designed for adaptive dynamic modeling. In HSAN, a dynamic data augmentation is first designed for each labeled step to include the unlabeled input sequences. Then, a self-attention layer of variable level is proposed to learn the variable interactions and short-interval temporal dependencies. After that, a self-attention layer of sample level is further developed to model the long-interval temporal dependencies. Finally, a long short-term memory network (LSTM) network is constructed to model the new sequence that contains abundant interactions for quality prediction. The experiment on an industrial hydrocracking process shows the effectiveness of HSAN.
- 24 April 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Neural Networks and Learning Systems
- Vol. 36 (8) , 13794-13804
Hierarchical Self-Attention Network for Industrial Data Series Modeling With Different Sampling Rates Between the Input and Output Sequences
For industrial processes, it is significant to carry out the dynamic modeling of data series for quality prediction. However, there are often different sampling rates between the input and output sequences. For the most traditional data series models, they have to carefully select the labeled sample sequence to build the dynamic prediction model, while the massive unlabeled input sequences between labeled samples are directly discarded. Moreover, the interactions of the variables and samples are usually not fully considered for quality prediction at each labeled step. To handle these problems, a hierarchical self-attention network (HSAN) is designed for adaptive dynamic modeling. In HSAN, a dynamic data augmentation is first designed for each labeled step to include the unlabeled input sequences. Then, a self-attention layer of variable level is proposed to learn the variable interactions and short-interval temporal dependencies. After that, a self-attention layer of sample level is further developed to model the long-interval temporal dependencies. Finally, a long short-term memory network (LSTM) network is constructed to model the new sequence that contains abundant interactions for quality prediction. The experiment on an industrial hydrocracking process shows the effectiveness of HSAN.
- Top Cited Papers
- 28 November 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Industrial Informatics
- Vol. 20 (4) , 5253-5262
Attention-Based Interval Aided Networks for Data Modeling of Heterogeneous Sampling Sequences With Missing Values in Process Industry
In complex process industries, multivariate time sequences are omnipresent, whose nonlinearities and dynamics present two major challenges for soft sensing of important quality variables. Consequently, due to the potent representational capabilities, nonlinear dynamic models like gated recurrent unit (GRU) and long short-term memory (LSTM) networks have been used for data sequence modeling. Though it is a common occurrence in many industrial plants, data series with heterogeneous sample intervals and missing values cannot be directly handled by these dynamic algorithms. To this end, attention-based interval-aided networks (AIA-Net) are proposed in this article to adaptively model the temporal information for heterogeneous sampling sequences with missing values in the processes industry. It includes two main mechanisms, which are named attention-based time-aware dynamic imputation and interval-aided time-aware network, respectively. The reduction rate is introduced by the attention-based time-aware dynamic imputation to apply the effects of time intervals and is used in the imputation of missing data. The interval-aided time-aware network includes time intervals in the model structure and uses a sampling interval gate to correct the temporal correlations in time series. The proposed AIA-Net is successfully applied to a real hydrocracking process to predict the C5 and C6 content in the light naphtha.
- 28 November 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Industrial Informatics
- Vol. 20 (4) , 5253-5262
Top Cited PapersAttention-Based Interval Aided Networks for Data Modeling of Heterogeneous Sampling Sequences With Missing Values in Process Industry
In complex process industries, multivariate time sequences are omnipresent, whose nonlinearities and dynamics present two major challenges for soft sensing of important quality variables. Consequently, due to the potent representational capabilities, nonlinear dynamic models like gated recurrent unit (GRU) and long short-term memory (LSTM) networks have been used for data sequence modeling. Though it is a common occurrence in many industrial plants, data series with heterogeneous sample intervals and missing values cannot be directly handled by these dynamic algorithms. To this end, attention-based interval-aided networks (AIA-Net) are proposed in this article to adaptively model the temporal information for heterogeneous sampling sequences with missing values in the processes industry. It includes two main mechanisms, which are named attention-based time-aware dynamic imputation and interval-aided time-aware network, respectively. The reduction rate is introduced by the attention-based time-aware dynamic imputation to apply the effects of time intervals and is used in the imputation of missing data. The interval-aided time-aware network includes time intervals in the model structure and uses a sampling interval gate to correct the temporal correlations in time series. The proposed AIA-Net is successfully applied to a real hydrocracking process to predict the C5 and C6 content in the light naphtha.