A transfer learning approach for predictive modeling of bioprocesses using small data
- 30 October 2021
- journal article
- research article
- Published by Wiley in Biotechnology and Bioengineering
- Vol. 119 (2) , 411-422
Abstract
Predictive modeling of new biochemical systems with small data is a great challenge. To fill this gap, transfer learning, a subdomain of machine learning that serves to transfer knowledge from a generalized model to a more domain‐specific model, provides a promising solution. While transfer learning has been used in natural language processing, image analysis, and chemical engineering fault detection, its application within biochemical engineering has not been systematically explored. In this study, we demonstrated the benefits of transfer learning when applied to predict dynamic behaviors of new biochemical processes. Two different case studies were presented to investigate the accuracy, reliability, and advantage of this innovative modeling approach. We thoroughly discussed the different transfer learning strategies and the effects of topology on transfer learning, comparing the performance of the transfer learning models against benchmark kinetic and data‐driven models. Furthermore, strong connections between the underlying process mechanism and the transfer learning model's optimal structure were highlighted, suggesting the interpretability of transfer learning to enable more accurate prediction than a naive data‐driven modeling approach. Therefore, this study shows a novel approach to effectively combining data from different resources for bioprocess simulation.Keywords
Funding Information
- Engineering and Physical Sciences Research Council (EP/T031123/1)
- National Natural Science Foundation of China (21776232, 21978244)
This publication has 32 references indexed in Scilit:
- Artificial neural network modeling for predicting the growth of the microalga Karlodinium veneficumAlgal Research, 2016
- Dynamic modeling and optimization of cyanobacterial C-phycocyanin production process by artificial neural networkAlgal Research, 2016
- Transfer learning for speech and language processing2015
- Simultaneous enhancement of CO2 fixation and lutein production with thermo-tolerant Desmodesmus sp. F51 using a repeated fed-batch cultivation strategyBiochemical Engineering Journal, 2014
- Phototrophic cultivation of a thermo-tolerant Desmodesmus sp. for lutein production: Effects of nitrate concentration, light intensity and fed-batch operationBioresource Technology, 2013
- A Survey on Transfer LearningIEEE Transactions on Knowledge and Data Engineering, 2009
- An overview of simultaneous strategies for dynamic optimizationChemical Engineering and Processing - Process Intensification, 2007
- Model based control of a yeast fermentation bioreactor using optimally designed artificial neural networksChemical Engineering Journal, 2007
- Application of artificial neural network coupling particle swarm optimization algorithm to biocatalytic production of GABABiotechnology and Bioengineering, 2006
- On the implementation of an interior-point filter line-search algorithm for large-scale nonlinear programmingMathematical Programming, 2005