Perspectives on Advancing Multimodal Learning in Environmental Science and Engineering Studies
- 3 September 2024
- journal article
- review article
- Published by American Chemical Society (ACS) in Environmental Science & Technology
- Vol. 58 (38) , 16690-16703
Abstract
The environment faces increasing anthropogenic impacts, resulting in a rapid increase in environmental issues that undermine the natural capital essential for human wellbeing. These issues are complex and often influenced by various factors represented by data with different modalities. While machine learning (ML) provides data-driven tools for addressing the environmental issues, the current ML models in environmental science and engineering (ES&E) often neglect the utilization of multimodal data. With the advancement in deep learning, multimodal learning (MML) holds promise for comprehensive descriptions of the environmental issues by harnessing data from diverse modalities. This advancement has the potential to significantly elevate the accuracy and robustness of prediction models in ES&E studies, providing enhanced solutions for various environmental modeling tasks. This perspective summarizes MML methodologies and proposes potential applications of MML models in ES&E studies, including environmental quality assessment, prediction of chemical hazards, and optimization of pollution control techniques. Additionally, we discuss the challenges associated with implementing MML in ES&E and propose future research directions in this domain.Keywords
Funding Information
- National Key Research and Development Program of China (2022YFC3902100)
- National Natural Science Foundation of China (22136001)
This publication has 90 references indexed in Scilit:
- Deep learning models for digital image processing: a reviewArtificial Intelligence Review, 2024
- CatNet: Sequence-based deep learning with cross-attention mechanism for identifying endocrine-disrupting chemicalsJournal of Hazardous Materials, 2023
- Integration of multimodal data for large-scale rapid agricultural land evaluation using machine learning and deep learning approachesGeoderma, 2023
- PocketAnchor: Learning structure-based pocket representations for protein-ligand interaction predictionCell Systems, 2023
- Enhancing deep learning for the comprehensive forecast model in flue gas desulfurization systemsControl Engineering Practice, 2023
- An enhanced deep learning approach to assessing inland lake water quality and its response to climate and anthropogenic factorsJournal of Hydrology, 2023
- A review on control and abatement of soil pollution by heavy metals: Emphasis on artificial intelligence in recovery of contaminated soilEnvironmental Research, 2023
- Artificial intelligence for multimodal data integration in oncologyCancer Cell, 2022
- Deep multimodal learning for municipal solid waste sortingScience China Technological Sciences, 2021
- Fully coupled “online” chemistry within the WRF modelAtmospheric Environment, 2005