Hanwen Zhang
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Hanwen Zhang has a total of 24 co-authors. Here are the top co-authors by number of shared publications:
- Myun Kim
Department of Industrial Design, Pukyong National University, 45, Yongso-ro, Nam-Gu, Busan 48513, Republic of Korea
5 shared publications - Hongyan Liu
Department of Marine Convergence Design Engineering, Pukyong National University, 45, Yongso-ro, Nam-Gu, Busan 48513, Republic of Korea
4 shared publications - Junghee Lee
Department of Marine Convergence Design Engineering, Pukyong National University, 45, Yongso-ro, Nam-Gu, Busan 48513, Republic of Korea
3 shared publications - Yanping Lu
Department of Marine Convergence Design Engineering, Pukyong National University, 45, Yongso-ro, Nam-Gu, Busan 48513, Republic of Korea
3 shared publications - Dandan Wang
Department of Marine Convergence Design Engineering, Pukyong National University, 45, Yongso-ro, Nam-Gu, Busan 48513, Republic of Korea
2 shared publications - Hao Hu
Department of Marine Design Convergence Engineering, Pukyong National University, 45, Yongso-ro, Nam-Gu, Busan 48513, Republic of Korea
2 shared publications
Latest Publications
- Open Access
- 3 June 2026
- Published by MDPI AG in Applied Sciences
- Vol. 16 (11) , 5595
Physics-Informed Transformer Framework for Indoor Acoustic Comfort Optimization in Buildings
Improving indoor acoustic comfort in buildings remains challenging for conventional acoustic design methods because they often rely on empirical formulas, static databases, and limited adaptability to dynamic environmental changes. To address these limitations, this study proposes a physics-informed Transformer framework for indoor acoustic comfort optimization in buildings. The proposed framework integrates measured, simulated, and publicly available acoustic data to construct an adaptive dataset for indoor acoustic modeling. A hierarchical time–frequency attention mechanism is introduced to capture complex acoustic features, while a physics-informed module is incorporated to improve the physical consistency of the predicted acoustic responses. In addition, a dynamic optimization strategy is developed to adjust acoustic parameters under changing indoor conditions while considering both acoustic performance and energy efficiency. Experimental results show that the proposed framework achieves a Mel-spectral distortion of 6.12 dB and a speech intelligibility score of 89.3%, while reducing the prediction errors of reverberation time and early decay time to 0.11 s and 0.09 s, respectively. In practical deployment tests, the proposed method increased the early sound energy ratio by 46.4%, improved reverberation time control accuracy by 41.2%, reduced total energy consumption by 29.7%, and increased the user acoustic comfort score by 38.1%, with an average response time of 1.8 s. These results demonstrate that the proposed framework provides an effective data-driven and physics-informed approach for improving indoor acoustic comfort and energy-efficient acoustic management in buildings.
- 3 June 2026
- Published by MDPI AG in Applied Sciences
- Vol. 16 (11) , 5595
Open AccessPhysics-Informed Transformer Framework for Indoor Acoustic Comfort Optimization in Buildings
Improving indoor acoustic comfort in buildings remains challenging for conventional acoustic design methods because they often rely on empirical formulas, static databases, and limited adaptability to dynamic environmental changes. To address these limitations, this study proposes a physics-informed Transformer framework for indoor acoustic comfort optimization in buildings. The proposed framework integrates measured, simulated, and publicly available acoustic data to construct an adaptive dataset for indoor acoustic modeling. A hierarchical time–frequency attention mechanism is introduced to capture complex acoustic features, while a physics-informed module is incorporated to improve the physical consistency of the predicted acoustic responses. In addition, a dynamic optimization strategy is developed to adjust acoustic parameters under changing indoor conditions while considering both acoustic performance and energy efficiency. Experimental results show that the proposed framework achieves a Mel-spectral distortion of 6.12 dB and a speech intelligibility score of 89.3%, while reducing the prediction errors of reverberation time and early decay time to 0.11 s and 0.09 s, respectively. In practical deployment tests, the proposed method increased the early sound energy ratio by 46.4%, improved reverberation time control accuracy by 41.2%, reduced total energy consumption by 29.7%, and increased the user acoustic comfort score by 38.1%, with an average response time of 1.8 s. These results demonstrate that the proposed framework provides an effective data-driven and physics-informed approach for improving indoor acoustic comfort and energy-efficient acoustic management in buildings.
- Open Access
Design and Performance Optimization of Coastal Wind and Wave Energy Collection Structures
This study proposes a health and performance optimization framework based on Particle Swarm Optimization (PSO) to improve the structural performance and energy utilization efficiency of coastal wind–wave energy harvesting systems. A semi-submersible floating wind turbine–wave energy integrated system is selected as the case study. The control variable method and numerical simulations are employed to determine the optimal structural parameters. Furthermore, a multi-scenario coordinated optimization model for wind, wave, energy storage, and load is established using the Velocity Pause Particle Swarm Optimization (VPPSO) algorithm. The optimal structural parameters are identified as an outer diameter of 16 m, an inner diameter of 8 m, a height of 8 m, and a draft of 3.5 m. The results show that VPPSO achieves faster convergence and better optimization performance compared to conventional algorithms. In the optimal scenario with wind–wave curtailment and energy storage participation, the minimum economic cost of 1780 CNY is achieved after 200 iterations. The proposed method provides theoretical guidance for the optimal design and efficient operation of coastal wind–wave energy harvesting systems.
Open AccessDesign and Performance Optimization of Coastal Wind and Wave Energy Collection Structures
This study proposes a health and performance optimization framework based on Particle Swarm Optimization (PSO) to improve the structural performance and energy utilization efficiency of coastal wind–wave energy harvesting systems. A semi-submersible floating wind turbine–wave energy integrated system is selected as the case study. The control variable method and numerical simulations are employed to determine the optimal structural parameters. Furthermore, a multi-scenario coordinated optimization model for wind, wave, energy storage, and load is established using the Velocity Pause Particle Swarm Optimization (VPPSO) algorithm. The optimal structural parameters are identified as an outer diameter of 16 m, an inner diameter of 8 m, a height of 8 m, and a draft of 3.5 m. The results show that VPPSO achieves faster convergence and better optimization performance compared to conventional algorithms. In the optimal scenario with wind–wave curtailment and energy storage participation, the minimum economic cost of 1780 CNY is achieved after 200 iterations. The proposed method provides theoretical guidance for the optimal design and efficient operation of coastal wind–wave energy harvesting systems.
- Open Access
- 19 April 2026
- Published by MDPI AG in Sustainability
- Vol. 18 (8) , 4064
A CLIP-Guided Multi-Objective Optimization Framework for Sustainable Design: Integrating Aesthetic Evaluation, Energy Efficiency, and Life Cycle Environmental Performance
Achieving sustainable design requires balancing environmental performance, resource efficiency, functional feasibility, and aesthetic acceptance throughout the product life cycle. However, traditional design approaches often struggle to quantitatively integrate subjective aesthetic evaluation with objective sustainability indicators such as energy consumption, carbon emissions, and material recyclability. To address this challenge, this study proposes a semantic-guided multi-objective optimization framework for sustainable design that integrates cross-modal aesthetic evaluation with life cycle environmental performance assessment. The proposed framework employs a Contrastive Language–Image Pre-training (CLIP)-based semantic evaluation mechanism to translate abstract sustainability and aesthetic concepts into quantifiable design features, enabling consistent assessment across diverse design solutions. These semantic features are further optimized using a multi-objective evolutionary optimization strategy to simultaneously minimize energy consumption and carbon emissions while maximizing material recovery and design quality. Life cycle environmental indicators derived from OpenLCA datasets are incorporated into the optimization process to ensure practical sustainability relevance. The experimental results demonstrate that the proposed framework achieves a superior performance compared with benchmark optimization methods. Specifically, carbon emission equivalents are reduced to as low as 12.3 kg CO2e, material recovery rates exceed 92%, and total computational energy consumption is reduced by more than 40% relative to comparative models. In addition, the framework shows strong stability and convergence efficiency while maintaining a high aesthetic evaluation accuracy in high-quality design ranges. The findings indicate that the proposed approach provides an effective pathway for integrating aesthetic value with environmental responsibility in sustainable design practice. This framework supports low-carbon and resource-efficient product development and offers practical insights for sustainable manufacturing, circular design, and environmentally conscious innovation.
- 19 April 2026
- Published by MDPI AG in Sustainability
- Vol. 18 (8) , 4064
Open AccessA CLIP-Guided Multi-Objective Optimization Framework for Sustainable Design: Integrating Aesthetic Evaluation, Energy Efficiency, and Life Cycle Environmental Performance
Achieving sustainable design requires balancing environmental performance, resource efficiency, functional feasibility, and aesthetic acceptance throughout the product life cycle. However, traditional design approaches often struggle to quantitatively integrate subjective aesthetic evaluation with objective sustainability indicators such as energy consumption, carbon emissions, and material recyclability. To address this challenge, this study proposes a semantic-guided multi-objective optimization framework for sustainable design that integrates cross-modal aesthetic evaluation with life cycle environmental performance assessment. The proposed framework employs a Contrastive Language–Image Pre-training (CLIP)-based semantic evaluation mechanism to translate abstract sustainability and aesthetic concepts into quantifiable design features, enabling consistent assessment across diverse design solutions. These semantic features are further optimized using a multi-objective evolutionary optimization strategy to simultaneously minimize energy consumption and carbon emissions while maximizing material recovery and design quality. Life cycle environmental indicators derived from OpenLCA datasets are incorporated into the optimization process to ensure practical sustainability relevance. The experimental results demonstrate that the proposed framework achieves a superior performance compared with benchmark optimization methods. Specifically, carbon emission equivalents are reduced to as low as 12.3 kg CO2e, material recovery rates exceed 92%, and total computational energy consumption is reduced by more than 40% relative to comparative models. In addition, the framework shows strong stability and convergence efficiency while maintaining a high aesthetic evaluation accuracy in high-quality design ranges. The findings indicate that the proposed approach provides an effective pathway for integrating aesthetic value with environmental responsibility in sustainable design practice. This framework supports low-carbon and resource-efficient product development and offers practical insights for sustainable manufacturing, circular design, and environmentally conscious innovation.
- Open Access
- 8 April 2026
- Published by MDPI AG in Infrastructures
- Vol. 11 (4) , 132
Design of a Quantitative Evaluation Framework for Highway Landscape Quality Based on Panoramic Image Segmentation
Highway landscape quality is important for visual comfort, environmental coordination, and infrastructure management. However, conventional assessment methods rely heavily on manual inspection and qualitative judgment, which are subjective and inefficient for large-scale applications. To address this issue, this study proposes an AI-based quantitative evaluation framework for highway landscape quality using an improved Panoptic-DeepLab model for panoramic image segmentation. The model identifies major landscape elements in highway scenes, including vegetation, sky, roads, buildings, and billboards. Based on the segmentation results, the proportions of natural elements, spatial openness, and artificial interference are integrated into a landscape quality score (LQS) model for quantitative assessment. Experimental results demonstrate that the proposed method achieves reliable segmentation performance and stable convergence in complex highway environments. Comparative analysis further shows that the method provides competitive accuracy with good computational efficiency. The proposed framework offers an effective tool for highway landscape evaluation and can support highway planning, landscape optimization, and visual environment management.
- 8 April 2026
- Published by MDPI AG in Infrastructures
- Vol. 11 (4) , 132
Open AccessDesign of a Quantitative Evaluation Framework for Highway Landscape Quality Based on Panoramic Image Segmentation
Highway landscape quality is important for visual comfort, environmental coordination, and infrastructure management. However, conventional assessment methods rely heavily on manual inspection and qualitative judgment, which are subjective and inefficient for large-scale applications. To address this issue, this study proposes an AI-based quantitative evaluation framework for highway landscape quality using an improved Panoptic-DeepLab model for panoramic image segmentation. The model identifies major landscape elements in highway scenes, including vegetation, sky, roads, buildings, and billboards. Based on the segmentation results, the proportions of natural elements, spatial openness, and artificial interference are integrated into a landscape quality score (LQS) model for quantitative assessment. Experimental results demonstrate that the proposed method achieves reliable segmentation performance and stable convergence in complex highway environments. Comparative analysis further shows that the method provides competitive accuracy with good computational efficiency. The proposed framework offers an effective tool for highway landscape evaluation and can support highway planning, landscape optimization, and visual environment management.
- Open Access
Data-Driven Material Selection for Flexible Wearable Sensors Under Environmental Coupling Conditions
Flexible wearable electronics have shown strong potential for medical and health monitoring; however, conventional materials often fail to simultaneously satisfy the requirements of signal stability, wear comfort, and environmental adaptability under dynamic use conditions. To address this issue, this study proposes a data-driven material selection framework for flexible wearable sensors based on the extreme gradient boosting (XGBoost) algorithm. The model integrates user perception, material physical parameters, and environmental coupling performance indicators to enable intelligent material matching and recommendation. Experimental results show that the proposed model achieves a recommendation accuracy of 94.5%, outperforming conventional comparison methods. Among the candidate materials, silver nanowires (AgNWs) exhibit superior overall performance, including a higher signal-to-noise ratio, lower skin-contact impedance, and stronger sweat resistance. In physiological monitoring experiments, the maximum deviation of the sensor response was below 3% under both static and motion conditions. In environmental coupling tests, the recommended material improved the system signal-to-noise ratio by 68% and reduced 24-h sensitivity decay by 75%. These results indicate that the proposed XGBoost-based framework can effectively support material selection for flexible wearable sensors and improve signal reliability and environmental adaptability in complex application scenarios.
Open AccessData-Driven Material Selection for Flexible Wearable Sensors Under Environmental Coupling Conditions
Flexible wearable electronics have shown strong potential for medical and health monitoring; however, conventional materials often fail to simultaneously satisfy the requirements of signal stability, wear comfort, and environmental adaptability under dynamic use conditions. To address this issue, this study proposes a data-driven material selection framework for flexible wearable sensors based on the extreme gradient boosting (XGBoost) algorithm. The model integrates user perception, material physical parameters, and environmental coupling performance indicators to enable intelligent material matching and recommendation. Experimental results show that the proposed model achieves a recommendation accuracy of 94.5%, outperforming conventional comparison methods. Among the candidate materials, silver nanowires (AgNWs) exhibit superior overall performance, including a higher signal-to-noise ratio, lower skin-contact impedance, and stronger sweat resistance. In physiological monitoring experiments, the maximum deviation of the sensor response was below 3% under both static and motion conditions. In environmental coupling tests, the recommended material improved the system signal-to-noise ratio by 68% and reduced 24-h sensitivity decay by 75%. These results indicate that the proposed XGBoost-based framework can effectively support material selection for flexible wearable sensors and improve signal reliability and environmental adaptability in complex application scenarios.
- Open Access
- 15 July 2025
- Published by MDPI AG in Journal of Imaging
- Vol. 11 (7) , 241
A Self-Supervised Adversarial Deblurring Face Recognition Network for Edge Devices
With the advancement of information technology, human activity recognition (HAR) has been widely applied in fields such as intelligent surveillance, health monitoring, and human–computer interaction. As a crucial component of HAR, facial recognition plays a key role, especially in vision-based activity recognition. However, current facial recognition models on the market perform poorly in handling blurry images and dynamic scenarios, limiting their effectiveness in real-world HAR applications. This study aims to construct a fast and accurate facial recognition model based on novel adversarial learning and deblurring theory to enhance its performance in human activity recognition. The model employs a generative adversarial network (GAN) as the core algorithm, optimizing its generation and recognition modules by decomposing the global loss function and incorporating a feature pyramid, thereby solving the balance challenge in GAN training. Additionally, deblurring techniques are introduced to improve the model’s ability to handle blurry and dynamic images. Experimental results show that the proposed model achieves high accuracy and recall rates across multiple facial recognition datasets, with an average recall rate of 87.40% and accuracy rates of 81.06% and 79.77% on the YTF, IMDB-WIKI, and WiderFace datasets, respectively. These findings confirm that the model effectively addresses the challenges of recognizing faces in dynamic and blurry conditions in human activity recognition, demonstrating significant application potential.
- 15 July 2025
- Published by MDPI AG in Journal of Imaging
- Vol. 11 (7) , 241
Open AccessA Self-Supervised Adversarial Deblurring Face Recognition Network for Edge Devices
With the advancement of information technology, human activity recognition (HAR) has been widely applied in fields such as intelligent surveillance, health monitoring, and human–computer interaction. As a crucial component of HAR, facial recognition plays a key role, especially in vision-based activity recognition. However, current facial recognition models on the market perform poorly in handling blurry images and dynamic scenarios, limiting their effectiveness in real-world HAR applications. This study aims to construct a fast and accurate facial recognition model based on novel adversarial learning and deblurring theory to enhance its performance in human activity recognition. The model employs a generative adversarial network (GAN) as the core algorithm, optimizing its generation and recognition modules by decomposing the global loss function and incorporating a feature pyramid, thereby solving the balance challenge in GAN training. Additionally, deblurring techniques are introduced to improve the model’s ability to handle blurry and dynamic images. Experimental results show that the proposed model achieves high accuracy and recall rates across multiple facial recognition datasets, with an average recall rate of 87.40% and accuracy rates of 81.06% and 79.77% on the YTF, IMDB-WIKI, and WiderFace datasets, respectively. These findings confirm that the model effectively addresses the challenges of recognizing faces in dynamic and blurry conditions in human activity recognition, demonstrating significant application potential.
- Open Access
- 3 April 2025
- Published by MDPI AG in Sustainability
- Vol. 17 (7) , 3206
Low-Carbon Control of Integrated Energy by Combining Cuckoo Search Algorithm and Particle Swarm Optimization Algorithm
With the increasing severity of global climate change, low-carbon development has become a key issue in the energy industry. As an effective way to optimize energy utilization and reduce carbon emissions, integrated energy system is receiving increasing attention. However, existing low-carbon control methods still face many challenges in improving system efficiency and reducing carbon emissions, and the ability of multi-energy cooperative scheduling and optimal control is insufficient. Therefore, a hybrid algorithm combining the particle swarm optimization and cuckoo search algorithms is designed to adjust the integrated energy low-carbon control capability. The proposed algorithm required fewer iterations than the genetic cuckoo algorithm, which only went through 43 iterations. The convergence speed was improved by 34.8% compared with a single cuckoo algorithm. Among the four scenarios, scenario 4 and scenario 3 had the highest utilization rates of 99.75%, while scenario 1 had the lowest utilization rate of 61.96%. This indicates that the integrated energy system controlled by the particle swarm optimization cuckoo algorithm, while considering carbon capture and storage as well as power-to-gas conversion, can effectively utilize solar energy resources for power generation and achieve energy-saving and emission reduction effects. In summary, this method can help the integrated energy system adapt to various optimization strategies, which promotes the development of low-carbon control technologies in the energy industry.
- 3 April 2025
- Published by MDPI AG in Sustainability
- Vol. 17 (7) , 3206
Open AccessLow-Carbon Control of Integrated Energy by Combining Cuckoo Search Algorithm and Particle Swarm Optimization Algorithm
With the increasing severity of global climate change, low-carbon development has become a key issue in the energy industry. As an effective way to optimize energy utilization and reduce carbon emissions, integrated energy system is receiving increasing attention. However, existing low-carbon control methods still face many challenges in improving system efficiency and reducing carbon emissions, and the ability of multi-energy cooperative scheduling and optimal control is insufficient. Therefore, a hybrid algorithm combining the particle swarm optimization and cuckoo search algorithms is designed to adjust the integrated energy low-carbon control capability. The proposed algorithm required fewer iterations than the genetic cuckoo algorithm, which only went through 43 iterations. The convergence speed was improved by 34.8% compared with a single cuckoo algorithm. Among the four scenarios, scenario 4 and scenario 3 had the highest utilization rates of 99.75%, while scenario 1 had the lowest utilization rate of 61.96%. This indicates that the integrated energy system controlled by the particle swarm optimization cuckoo algorithm, while considering carbon capture and storage as well as power-to-gas conversion, can effectively utilize solar energy resources for power generation and achieve energy-saving and emission reduction effects. In summary, this method can help the integrated energy system adapt to various optimization strategies, which promotes the development of low-carbon control technologies in the energy industry.
- Open Access
Machine Learning-Assisted Catalysts for Advanced Oxidation Processes: Progress, Challenges, and Prospects
Advanced oxidation processes (AOPs) are recognized as one of the most effective methods in the field of wastewater treatment, and the selection of catalysts in the oxidation process is very important. In the face of the traditional test trial-and-error method, the method of screening advanced oxidation catalysts is time-consuming and inefficient. This paper examines approximately two decades’ worth of literature pertaining to the development of catalysts facilitated by machine learning. A synopsis of the various advanced oxidation processes and reactive oxygen species (ROS) is provided. Subsequently, it is posited that the swift advancement of machine learning (ML) and its algorithmic classification has significantly propelled the progress in ML-assisted catalyst screening, active site prediction, the discovery of acceleration mechanisms, and catalyst structural research, which are subsequently elucidated. Despite ML’s proven efficacy as a tool within the domain of AOPs’ catalysis, the article concludes by presenting challenges and outlining future development strategies, particularly in light of issues pertaining to data quality and quantity, as well as inherent model limitations.
Open AccessMachine Learning-Assisted Catalysts for Advanced Oxidation Processes: Progress, Challenges, and Prospects
Advanced oxidation processes (AOPs) are recognized as one of the most effective methods in the field of wastewater treatment, and the selection of catalysts in the oxidation process is very important. In the face of the traditional test trial-and-error method, the method of screening advanced oxidation catalysts is time-consuming and inefficient. This paper examines approximately two decades’ worth of literature pertaining to the development of catalysts facilitated by machine learning. A synopsis of the various advanced oxidation processes and reactive oxygen species (ROS) is provided. Subsequently, it is posited that the swift advancement of machine learning (ML) and its algorithmic classification has significantly propelled the progress in ML-assisted catalyst screening, active site prediction, the discovery of acceleration mechanisms, and catalyst structural research, which are subsequently elucidated. Despite ML’s proven efficacy as a tool within the domain of AOPs’ catalysis, the article concludes by presenting challenges and outlining future development strategies, particularly in light of issues pertaining to data quality and quantity, as well as inherent model limitations.
- Open Access
- 1 March 2024
- Published by MDPI AG in Biomimetics
- Vol. 9 (3) , 150
Motor Interaction Control Based on Muscle Force Model and Depth Reinforcement Strategy
The current motion interaction model has the problems of insufficient motion fidelity and lack of self-adaptation to complex environments. To address this problem, this study proposed to construct a human motion control model based on the muscle force model and stage particle swarm, and based on this, this study utilized the deep deterministic gradient strategy algorithm to construct a motion interaction control model based on the muscle force model and the deep reinforcement strategy. Empirical analysis of the human motion control model proposed in this study revealed that the joint trajectory correlation and muscle activity correlation of the model were higher than those of other comparative models, and its joint trajectory correlation was up to 0.90, and its muscle activity correlation was up to 0.84. In addition, this study validated the effectiveness of the motion interaction control model using the depth reinforcement strategy and found that in the mixed-obstacle environment, the model’s desired results were obtained by training 1.1 × 103 times, and the walking distance was 423 m, which was better than other models. In summary, the proposed motor interaction control model using the muscle force model and deep reinforcement strategy has higher motion fidelity and can realize autonomous decision making and adaptive control in the face of complex environments. It can provide a theoretical reference for improving the effect of motion control and realizing intelligent motion interaction.
- 1 March 2024
- Published by MDPI AG in Biomimetics
- Vol. 9 (3) , 150
Open AccessMotor Interaction Control Based on Muscle Force Model and Depth Reinforcement Strategy
The current motion interaction model has the problems of insufficient motion fidelity and lack of self-adaptation to complex environments. To address this problem, this study proposed to construct a human motion control model based on the muscle force model and stage particle swarm, and based on this, this study utilized the deep deterministic gradient strategy algorithm to construct a motion interaction control model based on the muscle force model and the deep reinforcement strategy. Empirical analysis of the human motion control model proposed in this study revealed that the joint trajectory correlation and muscle activity correlation of the model were higher than those of other comparative models, and its joint trajectory correlation was up to 0.90, and its muscle activity correlation was up to 0.84. In addition, this study validated the effectiveness of the motion interaction control model using the depth reinforcement strategy and found that in the mixed-obstacle environment, the model’s desired results were obtained by training 1.1 × 103 times, and the walking distance was 423 m, which was better than other models. In summary, the proposed motor interaction control model using the muscle force model and deep reinforcement strategy has higher motion fidelity and can realize autonomous decision making and adaptive control in the face of complex environments. It can provide a theoretical reference for improving the effect of motion control and realizing intelligent motion interaction.
- Open Access
- 18 January 2024
- Published by MDPI AG in Sustainability
- Vol. 16 (2) , 833
Semantic and Instance Segmentation in Coastal Urban Spatial Perception: A Multi-Task Learning Framework with an Attention Mechanism
With the continuous acceleration of urbanization, urban planning and design require more in-depth research and development. Street view images can express rich urban features and guide residents’ emotions toward a city, thereby providing the most intuitive reflection of their perception of the city’s spatial quality. However, current researchers mainly conduct research on urban spatial quality through subjective experiential judgment, which includes problems such as a high cost and a low judgment accuracy. In response to these problems, this study proposes a multi-task learning urban spatial attribute perception model that integrates an attention mechanism. Via this model, the existing attributes of urban street scenes are analyzed. Then, the model is improved by introducing semantic segmentation and instance segmentation to identify and match the qualities of the urban space. The experimental results show that the multi-task learning urban spatial attribute perception model with an integrated attention mechanism has prediction accuracies of 79.54%, 78.62%, 79.68%, 77.42%, 78.45%, and 76.98% for the urban spatial attributes of beauty, boredom, depression, liveliness, safety, and richness, respectively. The accuracy of the multi-task learning urban spatial scene feature image segmentation model with an integrated attention mechanism is 95.4, 94.8, 96.2, 92.1, and 96.7 for roads, walls, sky, vehicles, and buildings, respectively. The multi-task learning urban spatial scene feature image segmentation model with an integrated attention mechanism has a higher recognition accuracy for urban spatial buildings than other models. These research results indicate the model’s effectiveness in matching urban spatial quality with public perception.
- 18 January 2024
- Published by MDPI AG in Sustainability
- Vol. 16 (2) , 833
Open AccessSemantic and Instance Segmentation in Coastal Urban Spatial Perception: A Multi-Task Learning Framework with an Attention Mechanism
With the continuous acceleration of urbanization, urban planning and design require more in-depth research and development. Street view images can express rich urban features and guide residents’ emotions toward a city, thereby providing the most intuitive reflection of their perception of the city’s spatial quality. However, current researchers mainly conduct research on urban spatial quality through subjective experiential judgment, which includes problems such as a high cost and a low judgment accuracy. In response to these problems, this study proposes a multi-task learning urban spatial attribute perception model that integrates an attention mechanism. Via this model, the existing attributes of urban street scenes are analyzed. Then, the model is improved by introducing semantic segmentation and instance segmentation to identify and match the qualities of the urban space. The experimental results show that the multi-task learning urban spatial attribute perception model with an integrated attention mechanism has prediction accuracies of 79.54%, 78.62%, 79.68%, 77.42%, 78.45%, and 76.98% for the urban spatial attributes of beauty, boredom, depression, liveliness, safety, and richness, respectively. The accuracy of the multi-task learning urban spatial scene feature image segmentation model with an integrated attention mechanism is 95.4, 94.8, 96.2, 92.1, and 96.7 for roads, walls, sky, vehicles, and buildings, respectively. The multi-task learning urban spatial scene feature image segmentation model with an integrated attention mechanism has a higher recognition accuracy for urban spatial buildings than other models. These research results indicate the model’s effectiveness in matching urban spatial quality with public perception.