Enhanced Mask R-CNN with PANet and PointRend for Detection and Instance Segmentation of Shadow Puppet Characters
Open Access
- 23 October 2026
- journal article
- research article
- Published by MDPI AG in Applied Sciences
- Vol. 16 (21) , 10519
Abstract
The segmentation of Hehuang shadow puppet images holds significant value for artistic creation and cultural preservation. However, it still faces challenges such as the subjective nature of manual segmentation and inaccurate boundary delineation in complex images. To address these challenges, an improved Mask R-CNN model is proposed for precise segmentation of shadow puppet image boundaries. Specifically, inspired by PANet, only its bottom-up path augmentation is adopted after the FPN outputs to shorten the feature fusion path between low-level contour features and high-level semantics. Additionally, Concat replaces residual connections to preserve feature diversity. Finally, the PointRend module is integrated into the mask branch to prevent overly smooth transitions along segmentation mask edges and enhance pixel-level refinement of image boundary segmentation. In this study, a novel COCO-format dataset with 2700 images and seven instance categories was constructed for comprehensive segmentation evaluation. Compared with the baseline, the proposed model achieves relative improvements of 10.1% in bbox_AP for detection and 10.6% in segm_AP for instance segmentation, while segm_AP50 rises from 92.1% to 95.0%. Furthermore, we developed an interactive segmentation system that refines complex boundaries, enhancing the extraction capability of shadow puppet elements and facilitating its application in digital preservation scenarios of shadow puppet heritage.Keywords
Funding Information
- Key R&D and transformation plan of Qinghai Province (2020-GX-113)
This publication has 32 references indexed in Scilit:
- Lightweight Dual-Agent Architecture for 2-D Shadow Puppetry: Real-Time Edge Deployment and EvaluationIEEE Access, 2026
- An efficient computational high-order Dual Hahn polynomials approach for reconstruction, compression, and recognition of large-size signals using machine learningJournal of Computational and Applied Mathematics, 2026
- Automatic Detection of CMEs Using Synthetically-Trained Mask R-CNNSolar Physics, 2026
- Intelligent recognition of visual speech based on custom CNN and Optimized Quaternion Charlier Moments using PSOAin Shams Engineering Journal, 2025
- When MLLMs Meet ICH: A visual retrieval-augmented generation-based method for intangible cultural heritage image recognition-take Shadow Puppetry as a caseInformation Processing & Management, 2025
- Research on Multi‐Feature Fusion Shadow Puppet Motifs Generation Based on CSPMotifsGAN and Cultural Heritage PreservationComputer Animation and Virtual Worlds, 2025
- Innovative Design of Interactive Shadow Puppets for Children Based on STEAM Education Concept2024
- Shadow Puppet Chatbot: Preserving Cultural Tourism2024
- 3D image recognition using new set of fractional-order Legendre moments and deep neural networksSignal Processing: Image Communication, 2021
- Microsoft COCO: Common Objects in Context2014