Self-Attention Based Multi-Scale Graph Auto-Encoder Network of 3D Meshes
Preprint
Abstract
3D meshes are fundamental data representations for capturing complex geometric shapes in computer vision and graphics applications. While Convolutional Neural Networks (CNNs) have excelled in structured data like images, extending them to irregular 3D meshes is challenging due to the non-Euclidean nature of the data. Graph Convolutional Networks (GCNs) offer a solution by applying convolutions to graph-structured data, but many existing methods rely on isotropic filters or spectral decomposition, limiting their ability to capture both local and global mesh features. In this paper, we introduce 3D Geometric Mesh Network (3DGeoMeshNet), a novel GCN-based framework that uses anisotropic convolution layers to effectively learn both global and local features directly in the spatial domain. Unlike previous approaches that convert meshes into intermediate representations like voxel grids or point clouds, our method preserves the original polygonal mesh format throughout the reconstruction process, enabling more accurate shape reconstruction. Our architecture features a multi-scale encoder-decoder structure, where separate global and local pathways capture both large-scale geometric structures and fine-grained local details. Extensive experiments on the COMA dataset containing human faces demonstrate the efficiency of 3DGeoMeshNet in terms of reconstruction accuracy.Keywords
All Related Versions
This publication has 7 references indexed in Scilit:
- Deep learning of curvature features for shape completionComputers & Graphics, 2023
- FaceTuneGAN: Face autoencoder for convolutional expression transfer using neural generative adversarial networksComputers & Graphics, 2022
- Robust Mesh Representation Learning via Efficient Local Structure-Aware Anisotropic ConvolutionIEEE Transactions on Neural Networks and Learning Systems, 2022
- Learning a model of facial shape and expression from 4D scansACM Transactions on Graphics, 2017
- Large Scale 3D Morphable ModelsInternational Journal of Computer Vision, 2017
- FaceWarehouse: A 3D Facial Expression Database for Visual ComputingIEEE Transactions on Visualization and Computer Graphics, 2013
- A 3D Face Model for Pose and Illumination Invariant Face Recognition2009