Xinyao Sun
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Xinyao Sun has a total of 28 co-authors. Here are the top co-authors by number of shared publications:
- Irene Cheng
Department of Computing Science, University of Alberta, Edmonton, Alberta, Canada
12 shared publications - Subhayan Mukherjee
Multimedia Research Centre, University of Alberta, Edmonton, AB T6G 2E8, Canada
5 shared publications - Wei Cai
University of Washington
4 shared publications - Zheng Wang
3vGeomatics Inc., Vancouver, BC V5Y 0M6, Canada
4 shared publications Aaron Zimmer
3vGeomatics Inc
3 shared publicationsNavaneeth Kamballur Kottayil
University of Alberta
3 shared publications
Latest Publications
- Open Access
- 8 October 2026
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Multimedia Computing, Communications, and Applications
- Vol. 22 (10) , 1-21
Fully Decentralized NFT Storage through Frequency Domain Neural Network Compression
Non-Fungible Tokens (NFTs) and other Web3 multimedia are typically stored off-chain because image and video assets exceed practical on-chain storage budgets, creating a gap between immutable ownership records and long-term media availability. This article proposes a collection-level neural compression approach that converts an entire NFT collection into a single compact decoder. The decoder maps a token’s integer index directly to its reconstructed image and is intentionally trained to memorize the collection so that no per-image latent codes are stored. To minimize the decoder’s on-chain footprint, we parameterize weights in the frequency domain, progressively prune high-frequency coefficients via zigzag-ordered masking, and apply run-length plus Huffman entropy coding to the resulting sparse parameters. Across three 10,000-image NFT benchmarks, Bored Ape Yacht Club (BAYC), Azuki, and CryptoPunks, the compressed artifacts are reduced to 7.63 MB, 17.09 MB, and 3.33 MB, respectively. These artifacts achieve up to \(177\times\) smaller size than PNG while maintaining high reconstruction quality, measured by Peak Signal-to-Noise Ratio (PSNR) and Structural Similarity Index (SSIM), with PSNR \(\geq\) 33 dB and SSIM \(\geq\) 0.967. We further report Ethereum storage gas estimates showing that collection-level on-chain deployment becomes feasible at \(10^{3}\) – \(10^{4}\) USD under representative fee assumptions, reducing on-chain deployment cost by 58.6–99.4%. The main contribution is a collection-level compressed decoder that serves as the deployable on-chain storage artifact, removing dependence on external media hosts and avoiding per-image latent storage. These results demonstrate a practical path to self-contained, on-chain availability of large NFT multimedia collections without relying on external storage networks.- 8 October 2026
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Multimedia Computing, Communications, and Applications
- Vol. 22 (10) , 1-21
Open AccessFully Decentralized NFT Storage through Frequency Domain Neural Network Compression
Non-Fungible Tokens (NFTs) and other Web3 multimedia are typically stored off-chain because image and video assets exceed practical on-chain storage budgets, creating a gap between immutable ownership records and long-term media availability. This article proposes a collection-level neural compression approach that converts an entire NFT collection into a single compact decoder. The decoder maps a token’s integer index directly to its reconstructed image and is intentionally trained to memorize the collection so that no per-image latent codes are stored. To minimize the decoder’s on-chain footprint, we parameterize weights in the frequency domain, progressively prune high-frequency coefficients via zigzag-ordered masking, and apply run-length plus Huffman entropy coding to the resulting sparse parameters. Across three 10,000-image NFT benchmarks, Bored Ape Yacht Club (BAYC), Azuki, and CryptoPunks, the compressed artifacts are reduced to 7.63 MB, 17.09 MB, and 3.33 MB, respectively. These artifacts achieve up to \(177\times\) smaller size than PNG while maintaining high reconstruction quality, measured by Peak Signal-to-Noise Ratio (PSNR) and Structural Similarity Index (SSIM), with PSNR \(\geq\) 33 dB and SSIM \(\geq\) 0.967. We further report Ethereum storage gas estimates showing that collection-level on-chain deployment becomes feasible at \(10^{3}\) – \(10^{4}\) USD under representative fee assumptions, reducing on-chain deployment cost by 58.6–99.4%. The main contribution is a collection-level compressed decoder that serves as the deployable on-chain storage artifact, removing dependence on external media hosts and avoiding per-image latent storage. These results demonstrate a practical path to self-contained, on-chain availability of large NFT multimedia collections without relying on external storage networks. - Open Access
- 22 November 2024
- Published by Association for Computing Machinery (ACM)
- p. 1-13
Advancing Traditional Player Participation in Blockchain Games: Engaging Native Game Mechanics
- 22 November 2024
- Published by Association for Computing Machinery (ACM)
- p. 1-13
Open AccessAdvancing Traditional Player Participation in Blockchain Games: Engaging Native Game Mechanics
- Open Access
- 28 October 2024
- Published by Association for Computing Machinery (ACM)
- p. 11051-11059
SemNFT: A Semantically Enhanced Decentralized Middleware for Digital Asset Immortality
Non-Fungible Tokens (NFTs) have emerged as a pivotal digital asset, offering authenticated ownership of unique digital content. Despite it has gained remarkable traction, yet face pressing storage and verification challenges stemming from blockchain's permanent data costs. Existing off-chain or centralized storage solutions, while being alternatives, also introduce notable security vulnerabilities. We present SemNFT, an innovative decentralized framework integrated with blockchain oracle middleware services, addressing these persistent NFT dilemmas. Our approach compresses NFT source data into compact embeddings encapsulating semantic essence. These arrays are stored on-chain, while facilitating reliable decentralized image reconstruction and ownership verification. We implemented ERC721-compliant smart contracts with supplementary functionalities, demonstrating SemNFT's seamless integrative capabilities within the ecosystem. Extensive evaluations evidence marked storage optimizations and preservation of requisite visual fidelity by comparison with existing solutions. The proposed SemNFT framework marks a significant advancement in holistically confronting rising NFT storage and verification challenges without compromising decentralization. It substantively propels the meaningful evolution of NFT infrastructure to achieve digital asset immortality.
- 28 October 2024
- Published by Association for Computing Machinery (ACM)
- p. 11051-11059
Open AccessSemNFT: A Semantically Enhanced Decentralized Middleware for Digital Asset Immortality
Non-Fungible Tokens (NFTs) have emerged as a pivotal digital asset, offering authenticated ownership of unique digital content. Despite it has gained remarkable traction, yet face pressing storage and verification challenges stemming from blockchain's permanent data costs. Existing off-chain or centralized storage solutions, while being alternatives, also introduce notable security vulnerabilities. We present SemNFT, an innovative decentralized framework integrated with blockchain oracle middleware services, addressing these persistent NFT dilemmas. Our approach compresses NFT source data into compact embeddings encapsulating semantic essence. These arrays are stored on-chain, while facilitating reliable decentralized image reconstruction and ownership verification. We implemented ERC721-compliant smart contracts with supplementary functionalities, demonstrating SemNFT's seamless integrative capabilities within the ecosystem. Extensive evaluations evidence marked storage optimizations and preservation of requisite visual fidelity by comparison with existing solutions. The proposed SemNFT framework marks a significant advancement in holistically confronting rising NFT storage and verification challenges without compromising decentralization. It substantively propels the meaningful evolution of NFT infrastructure to achieve digital asset immortality.
- Open Access
- 2 February 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
- Vol. 17 (19391404) , 5303-5316
GANInSAR: Deep Generative Modeling for Large-Scale InSAR Signal Simulation
Interferometric Synthetic Aperture Radar (InSAR) technology is widely used to create digital elevation models and measure dynamics on the earth's surface, including monitoring ground displacements. The lack of or limited-collected ground-truth data, however, often poses a bottleneck in validating the research outcome, particularly at high precision and resolution levels. To mitigate the gap, we introduce a new Deep Generative Model (DGM) for the simulation of linear deformation rate maps. We demonstrate that our adversarial DGM architecture with carefully designed pre-processing and post-processing modules performs well for InSAR deformation signal synthesis, even when limited data is available. We also introduce a dimensionality reduction method, based on the distance between the real-world and generated image feature vectors, to address the lack of quantitative evaluation for data simulation. Furthermore, we introduce a hybrid evaluation metric integrating quantitative and qualitative measures, which is more intuitive than the existing methods and makes it easier for domain experts to participate in the evaluation. We compare the results of our model with established methods. The comparison result illustrates the superior performance of our proposed method.
- 2 February 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
- Vol. 17 (19391404) , 5303-5316
Open AccessGANInSAR: Deep Generative Modeling for Large-Scale InSAR Signal Simulation
Interferometric Synthetic Aperture Radar (InSAR) technology is widely used to create digital elevation models and measure dynamics on the earth's surface, including monitoring ground displacements. The lack of or limited-collected ground-truth data, however, often poses a bottleneck in validating the research outcome, particularly at high precision and resolution levels. To mitigate the gap, we introduce a new Deep Generative Model (DGM) for the simulation of linear deformation rate maps. We demonstrate that our adversarial DGM architecture with carefully designed pre-processing and post-processing modules performs well for InSAR deformation signal synthesis, even when limited data is available. We also introduce a dimensionality reduction method, based on the distance between the real-world and generated image feature vectors, to address the lack of quantitative evaluation for data simulation. Furthermore, we introduce a hybrid evaluation metric integrating quantitative and qualitative measures, which is more intuitive than the existing methods and makes it easier for domain experts to participate in the evaluation. We compare the results of our model with established methods. The comparison result illustrates the superior performance of our proposed method.
- 10 December 2023
- Published by Springer Nature
- p. 11-13
A Benchmark InSAR Simulator for Phase Filtering and Coherence Estimation
- 10 December 2023
- Published by Springer Nature
- p. 11-13
A Benchmark InSAR Simulator for Phase Filtering and Coherence Estimation
- Open Access
- 26 October 2023
- Published by Association for Computing Machinery (ACM)
- p. 6756-6764
MetaCast: A Self-Driven Metaverse Announcer Architecture Based on Quality of Experience Evaluation Model
Metaverse provides users with a novel experience through immersive multimedia technologies. Along with the rapid user growth, numerous events bursting in the metaverse necessitate an announcer to help catch and monitor ongoing events. However, systems on the market primarily serve for esports competitions and rely on human directors, making it challenging to provide 24-hour delivery in the metaverse persistent world. To fill the blank, we proposed a three-stage architecture for metaverse announcers, which is designed to identify events, position cameras, and blend between shots. Based on the architecture, we introduced a Metaverse Announcer User Experience (MAUE) model to identify the factors affecting the users' Quality of Experience (QoE) from a human-centered perspective. In addition, we implemented MetaCast, a practical self-driven metaverse announcer in a university campus metaverse prototype, to conduct user studies for MAUE model. The experimental results have effectively achieved satisfactory announcer settings that align with the preferences of most users, encompassing parameters such as video transition rate, repetition rate, importance threshold value, and image composition.
- 26 October 2023
- Published by Association for Computing Machinery (ACM)
- p. 6756-6764
Open AccessMetaCast: A Self-Driven Metaverse Announcer Architecture Based on Quality of Experience Evaluation Model
Metaverse provides users with a novel experience through immersive multimedia technologies. Along with the rapid user growth, numerous events bursting in the metaverse necessitate an announcer to help catch and monitor ongoing events. However, systems on the market primarily serve for esports competitions and rely on human directors, making it challenging to provide 24-hour delivery in the metaverse persistent world. To fill the blank, we proposed a three-stage architecture for metaverse announcers, which is designed to identify events, position cameras, and blend between shots. Based on the architecture, we introduced a Metaverse Announcer User Experience (MAUE) model to identify the factors affecting the users' Quality of Experience (QoE) from a human-centered perspective. In addition, we implemented MetaCast, a practical self-driven metaverse announcer in a university campus metaverse prototype, to conduct user studies for MAUE model. The experimental results have effectively achieved satisfactory announcer settings that align with the preferences of most users, encompassing parameters such as video transition rate, repetition rate, importance threshold value, and image composition.
- Open Access
- 26 October 2023
- Published by Association for Computing Machinery (ACM)
- p. 9385-9387
BranchClash: A Fully On-Chain Tower Defense Blockchain Game with New Collaboration Mechanism
Mainstream blockchain games have drawn criticism for prioritizing economic systems over gameplay experience. Influenced by these economically-centered games, existing research on blockchain games predominantly focuses on the financial sector. We have developed BranchClash, a fully on-chain tower defense game on the Sepolia testnet of Ethereum. It introduces chain collaboration, a novel non-economically-centered game mechanism inspired by blockchain technology. BranchClash aims to expand unique game mechanics in blockchain games and explore innovative cooperative modes within the decentralized ecosystem.
- 26 October 2023
- Published by Association for Computing Machinery (ACM)
- p. 9385-9387
Open AccessBranchClash: A Fully On-Chain Tower Defense Blockchain Game with New Collaboration Mechanism
Mainstream blockchain games have drawn criticism for prioritizing economic systems over gameplay experience. Influenced by these economically-centered games, existing research on blockchain games predominantly focuses on the financial sector. We have developed BranchClash, a fully on-chain tower defense game on the Sepolia testnet of Ethereum. It introduces chain collaboration, a novel non-economically-centered game mechanism inspired by blockchain technology. BranchClash aims to expand unique game mechanics in blockchain games and explore innovative cooperative modes within the decentralized ecosystem.
- Open Access
- 24 October 2023
- Published by MDPI AG in Remote Sensing
- Vol. 15 (21) , 5081
A U-Net Approach for InSAR Phase Unwrapping and Denoising
The interferometric synthetic aperture radar (InSAR) imaging technique computes relative distances or surface maps by measuring the absolute phase differences of returned radar signals. The measured phase difference is wrapped in a 2 cycle due to the wave nature of light. Hence, the proper multiple of 2 must be added back during restoration and this process is known as phase unwrapping. The noise and discontinuity present in the wrapped signals pose challenges for error-free unwrapping procedures. Separate denoising and unwrapping algorithms lead to the introduction of additional errors from excessive filtering and changes in the statistical nature of the signal. This can be avoided by joint unwrapping and denoising procedures. In recent years, research efforts have been made using deep-learning-based frameworks, which can learn the complex relationship between the wrapped phase, coherence, and amplitude images to perform better unwrapping than traditional signal processing methods. This research falls predominantly into segmentation- and regression-based unwrapping procedures. The regression-based methods have poor performance while segmentation-based frameworks, like the conventional U-Net, rely on a wrap count estimation strategy with very poor noise immunity. In this paper, we present a two-stage phase unwrapping deep neural network framework based on U-Net, which can jointly unwrap and denoise InSAR phase images. The experimental results demonstrate that our approach outperforms related work in the presence of phase noise and discontinuities with a root mean square error (RMSE) of an order of magnitude lower than the others. Our framework exhibits better noise immunity, with a low average RMSE of 0.11.- 24 October 2023
- Published by MDPI AG in Remote Sensing
- Vol. 15 (21) , 5081
Open AccessA U-Net Approach for InSAR Phase Unwrapping and Denoising
The interferometric synthetic aperture radar (InSAR) imaging technique computes relative distances or surface maps by measuring the absolute phase differences of returned radar signals. The measured phase difference is wrapped in a 2 cycle due to the wave nature of light. Hence, the proper multiple of 2 must be added back during restoration and this process is known as phase unwrapping. The noise and discontinuity present in the wrapped signals pose challenges for error-free unwrapping procedures. Separate denoising and unwrapping algorithms lead to the introduction of additional errors from excessive filtering and changes in the statistical nature of the signal. This can be avoided by joint unwrapping and denoising procedures. In recent years, research efforts have been made using deep-learning-based frameworks, which can learn the complex relationship between the wrapped phase, coherence, and amplitude images to perform better unwrapping than traditional signal processing methods. This research falls predominantly into segmentation- and regression-based unwrapping procedures. The regression-based methods have poor performance while segmentation-based frameworks, like the conventional U-Net, rely on a wrap count estimation strategy with very poor noise immunity. In this paper, we present a two-stage phase unwrapping deep neural network framework based on U-Net, which can jointly unwrap and denoise InSAR phase images. The experimental results demonstrate that our approach outperforms related work in the presence of phase noise and discontinuities with a root mean square error (RMSE) of an order of magnitude lower than the others. Our framework exhibits better noise immunity, with a low average RMSE of 0.11. - 14 April 2023
- Published by Springer Nature
- p. 707-711
ChainSync: A Real-Time Multi-chain ETL System for dApp Development
- 14 April 2023
- Published by Springer Nature
- p. 707-711
ChainSync: A Real-Time Multi-chain ETL System for dApp Development
- Open Access
- 24 February 2023
- Published by MDPI AG in Remote Sensing
- Vol. 15 (5) , 1253
Water Body Extraction from Sentinel-2 Imagery with Deep Convolutional Networks and Pixelwise Category Transplantation
A common task in land-cover classification is water body extraction, wherein each pixel in an image is labelled as either water or background. Water body detection is integral to the field of urban hydrology, with applications ranging from early flood warning to water resource management. Although traditional index-based methods such as the Normalized Difference Water Index (NDWI) and the Modified Normalized Difference Water Index (MNDWI) have been used to detect water bodies for decades, deep convolutional neural networks (DCNNs) have recently demonstrated promising results. However, training these networks requires access to large quantities of high-quality and accurately labelled data, which is often lacking in the field of remotely sensed imagery. Another challenge stems from the fact that the category of interest typically occupies only a small portion of an image and is thus grossly underrepresented in the data. We propose a novel approach to data augmentation—pixelwise category transplantation (PCT)—as a potential solution to both of these problems. Experimental results demonstrate PCT’s ability to improve performance on a variety of models and datasets, achieving an average improvement of 0.749 mean intersection over union (mIoU). Moreover, PCT enables us to outperform the previous high score achieved on the same dataset without introducing a new model architecture. We also explore the suitability of several state-of-the-art segmentation models and loss functions on the task of water body extraction. Finally, we address the shortcomings of previous works by assessing each model on RGB, NIR, and multispectral features to ascertain the relative advantages of each approach. In particular, we find a significant benefit to the inclusion of multispectral bands, with such methods outperforming visible-spectrum models by an average of 4.193 mIoU.
- 24 February 2023
- Published by MDPI AG in Remote Sensing
- Vol. 15 (5) , 1253
Open AccessWater Body Extraction from Sentinel-2 Imagery with Deep Convolutional Networks and Pixelwise Category Transplantation
A common task in land-cover classification is water body extraction, wherein each pixel in an image is labelled as either water or background. Water body detection is integral to the field of urban hydrology, with applications ranging from early flood warning to water resource management. Although traditional index-based methods such as the Normalized Difference Water Index (NDWI) and the Modified Normalized Difference Water Index (MNDWI) have been used to detect water bodies for decades, deep convolutional neural networks (DCNNs) have recently demonstrated promising results. However, training these networks requires access to large quantities of high-quality and accurately labelled data, which is often lacking in the field of remotely sensed imagery. Another challenge stems from the fact that the category of interest typically occupies only a small portion of an image and is thus grossly underrepresented in the data. We propose a novel approach to data augmentation—pixelwise category transplantation (PCT)—as a potential solution to both of these problems. Experimental results demonstrate PCT’s ability to improve performance on a variety of models and datasets, achieving an average improvement of 0.749 mean intersection over union (mIoU). Moreover, PCT enables us to outperform the previous high score achieved on the same dataset without introducing a new model architecture. We also explore the suitability of several state-of-the-art segmentation models and loss functions on the task of water body extraction. Finally, we address the shortcomings of previous works by assessing each model on RGB, NIR, and multispectral features to ascertain the relative advantages of each approach. In particular, we find a significant benefit to the inclusion of multispectral bands, with such methods outperforming visible-spectrum models by an average of 4.193 mIoU.