XWXundong Wu

Xundong Wu

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article

Previous Organizations / Institutes

The organizations / institutes from the scholar's other articles in the past ten years


Xundong Wu has a total of 36 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Open Access

    Dendritic nonlinearities mitigate communication costs

    by Xundong Wu, Pengfei Zhao, Zilin Yu, Lei Ma, Yifan Gao, Ka-Wa Yip, Huajin Tang, Gang Pan, Panayiota Poirazi, Tiejun Huang


  • SBNN: Slimming binarized neural network

    by Qing Wu, Xiaojin Lu, Shan Xue, Chao Wang, Xundong Wu, Jin Fan


  • Open Access

    Cross-Channel Intragroup Sparsity Neural Network

    by Zhilin Yu, Chao Wang, Xin Wang, Qing Wu, Yong Zhao, Xundong Wu

    Modern deep neural networks rely on overparameterization to achieve state-of-the-art generalization. But overparameterized models are computationally expensive. Network pruning is often employed to obtain less demanding models for deployment. Fine-grained pruning removes individual weights in parameter tensors and can achieve a high model compression ratio with little accuracy degradation. However, it introduces irregularity into the computing dataflow and often does not yield improved model inference efficiency in practice. Coarse-grained model pruning, while realizing satisfactory inference speedup through removal of network weights in groups, e.g. an entire filter, often lead to significant accuracy degradation. This work introduces the cross-channel intragroup (CCI) sparsity structure, which can prevent the inference inefficiency of fine-grained pruning while maintaining outstanding model performance. We then present a novel training algorithm designed to perform well under the constraint imposed by the CCI-Sparsity. Through a series of comparative experiments we show that our proposed CCI-Sparsity structure and the corresponding pruning algorithm outperform prior art in inference efficiency by a substantial margin given suited hardware acceleration in the future.

  • Open Access

    How Dendrites Affect Online Recognition Memory

    by Xundong E. Wu, Gabriel C. Mel, D. J. Strouse, Bartlett W. Mel

    In order to record the stream of autobiographical information that defines our unique personal history, our brains must form durable memories from single brief exposures to the patterned stimuli that impinge on them continuously throughout life. However, little is known about the computational strategies or neural mechanisms that underlie the brain's ability to perform this type of "online" learning. Based on increasing evidence that dendrites act as both signaling and learning units in the brain, we developed an analytical model that relates online recognition memory capacity to roughly a dozen dendritic, network, pattern, and task-related parameters. We used the model to determine what dendrite size maximizes storage capacity under varying assumptions about pattern density and noise level. We show that over a several-fold range of both of these parameters, and over multiple orders-of-magnitude of memory size, capacity is maximized when dendrites contain a few hundred synapses—roughly the natural number found in memory-related areas of the brain. Thus, in comparison to entire neurons, dendrites increase storage capacity by providing a larger number of better-sized learning units. Our model provides the first normative theory that explains how dendrites increase the brain’s capacity for online learning; predicts which combinations of parameter settings we should expect to find in the brain under normal operating conditions; leads to novel interpretations of an array of existing experimental results; and provides a tool for understanding which changes associated with neurological disorders, aging, or stress are most likely to produce memory deficits—knowledge that could eventually help in the design of improved clinical treatments for memory loss. Humans can effortlessly recognize a pattern as familiar even after a single presentation and a long delay, and our capacity to do so even with complex stimuli such as images has been called "almost limitless". How is the information needed to support familiarity judgements stored so rapidly and held so reliably for such a long time? Most theoretical work aimed at understanding the brain's one-shot learning mechanisms has been based on drastically simplified neuron models which omit any representation of the most visually prominent features of neurons—their extensive dendritic arbors. Given recent evidence that individual dendritic branches generate local spikes, and function as separately thresholded learning/responding units inside neurons, we set out to capture mathematically how the numerous parameters needed to describe a dendrite-based neural learning system interact to determine the memory's storage capacity. Using the model, we show that having dendrite-sized learning units provides a large capacity boost compared to a memory based on simplified (dendriteless) neurons, attesting to the importance of dendrites for optimal memory function. Our mathematical model may also prove useful in future efforts to understand how disruptions to dendritic structure and function lead to reduced memory capacity in aging and disease.


  • Open Access

    Binarized Neural Networks on the ImageNet Classification Task

    by Xundong Wu, Yong Wu, Yong Zhao

    We trained Binarized Neural Networks (BNNs) on the high resolution ImageNet ILSVRC-2102 dataset classification task and achieved a good performance. With a moderate size network of 13 layers, we obtained top-5 classification accuracy rate of 84.1 % on validation set through network distillation, much better than previous published results of 73.2% on XNOR network and 69.1% on binarized GoogleNET. We expect networks of better performance can be obtained by following our current strategies. We provide a detailed discussion and preliminary analysis on strategies used in the network training.

  • Open Access

    Resonant Scanning with Large Field of View Reduces Photobleaching and Enhances Fluorescence Yield in STED Microscopy

    by Yong Wu, Xundong Wu, Rong Lu, Jin Zhang, Ligia Toro, Enrico Stefani

    Photobleaching is a major limitation of superresolution Stimulated Depletion Emission (STED) microscopy. Fast scanning has long been considered an effective means to reduce photobleaching in fluorescence microscopy, but a careful quantitative study of this issue is missing. In this paper, we show that the photobleaching rate in STED microscopy can be slowed down and the fluorescence yield be enhanced by scanning with high speed, enabled by using large field of view in a custom-built resonant-scanning STED microscope. The effect of scanning speed on photobleaching and fluorescence yield is more remarkable at higher levels of depletion laser irradiance and virtually disappears in conventional confocal microscopy. With ≥6 GW∙cm−2 depletion irradiance, we were able to extend the fluorophore survival time of Atto 647N and Abberior STAR 635P by ~80% with 8-fold wider field of view. We confirm that STED Photobleaching is primarily caused by the depletion light acting upon the excited fluorophores. Experimental data agree with a theoretical model. Our results encourage further increasing the linear scanning speed for photobleaching reduction in STED microscopy.