KBKangjun Bai

Kangjun Bai

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article

Previous Organizations / Institutes

The organizations / institutes from the scholar's other articles in the past ten years


Kangjun Bai has a total of 20 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • A journey to take technology from the lab to the field

    by Clare D. Thiem, Jack P. Lombardi, Kang Jun Bai, Nathan R. McDonald, Bryant T. Wysocki, David T. Wise, Christian W. Brazeau

    The Air Force Research Laboratory's Information Directorate has a rich history of developing advanced computing technology for the warfighter guiding emerging technologies from the laboratory to the field. Memristors, also known as resistive random-access memory, is one such computing technology. This paper details AFRL's technical maturation of memristors for neuromorphic computing from early concept through device fabrication and architectural implementation using a combination of in-house programs, contractual efforts, and collaborative partnerships. It additionally explores recent DoD architectural advancements to further enable low size, weight, and power computationally efficient intelligent computing at the edge.


  • Enabling a New Methodology of Neural Coding: Multiplexing Temporal Encoding in Neuromorphic Computing

    by Honghao Zheng, Kang Jun Bai, Yang Yi

    From rate to temporal encoding, spiking information processing has demonstrated advantages across diverse neuromorphic applications. In the aspects of data capacity and robustness, multiplexing encoding outperforms alternative encoding schemes. In this work, we aim to implement a new class of multiplexing temporal encoders, patterning stimuli in multiple timescales to improve the information processing capability, and robustness of systems deployed in noisy environments. Benefitted by the internal reference frame using subthreshold membrane oscillation (SMO), the encoded spike patterns are less sensitive to the input noise, increasing the encoder’s robustness. Our design results in a tremendous saving on power consumption and silicon area compared with the power-hungry analog-to-digital converters. Furthermore, a working prototype of the multiplexing temporal encoder built based on an interspike interval (ISI) encoding scheme is implemented on a silicon chip using the standard 180-nm CMOS process. To the best of our knowledge, our introduced encoder demonstrates the first integrated circuit (IC) implementation of neural encoding with multiplexing topology. Finally, the accuracy and efficiency of our design are evaluated through standard machine learning benchmarks, including Modified National Institute of Standards and Technology (MNIST), Canadian Institute For Advanced Research (CIFAR)-10, Street View House Number (SVHN), and spectrum sensing in high-speed communication networks. While our multiplexing temporal encoder demonstrates a higher classification accuracy across all the benchmarks, the power consumption and dissipated energy per spike reach merely $2.6~\mu \text {W}$ and 95 fJ/spike, respectively, with an effective frame rate of 300 MHz. Compared with alternative encoding schemes, our multiplexing temporal encoder achieves at most 100% higher data capacity, 11.4% more accurate in classification, and 25% more robust against noise. Compared with the state-of-the-art designs, our work achieves up to $105 \times $ power efficiency without significantly increasing the silicon area.


  • Design Strategies and Applications of Reservoir Computing: Recent Trends and Prospects [Feature]

    by Kang Jun Bai, Clare Thiem, Jack Lombardi, Yibin Liang, Yang Yi

    Reservoir computing (RC) is a neural computing paradigm especially well-suited for learning dynamical systems by leveraging an untrained reservoir layer, providing high-dimensional input encoding with fading memory property. Since only the readout weights are trained under RC, linear regression learning algorithms are sufficient, leading to significant improvements in computational complexity and energy efficiency as compared to other deep neural networks (DNNs). RC offers an alternative solution to sidestep the shortcomings of data scarcity and the vanishing gradient problem. More importantly, such a network structure is amenable to hardware implementation using a variety of devices, circuits, and systems, making RC a good candidate to replace sophisticated DNNs as a lightweight classifier at the edge for internet of things (IoT) applications. In this article, we provide an overview of recent advances in RC hardware and their applications for mobile edge intelligence. Specifically, we will demonstrate the design strategies of RC in opto-electronic configuration, fully digital system, and silicon with the mixed-signal integrated circuit approach. Moreover, we will expose a novel implementation approach using emerging materials, designing the way for RC to be used in the next-generation neuromorphic computing systems. Building upon these efficient RC models, their applicability and effectiveness against the state-of-the-art are then demonstrated through diverse machine learning benchmarks spanning the area of IoT, communication networks, and healthcare.


  • Spatial-Temporal Hybrid Neural Network With Computing-in-Memory Architecture

    by Kangjun Bai, Lingjia Liu, Yang Yi

    Deep learning (DL) has gained unprecedented success in many real-world applications. However, DL poses difficulties for efficient hardware implementation due to the needs of a complex gradient-based learning algorithm and the required high memory bandwidth for synaptic weight storage, especially in today's data-intensive environment. Computing-in-memory (CIM) strategies have emerged as an alternative for realizing energy-efficient neuromorphic applications in silicon, reducing resources and energy required for neural computations. In this work, we exploit a CIM-based spatial-temporal hybrid neural network (STHNN) with a unique learning algorithm. To be specific, we integrate both multilayer perceptron and recurrent-based delay-dynamical system, making the network becomes linear separable while processing information in both spatial and temporal domains, better yet, reducing the memory bandwidth and hardware overhead through the CIM architecture. The prototype fabricated in 180 nm CMOS process is built of fully-analog components, yielding an average on-chip classification accuracy up to 86.9% on handprinted alphabet characters with a power consumption of 33 mW. Beyond that, through the handwritten digit database and the radio frequency fingerprinting dataset, software-based numerical evaluations offer 1.6 -to- 9.8 × and 1.9 -to- 4.4 × speedup, respectively, without significantly degrading its classification accuracy compared to the cutting-edge DL approaches.


  • Open Access

    The Novel Applications of Deep Reservoir Computing in Cyber-Security and Wireless Communication

    by Kian Hamedani, Zhou Zhou, Kangjun Bai, Lingjia Liu

    This chapter introduces the novel applications of deep reservoir computing (RC) systems in cyber-security and wireless communication. The RC systems are a new class of recurrent neural networks (RNNs). Traditional RNNs are very challenging to train due to vanishing/exploding gradients. However, the RC systems are easier to train and have shown similar or even better performances compared with traditional RNNs. It is very essential to study the spatio-temporal correlations in cyber-security and wireless communication domains. Therefore, RC models are good choices to explore the spatio-temporal correlations. In this chapter, we explore the applications and performance of delayed feedback reservoirs (DFRs), and echo state networks (ESNs) in the cyber-security of smart grids and symbol detection in MIMO-OFDM systems, respectively. DFRs and ESNs are two different types of RC models. We also introduce the spiking structure of DFRs as spiking artificial neural networks are more energy efficient and biologically plausible as well.


  • Energy Efficient Temporal Spatial Information Processing Circuits Based on STDP and Spike Iteration

    by Chenyuan Zhao, Qiyuan An, Kangjun Bai, Bryant Wysocki, Clare Thiem, Lingjia Liu, Yang Yi

    In this paper, we propose a novel energy-efficient temporal-spatial information processing circuit that serves as the signal pre-processing interface for spiking neural networks. In or-der to transform sensory information into a highly efficient neu-ral-like spike train, an iteration encoding scheme based temporal-spatial inter-spike interval (ISI) encoder is designed and analyzed. Moreover, a decoder is designed with the spike-timing-dependent plasticity (STDP) principle, which performs well in information recovery. The prototype of the proposed ISI encoder is presented, with a 3-interval encoder through the standard 180nm CMOS technology. The proposed ISI encoder could operate in 1MHz sampling frequency, and it occupies merely 0.647mm die area while consuming as low as 1.63uW/neuron power. A multi-level ISI decoder with spike width adaptation is also designed and eval-uated through the CIFAR10 image dataset.


  • Open Access

    Opening the “Black Box” of Silicon Chip Design in Neuromorphic Computing

    by Kangjun Bai, Yang Yi

    Neuromorphic computing, a bio-inspired computing architecture that transfers neuroscience to silicon chip, has potential to achieve the same level of computation and energy efficiency as mammalian brains. Meanwhile, three-dimensional (3D) integrated circuit (IC) design with non-volatile memory crossbar array uniquely unveils its intrinsic vector-matrix computation with parallel computing capability in neuromorphic computing designs. In this chapter, the state-of-the-art research trend on electronic circuit designs of neuromorphic computing will be introduced. Furthermore, a practical bio-inspired spiking neural network with delay-feedback topology will be discussed. In the endeavor to imitate how human beings process information, our fabricated spiking neural network chip has capability to process analog signal directly, resulting in high energy efficiency with small hardware implementation cost. Mimicking the neurological structure of mammalian brains, the potential of 3D-IC implementation technique with memristive synapses is investigated. Finally, applications on the chaotic time series prediction and the video frame recognition will be demonstrated.


  • Open Access

    The Roadmap to Realize Memristive Three-Dimensional Neuromorphic Computing System

    by Hongyu An, Kangjun Bai, Yang Yi

    Neuromorphic computing, an emerging non-von Neumann computing mimicking the physical structure and signal processing technique of mammalian brains, potentially achieves the same level of computing and power efficiencies of mammalian brains. This chapter will discuss the state-of-the-art research trend on neuromorphic computing with memristors as electronic synapses. Furthermore, a novel three-dimensional (3D) neuromorphic computing architecture combining memristor and monolithic 3D integration technology would be introduced; such computing architecture has capabilities to reduce the system power consumption, provide high connectivity, resolve the routing congestion issues, and offer the massively parallel data processing. Moreover, the design methodology of applying the capacitance formed by the through-silicon vias (TSVs) to generate a membrane potential in 3D neuromorphic computing system would be discussed in this chapter.