Ionut Schiopu has a total of 29 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • CADeTT: Context-Adaptive Deep-Trinary-Tree Lossless Compression of Event Camera Frames

    by Ionut Schiopu, Radu Ciprian Bilcu

    The letter proposes an efficient context-adaptive lossless compression method for encoding event frame sequences. A first contribution proposes the use of a deep-ternary-tree of the current pixel position context as the context-tree model selector. The arithmetic codec encodes each trinary symbol using the probability distribution of the associated context-tree-leaf model. Another contribution proposes a novel context design based on several frames, where the context order controls the codec's complexity. Another contribution proposes a model search procedure to replace the context-tree prune-and-encode strategy by searching for the closest “mature” context model between lower-order context-tree models. The experimental evaluation shows that the proposed method provides an improved coding performance of 34.34% and a smaller runtime of up to $5.18\times$ compared with state-of-the-art lossless image codec FLIF and, respectively, 6.95% and $14.42\times$ compared with our prior work.


  • Open Access

    Memory-Efficient Fixed-Length Representation of Synchronous Event Frames for Very-Low-Power Chip Integration

    by Ionut Schiopu, Radu Ciprian Bilcu

    The new event cameras are now widely used in many computer vision applications. Their high raw data bitrate levels require a more efficient fixed-length representation for low-bandwidth transmission from the event sensor to the processing chip. A novel low-complexity lossless compression framework is proposed for encoding the synchronous event frames (EFs) by introducing a novel memory-efficient fixed-length representation suitable for hardware implementation in the very-low-power (VLP) event-processing chip. A first contribution proposes an improved representation of the ternary frames using pixel-group frame partitioning and symbol remapping. Another contribution proposes a novel low-complexity memory-efficient fixed-length representation using multi-level lookup tables (LUTs). Complex experimental analysis is performed using a set of group-size configurations. For very-large group-size configurations, an improved representation is proposed using a mask-LUT structure. The experimental evaluation on a public dataset demonstrates that the proposed fixed-length coding framework provides at least two times the compression ratio relative to the raw EF representation and a close performance compared with variable-length video coding standards and variable-length state-of-the-art image codecs for lossless compression of ternary EFs generated at frequencies bellow one KHz. To our knowledge, the paper is the first to introduce a low-complexity memory-efficient fixed-length representation for lossless compression of synchronous EFs, suitable for integration into a VLP event-processing chip.


  • Open Access

    Low-Complexity Lossless Coding of Asynchronous Event Sequences for Low-Power Chip Integration

    by Ionut Schiopu, Radu Ciprian Bilcu

    The event sensor provides high temporal resolution and generates large amounts of raw event data. Efficient low-complexity coding solutions are required for integration into low-power event-processing chips with limited memory. In this paper, a novel lossless compression method is proposed for encoding the event data represented as asynchronous event sequences. The proposed method employs only low-complexity coding techniques so that it is suitable for hardware implementation into low-power event-processing chips. A first, novel, contribution consists of a low-complexity coding scheme which uses a decision tree to reduce the representation range of the residual error. The decision tree is formed by using a triplet threshold parameter which divides the input data range into several coding ranges arranged at concentric distances from an initial prediction, so that the residual error of the true value information is represented by using a reduced number of bits. Another novel contribution consists of an improved representation, which divides the input sequence into same-timestamp subsequences, wherein each subsequence collects the same timestamp events in ascending order of the largest dimension of the event spatial information. The proposed same-timestamp representation replaces the event timestamp information with the same-timestamp subsequence length and encodes it together with the event spatial and polarity information into a different bitstream. Another novel contribution is the random access to any time window by using additional header information. The experimental evaluation on a highly variable event density dataset demonstrates that the proposed low-complexity lossless coding method provides an average improvement of 5.49%, 11.45%, and 35.57% compared with the state-of-the-art performance-oriented lossless data compression codecs Bzip2, LZMA, and ZLIB, respectively. To our knowledge, the paper proposes the first low-complexity lossless compression method for encoding asynchronous event sequences that are suitable for hardware implementation into low-power chips.


  • Open Access

    Framework for Vehicle Make and Model Recognition—A New Large-Scale Dataset and an Efficient Two-Branch–Two-Stage Deep Learning Architecture

    by Yangxintong Lyu, Ionut Schiopu, Bruno Cornelis, Adrian Munteanu

    In recent years, Vehicle Make and Model Recognition (VMMR) has attracted a lot of attention as it plays a crucial role in Intelligent Transportation Systems (ITS). Accurate and efficient VMMR systems are required in real-world applications including intelligent surveillance and autonomous driving. The paper introduces a new large-scale dataset and a novel deep learning paradigm for VMMR. A new large-scale dataset dubbed Diverse large-scale VMM (DVMM) is proposed collecting image-samples with the most popular vehicle brands operating in Europe. A novel VMMR framework is proposed which follows a two-branch architecture performing make and model recognition respectively. A two-stage training procedure and a novel decision module are proposed to process the make and model predictions and compute the final model prediction. In addition, a novel metric based on the true positive rate is proposed to compare classification confusion of the proposed 2B–2S and the baseline methods. A complex experimental validation is carried out, demonstrating the generality, diversity, and practicality of the proposed DVMM dataset. The experimental results show that the proposed framework provides 93.95% accuracy over the more diverse DVMM dataset and 95.85% accuracy over traditional VMMR datasets. The proposed two-branch approach outperforms the conventional one-branch approach for VMMR over small-, medium-, and large-scale datasets by providing lower vehicle model confusion and reduced inter-make ambiguity. The paper demonstrates the advantages of the proposed two-branch VMMR paradigm in terms of robustness and lower confusion relative to single-branch designs.


  • Low-Complexity Lossless Coding for Memory-Efficient Representation of Event Camera Frames

    by Ionut Schiopu, Radu Ciprian Bilcu

    A novel low-complexity lossless coding framework is proposed for efficient memory representation of event frames (EFs) suitable for hardware implementation in the low-cost event signal processing (ESP) chip. The proposed framework adapts the run-length encoding scheme and Elias coding for EF coding. A first contribution proposes a novel low-complexity codec for fast encoding of large EF sets using a binary map of accumulated spatial information and a vector of concatenated time intervals. Another contribution proposes a novel memory-efficient representation codec for random access to any group of pixels. The experimental evaluation demonstrates that the proposed codecs provide a much smaller runtime and a close performance compared with the state-of-the-art lossless image and video codecs, designed for storage optimization. To our knowledge, the paper proposes the first low-complexity lossless coding framework of EFs suitable for integration into low-cost ESP chips.


  • Lossless Compression of Event Camera Frames

    by Ionut Schiopu, Radu Ciprian Bilcu

    The letter introduces an efficient context-based lossless image codec for encoding event camera frames. The asynchronous events acquired by an event camera in a spatio-temporal neighborhood are collected by an Event Frame (EF). A more efficient way to store the event data is introduced, where up to eight EFs are represented as a pair of an event map image (EMI), containing the spatial information, and a vector, containing the polarity information. The proposed codec encodes the EMI using: (i) a binary map, which signals the positions where at least one event occurs in the EFs; (ii) the number of events for each signalled position; and (iii) their EF index. Template context modelling and adaptive Markov modelling are employed to encode these three types of data. The experimental evaluation for EFs generated at different time intervals demonstrates that the proposed method achieves an improved performance compared with both video coding standards, HEVC and VVC, and state-of-the-art lossless image coding methods, CALIC and FLIF. When all events are collected by EFs, a relative compression of up to 5.8 is achieved compared with the raw event encapsulation provided by the event camera.


  • Open Access

    Deep Learning Post-Filtering Using Multi-Head Attention and Multiresolution Feature Fusion for Image and Intra-Video Quality Enhancement

    by Ionut Schiopu, Adrian Munteanu

    The paper proposes a novel post-filtering method based on convolutional neural networks (CNNs) for quality enhancement of RGB/grayscale images and video sequences. The lossy images are encoded using common image codecs, such as JPEG and JPEG2000. The video sequences are encoded using previous and ongoing video coding standards, high-efficiency video coding (HEVC) and versatile video coding (VVC), respectively. A novel deep neural network architecture is proposed to estimate fine refinement details for full-, half-, and quarter-patch resolutions. The proposed architecture is built using a set of efficient processing blocks designed based on the following concepts: (i) the multi-head attention mechanism for refining the feature maps, (ii) the weight sharing concept for reducing the network complexity, and (iii) novel block designs of layer structures for multiresolution feature fusion. The proposed method provides substantial performance improvements compared with both common image codecs and video coding standards. Experimental results on high-resolution images and standard video sequences show that the proposed post-filtering method provides average BD-rate savings of 31.44% over JPEG and 54.61% over HEVC (x265) for RGB images, Y-BD-rate savings of 26.21% over JPEG and 15.28% over VVC (VTM) for grayscale images, and 15.47% over HEVC and 14.66% over VVC for video sequences.


  • Open Access

    Attention Networks for the Quality Enhancement of Light Field Images

    by Ionut Schiopu, Adrian Munteanu

    In this paper, we propose a novel filtering method based on deep attention networks for the quality enhancement of light field (LF) images captured by plenoptic cameras and compressed using the High Efficiency Video Coding (HEVC) standard. The proposed architecture was built using efficient complex processing blocks and novel attention-based residual blocks. The network takes advantage of the macro-pixel (MP) structure, specific to LF images, and processes each reconstructed MP in the luminance (Y) channel. The input patch is represented as a tensor that collects, from an MP neighbourhood, four Epipolar Plane Images (EPIs) at four different angles. The experimental results on a common LF image database showed high improvements over HEVC in terms of the structural similarity index (SSIM), with an average Y-Bjøntegaard Delta (BD)-rate savings of 36.57%, and an average Y-BD-PSNR improvement of 2.301 dB. Increased performance was achieved when the HEVC built-in filtering methods were skipped. The visual results illustrate that the enhanced image contains sharper edges and more texture details. The ablation study provides two robust solutions to reduce the inference time by 44.6% and the network complexity by 74.7%. The results demonstrate the potential of attention networks for the quality enhancement of LF images encoded by HEVC.


  • Open Access

    Real-Time Instance Segmentation of Traffic Videos for Embedded Devices

    by Ruben Panero Martinez, Ionut Schiopu, Bruno Cornelis, Adrian Munteanu

    The paper proposes a novel instance segmentation method for traffic videos devised for deployment on real-time embedded devices. A novel neural network architecture is proposed using a multi-resolution feature extraction backbone and improved network designs for the object detection and instance segmentation branches. A novel post-processing method is introduced to ensure a reduced rate of false detection by evaluating the quality of the output masks. An improved network training procedure is proposed based on a novel label assignment algorithm. An ablation study on speed-vs.-performance trade-off further modifies the two branches and replaces the conventional ResNet-based performance-oriented backbone with a lightweight speed-oriented design. The proposed architectural variations achieve real-time performance when deployed on embedded devices. The experimental results demonstrate that the proposed instance segmentation method for traffic videos outperforms the you only look at coefficients algorithm, the state-of-the-art real-time instance segmentation method. The proposed architecture achieves qualitative results with 31.57 average precision on the COCO dataset, while its speed-oriented variations achieve speeds of up to 66.25 frames per second on the Jetson AGX Xavier module.


  • Open Access

    Macro‐pixel‐wise CNN‐based filtering for quality enhancement of light field images

    by H. Huang, I. Schiopu, A. Munteanu

    The Letter introduces a novel filtering method based on convolutional neural networks (CNNs) for quality enhancement of light field (LF) images captured by a plenoptic camera and compressed using high‐efficiency video coding (HEVC). The method takes advantage of the macro‐pixel (MP) structure specific to the LF images and proposes a novel MP‐wise filtering approach based on a novel deep neural network architecture. The proposed CNN‐based method achieves an outstanding performance when HEVC is employed without its in‐loop filters. Experimental results show high luminance‐peak signal‐to‐noise ratio (Y‐PSNR) gains and average Y‐Bjøntegaard delta (BD)‐rate savings of over HEVC on a large data set.