Pak Hung Chan
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Pak Hung Chan has a total of 35 co-authors. Here are the top co-authors by number of shared publications:
- Valentina Donzella
Queen Mary University of London, London, U.K.
11 shared publications Valentina Donzella
WMG, University of Warwick, Coventry, UK
8 shared publications- Boda Li
WMG, University of Warwick, Coventry, U.K.
5 shared publications Anthony Huggett
Onsemi, Greenwood House, Bracknell, U.K.
4 shared publicationsGabriele Baris
WMG, University of Warwick, Coventry, U.K.
4 shared publicationsBoda Li
WMG, University of Warwick, Coventry, UK
2 shared publications
Latest Publications
- 21 May 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Sensors Journal
- Vol. 25 (13) , 25820-25828
LiDAR De-Snow Score (DSS): Combining Quality and Perception Metrics for Optimized De-Noising
The testing and safety cases of Assisted and Automated Driving functions require considerations for non ideal environmental conditions, such as adverse and extreme weather. In these extreme conditions, perception sensors (e.g. camera, LiDAR, RADAR), which build the situational awareness of the vehicle, might produce noisy and degraded data. Therefore it is key to consider: (i) how to reliably and robustly measure data degradation; (ii) how to evaluate de-noising techniques; (iii) linking perception performance to denoising quality. This paper focuses on de-snowing of LiDAR data, as falling snow is one of the most variable and dangerous conditions encountered while driving - and LiDAR can provide essential 3D information to still enable safe vehicle navigation. Using the WADS dataset, which contains segmented pointclouds including falling and deposited snow points, state-of-the-art de-snowing techniques are compared using an array of adapted pointcloud quality metrics, combined with downstream segmentation (perception) performance after de-snowing evaluated using perception based metrics. The different metrics are able to capture different aspects/effects of the data degradation, and hereby the novel De-Snow Score (DSS) is proposed and applied to have a holistic evaluation of the de-noising techniques considering both data quality and expected perception performance. Based on DSS, the most promising de-noising algorithms are identified. The proposed methodology and De-Snow Score can pave the way for a standardised approach when evaluating perception sensor data degradation and de-noising techniques.
- 21 May 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Sensors Journal
- Vol. 25 (13) , 25820-25828
LiDAR De-Snow Score (DSS): Combining Quality and Perception Metrics for Optimized De-Noising
The testing and safety cases of Assisted and Automated Driving functions require considerations for non ideal environmental conditions, such as adverse and extreme weather. In these extreme conditions, perception sensors (e.g. camera, LiDAR, RADAR), which build the situational awareness of the vehicle, might produce noisy and degraded data. Therefore it is key to consider: (i) how to reliably and robustly measure data degradation; (ii) how to evaluate de-noising techniques; (iii) linking perception performance to denoising quality. This paper focuses on de-snowing of LiDAR data, as falling snow is one of the most variable and dangerous conditions encountered while driving - and LiDAR can provide essential 3D information to still enable safe vehicle navigation. Using the WADS dataset, which contains segmented pointclouds including falling and deposited snow points, state-of-the-art de-snowing techniques are compared using an array of adapted pointcloud quality metrics, combined with downstream segmentation (perception) performance after de-snowing evaluated using perception based metrics. The different metrics are able to capture different aspects/effects of the data degradation, and hereby the novel De-Snow Score (DSS) is proposed and applied to have a holistic evaluation of the de-noising techniques considering both data quality and expected perception performance. Based on DSS, the most promising de-noising algorithms are identified. The proposed methodology and De-Snow Score can pave the way for a standardised approach when evaluating perception sensor data degradation and de-noising techniques.
- 7 April 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Sensors Journal
- Vol. 25 (10) , 18291-18301
A Noise Analysis of 4D RADAR: Robust Sensing for Automotive?
The sensor suite for assisted and automated/ autonomous driving functions is critical to the function of a vehicle, but also the first and most significant limitation to the level of automation that the system can achieve. The advancement of 4D RADARs, offering better resolution in both azimuth and elevation compared to traditional RADAR, can assist to achieve more robust situational awareness, whilst also providing more data for perception algorithms and sensor fusion. However, like all perception sensors, 4D RADAR is affected by numerous noise factors. To explore the sources of noise, this work identifies, classifies, and analyses automotive 4D RADAR noise factors. For the first time, 23 noise factors have been considered, in combination with their effect on six 4D RADAR outputs. Finally, this work also proposes and applies a novel dissimilarity metric to collected 4D RADAR data in the presence of rain and snow with different intensities. The proposed metric is used to assess the effect of noise on the variability of the measured data, in addition it can be applied to compare any 4D RADAR data. The metric, combined with other pointcloud evaluations, shows that as rain rate or snow rate intensify, the size of the pointcloud changes, the factors in the measurements increases. This work presents the importance of evaluating, compounding, and quantifying noise for 4D RADAR, and can pave the way for more in depth quantitative analysis of modelling and testing of 4D RADAR for assisted and automated driving functions.
- 7 April 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Sensors Journal
- Vol. 25 (10) , 18291-18301
A Noise Analysis of 4D RADAR: Robust Sensing for Automotive?
The sensor suite for assisted and automated/ autonomous driving functions is critical to the function of a vehicle, but also the first and most significant limitation to the level of automation that the system can achieve. The advancement of 4D RADARs, offering better resolution in both azimuth and elevation compared to traditional RADAR, can assist to achieve more robust situational awareness, whilst also providing more data for perception algorithms and sensor fusion. However, like all perception sensors, 4D RADAR is affected by numerous noise factors. To explore the sources of noise, this work identifies, classifies, and analyses automotive 4D RADAR noise factors. For the first time, 23 noise factors have been considered, in combination with their effect on six 4D RADAR outputs. Finally, this work also proposes and applies a novel dissimilarity metric to collected 4D RADAR data in the presence of rain and snow with different intensities. The proposed metric is used to assess the effect of noise on the variability of the measured data, in addition it can be applied to compare any 4D RADAR data. The metric, combined with other pointcloud evaluations, shows that as rain rate or snow rate intensify, the size of the pointcloud changes, the factors in the measurements increases. This work presents the importance of evaluating, compounding, and quantifying noise for 4D RADAR, and can pave the way for more in depth quantitative analysis of modelling and testing of 4D RADAR for assisted and automated driving functions.
- Open Access
- 24 February 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 13, 36575-36589
Automotive DNN-Based Object Detection in the Presence of Lens Obstruction and Video Compression
Recent advances in sensing, processing, machine learning, and communication technologies are accelerating assisted and automated functions development for commercial vehicles. Environmental perception sensor data streams are processed to generate a correct and complete situational awareness. It is of utmost importance to assess the robustness of the sensor data pipeline, particularly in the case of data degradation in a noisy and variable environment. Sensor data reduction and compression techniques are key for higher levels of driving automation, as there is an expectation that traditional automotive vehicle wired networks will not be able to support the needed sensor datarates (i.e. more than 10 perception sensors, including cameras, LiDARs, and RADARs, generating tens of Gb/s of data). This work proposes for the first time to consider video compression for camera data transmission on vehicle wired networks in the presence of highly noisy data, e.g. partially obstructed camera field of view. The effects are discussed in terms of machine learning vehicle detection accuracy drop, and also visualising how detection performance spatially varies on the frames using the recently introduced metric, the Spatial Recall Index (SRI). The presented parametric obstruction noise model is generated to emulate real-world patterns, whereas compression is based on the well-established AVC/H.264. While Deep Neural Networks’ (DNNs’) performance is stable with lossy compression (up to 70:1) of ‘ideal’ data, when noise is added there is a significant accuracy degradation, in the range of a 7%-90% decrease. The proposed compression and noise tuning of the DNN training improves the performance up to 35%, enhancing the noise and compression robustness of the system. However, in the presence of compression combined with extreme levels of noise (i.e. more than 80% of pixels affected), DNN performance significantly degrades, up to a 90% decrease, even with re-training. This issue needs to be carefully considered in the design phase of perception and communication networks used to transmit sensor data.
- 24 February 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 13, 36575-36589
Open AccessAutomotive DNN-Based Object Detection in the Presence of Lens Obstruction and Video Compression
Recent advances in sensing, processing, machine learning, and communication technologies are accelerating assisted and automated functions development for commercial vehicles. Environmental perception sensor data streams are processed to generate a correct and complete situational awareness. It is of utmost importance to assess the robustness of the sensor data pipeline, particularly in the case of data degradation in a noisy and variable environment. Sensor data reduction and compression techniques are key for higher levels of driving automation, as there is an expectation that traditional automotive vehicle wired networks will not be able to support the needed sensor datarates (i.e. more than 10 perception sensors, including cameras, LiDARs, and RADARs, generating tens of Gb/s of data). This work proposes for the first time to consider video compression for camera data transmission on vehicle wired networks in the presence of highly noisy data, e.g. partially obstructed camera field of view. The effects are discussed in terms of machine learning vehicle detection accuracy drop, and also visualising how detection performance spatially varies on the frames using the recently introduced metric, the Spatial Recall Index (SRI). The presented parametric obstruction noise model is generated to emulate real-world patterns, whereas compression is based on the well-established AVC/H.264. While Deep Neural Networks’ (DNNs’) performance is stable with lossy compression (up to 70:1) of ‘ideal’ data, when noise is added there is a significant accuracy degradation, in the range of a 7%-90% decrease. The proposed compression and noise tuning of the DNN training improves the performance up to 35%, enhancing the noise and compression robustness of the system. However, in the presence of compression combined with extreme levels of noise (i.e. more than 80% of pixels affected), DNN performance significantly degrades, up to a 90% decrease, even with re-training. This issue needs to be carefully considered in the design phase of perception and communication networks used to transmit sensor data.
- Open Access
- 13 January 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 13, 21695-21706
Raw Camera Data Object Detectors: An Optimisation for Automotive Video Processing and Transmission
Whilst Deep Neural Networks (DNNs) have been developing swiftly, most of the research has been focused on videos based on RGB frames. RGB data has been traditionally optimised for human vision and is a highly re-elaborated and interpolated version of the collected raw data. In fact, the sensor collects the light intensity value per pixel, but an RGB frame contains 3 values, for red, green, and blue colour channels. This conversion to RGB requires computational resource, time, power, and increases by a factor of three the amount of output data. This work investigates DNN based detection using (for training and evaluation) Bayer frames, generated from a benchmarking automotive dataset ( i.e . KITTI dataset). A Deep Neural Network (DNN) is deployed in an unmodified form, and also modified to accept only single channel frames, such as Bayer frames. Eleven different re-trained versions of the DNN are produced, and cross-evaluated across different data formats. The results demonstrate that the selected DNN has the same accuracy when evaluating RGB or Bayer data, without significant degradation in the perception (the variation of the Average Precision is <1%). Moreover, the colour filter array position and the colour correction matrix do not seem to contribute significantly to the DNN performance. This work demonstrates that Bayer data can be used for object detection in automotive without significant perception performance loss, allowing for more efficient sensing-perception systems.
- 13 January 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 13, 21695-21706
Open AccessRaw Camera Data Object Detectors: An Optimisation for Automotive Video Processing and Transmission
Whilst Deep Neural Networks (DNNs) have been developing swiftly, most of the research has been focused on videos based on RGB frames. RGB data has been traditionally optimised for human vision and is a highly re-elaborated and interpolated version of the collected raw data. In fact, the sensor collects the light intensity value per pixel, but an RGB frame contains 3 values, for red, green, and blue colour channels. This conversion to RGB requires computational resource, time, power, and increases by a factor of three the amount of output data. This work investigates DNN based detection using (for training and evaluation) Bayer frames, generated from a benchmarking automotive dataset ( i.e . KITTI dataset). A Deep Neural Network (DNN) is deployed in an unmodified form, and also modified to accept only single channel frames, such as Bayer frames. Eleven different re-trained versions of the DNN are produced, and cross-evaluated across different data formats. The results demonstrate that the selected DNN has the same accuracy when evaluating RGB or Bayer data, without significant degradation in the perception (the variation of the Average Precision is <1%). Moreover, the colour filter array position and the colour correction matrix do not seem to contribute significantly to the DNN performance. This work demonstrates that Bayer data can be used for object detection in automotive without significant perception performance loss, allowing for more efficient sensing-perception systems.
- Open Access
- 25 November 2024
- Published by Cambridge University Press (CUP) in Data-Centric Engineering
- Vol. 5, e34
The inconvenient truth of ground truth errors in automotive datasets and DNN-based detection
Assisted and automated driving functions will rely on machine learning algorithms, given their ability to cope with real-world variations, e.g. vehicles of different shapes, positions, colors, and so forth. Supervised learning needs annotated datasets, and several automotive datasets are available. However, these datasets are tremendous in volume, and labeling accuracy and quality can vary across different datasets and within dataset frames. Accurate and appropriate ground truth is especially important for automotive, as “incomplete” or “incorrect” learning can negatively impact vehicle safety when these neural networks are deployed. This work investigates the ground truth quality of widely adopted automotive datasets, including a detailed analysis of KITTI MoSeg. According to the identified and classified errors in the annotations of different automotive datasets, this article provides three different criteria collections for producing improved annotations. These criteria are enforceable and applicable to a wide variety of datasets. The three annotations sets are created to (i) remove dubious cases; (ii) annotate to the best of human visual system; and (iii) remove clear erroneous BBs. KITTI MoSeg has been reannotated three times according to the specified criteria, and three state-of-the-art deep neural network object detectors are used to evaluate them. The results clearly show that network performance is affected by ground truth variations, and removing clear errors is beneficial for predicting real-world objects only for some networks. The relabeled datasets still present some cases with “arbitrary”/“controversial” annotations, and therefore, this work concludes with some guidelines related to dataset annotation, metadata/sublabels, and specific automotive use cases.
- 25 November 2024
- Published by Cambridge University Press (CUP) in Data-Centric Engineering
- Vol. 5, e34
Open AccessThe inconvenient truth of ground truth errors in automotive datasets and DNN-based detection
Assisted and automated driving functions will rely on machine learning algorithms, given their ability to cope with real-world variations, e.g. vehicles of different shapes, positions, colors, and so forth. Supervised learning needs annotated datasets, and several automotive datasets are available. However, these datasets are tremendous in volume, and labeling accuracy and quality can vary across different datasets and within dataset frames. Accurate and appropriate ground truth is especially important for automotive, as “incomplete” or “incorrect” learning can negatively impact vehicle safety when these neural networks are deployed. This work investigates the ground truth quality of widely adopted automotive datasets, including a detailed analysis of KITTI MoSeg. According to the identified and classified errors in the annotations of different automotive datasets, this article provides three different criteria collections for producing improved annotations. These criteria are enforceable and applicable to a wide variety of datasets. The three annotations sets are created to (i) remove dubious cases; (ii) annotate to the best of human visual system; and (iii) remove clear erroneous BBs. KITTI MoSeg has been reannotated three times according to the specified criteria, and three state-of-the-art deep neural network object detectors are used to evaluate them. The results clearly show that network performance is affected by ground truth variations, and removing clear errors is beneficial for predicting real-world objects only for some networks. The relabeled datasets still present some cases with “arbitrary”/“controversial” annotations, and therefore, this work concludes with some guidelines related to dataset annotation, metadata/sublabels, and specific automotive use cases.
- Open Access
- 8 April 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in TechRxiv
LIDAR De-Snow Score (DSS): combining quality and perception metrics for optimised data filtering
The testing and safety cases of Assisted and Automated Driving functions require considerations for non ideal environmental conditions, such as adverse and extreme weather. In these extreme conditions, perception sensors (e.g. camera, LiDAR, RADAR), used to build the situational awareness of the vehicle, might produce noisy and degraded data, and it is therefore key to consider: (i) how to reliably and robustly measure data degradation; (ii) how to evaluate de-noising techniques. This paper focuses on de-snowing of LiDAR data, as falling snow is one of the most variable and dangerous conditions to be encounter while driving-and LiDAR can provide essential 3D information to still enable safe vehicle navigation. Using the WADS dataset, which contains segmented pointclouds including falling and deposited snow points, 4 different state-of-the-art desnowing techniques are compared using an array of adapted pointcloud quality metrics, and combined with perception based metrics. The different metrics are able to capture different aspects of the data degradation, and hereby the novel De-Snow Score (DSS) is proposed and applied to have a holistic evaluation of the de-noising techniques. Based on DSS, the most promising de-noising algorithms are identified. The proposed methodology and De-Snow Score can pave the way for a standardised approach when measuring perception sensor data degradation and de-noising.
- 8 April 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in TechRxiv
Open AccessLIDAR De-Snow Score (DSS): combining quality and perception metrics for optimised data filtering
The testing and safety cases of Assisted and Automated Driving functions require considerations for non ideal environmental conditions, such as adverse and extreme weather. In these extreme conditions, perception sensors (e.g. camera, LiDAR, RADAR), used to build the situational awareness of the vehicle, might produce noisy and degraded data, and it is therefore key to consider: (i) how to reliably and robustly measure data degradation; (ii) how to evaluate de-noising techniques. This paper focuses on de-snowing of LiDAR data, as falling snow is one of the most variable and dangerous conditions to be encounter while driving-and LiDAR can provide essential 3D information to still enable safe vehicle navigation. Using the WADS dataset, which contains segmented pointclouds including falling and deposited snow points, 4 different state-of-the-art desnowing techniques are compared using an array of adapted pointcloud quality metrics, and combined with perception based metrics. The different metrics are able to capture different aspects of the data degradation, and hereby the novel De-Snow Score (DSS) is proposed and applied to have a holistic evaluation of the de-noising techniques. Based on DSS, the most promising de-noising algorithms are identified. The proposed methodology and De-Snow Score can pave the way for a standardised approach when measuring perception sensor data degradation and de-noising.
- Open Access
- 26 January 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in TechRxiv
The inconvenient truth of ground truth errors in automotive datasets and DNN-based detection
Assisted and automated driving functions will rely on machine learning algorithms, given their ability to cope with real world variations, e.g. vehicles of different shapes, positions, colours, etc. Supervised learning needs annotated datasets, and several datasets are available for developing automotive functions. However, these datasets are tremendous in volume, and labelling accuracy and quality can vary across different datasets and within dataset frames. Accurate and appropriate ground truth is especially important for automotive, as "incomplete" or "incorrect" learning can impact negatively vehicle safety when these neural networks are deployed. This work investigates ground truth quality of widely adopted automotive datasets, including a detailed analysis of KITTI MoSeg. According to the identified and classified errors in the annotations of different automotive datasets, this paper provides three different criteria collections for producing improved annotations. These criteria are enforceable and applicable to a wide variety of datasets. The three annotations sets are created to: (i) remove dubious cases; (ii) annotate to the best of human visual system; (iii) remove clear erroneous bounding boxes. KITTI MoSeg has been reannotated three times according to the specified criteria, and three state-of-the-art deep neural network object detectors are used to evaluate them. The results clearly show that network performance is affected by ground truth variations, and removing clear errors is beneficial for predicting real world objects only for some networks. The relabelled datasets still present some cases with "arbitrary"/"controversial" annotations, and therefore this work concludes with some guidelines related to dataset annotation, metadata/sub-labels, and specific automotive use-cases.
- 26 January 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in TechRxiv
Open AccessThe inconvenient truth of ground truth errors in automotive datasets and DNN-based detection
Assisted and automated driving functions will rely on machine learning algorithms, given their ability to cope with real world variations, e.g. vehicles of different shapes, positions, colours, etc. Supervised learning needs annotated datasets, and several datasets are available for developing automotive functions. However, these datasets are tremendous in volume, and labelling accuracy and quality can vary across different datasets and within dataset frames. Accurate and appropriate ground truth is especially important for automotive, as "incomplete" or "incorrect" learning can impact negatively vehicle safety when these neural networks are deployed. This work investigates ground truth quality of widely adopted automotive datasets, including a detailed analysis of KITTI MoSeg. According to the identified and classified errors in the annotations of different automotive datasets, this paper provides three different criteria collections for producing improved annotations. These criteria are enforceable and applicable to a wide variety of datasets. The three annotations sets are created to: (i) remove dubious cases; (ii) annotate to the best of human visual system; (iii) remove clear erroneous bounding boxes. KITTI MoSeg has been reannotated three times according to the specified criteria, and three state-of-the-art deep neural network object detectors are used to evaluate them. The results clearly show that network performance is affected by ground truth variations, and removing clear errors is beneficial for predicting real world objects only for some networks. The relabelled datasets still present some cases with "arbitrary"/"controversial" annotations, and therefore this work concludes with some guidelines related to dataset annotation, metadata/sub-labels, and specific automotive use-cases.
- Open Access
- 22 November 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE) in TechRxiv
Correlating traditional image quality metrics and DNN-based object detection: a case study with compressed camera data
 Assisted and automated driving (AAD) systems heavily rely on data collected from perception sensors, such as cameras. While prior research has explored the quality of camera data via traditional and well-established image quality assessment (IQA) metrics (e.g. PSNR, SSIM, BRISQUE) or have considered when noisy/degraded data affects perception algorithms (e.g. deep neural network (DNN) based object detection), there are no works that approach the holistic relationship between IQA and DNN performance. This work proposes that traditional IQA metrics, designed to evaluate digital image quality according to human visual perception, can help to predict the sensor data degradation level that perception algorithms can tolerate before performance deterioration occurs. Consequently, a correlation analysis was conducted between 17 selected IQA metrics (with and without reference) and DNN average precision. The evaluated data was increasingly compressed to generate degradation and artefacts. Notably, the experimental results show that several IQA metrics had a strong positive correlation (exceeding correlation scores of 0.7) with average precision, with IW-SSIM and DSS having very high correlation (> 0.9). Interestingly, the results show that re-training BRISQUE on compressed data causes an exceptionally high positive correlation (> 0.97), making it very suitable for predicting the performance of DNN object detectors. By effectively relating traditional image quality metrics to DNN performance, this research offers a series of significant tools to understand and predict perception degradation based on the quality of data, thus resulting in a significant impact on the development of automated driving systems.Â
- 22 November 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE) in TechRxiv
Open AccessCorrelating traditional image quality metrics and DNN-based object detection: a case study with compressed camera data
 Assisted and automated driving (AAD) systems heavily rely on data collected from perception sensors, such as cameras. While prior research has explored the quality of camera data via traditional and well-established image quality assessment (IQA) metrics (e.g. PSNR, SSIM, BRISQUE) or have considered when noisy/degraded data affects perception algorithms (e.g. deep neural network (DNN) based object detection), there are no works that approach the holistic relationship between IQA and DNN performance. This work proposes that traditional IQA metrics, designed to evaluate digital image quality according to human visual perception, can help to predict the sensor data degradation level that perception algorithms can tolerate before performance deterioration occurs. Consequently, a correlation analysis was conducted between 17 selected IQA metrics (with and without reference) and DNN average precision. The evaluated data was increasingly compressed to generate degradation and artefacts. Notably, the experimental results show that several IQA metrics had a strong positive correlation (exceeding correlation scores of 0.7) with average precision, with IW-SSIM and DSS having very high correlation (> 0.9). Interestingly, the results show that re-training BRISQUE on compressed data causes an exceptionally high positive correlation (> 0.97), making it very suitable for predicting the performance of DNN object detectors. By effectively relating traditional image quality metrics to DNN performance, this research offers a series of significant tools to understand and predict perception degradation based on the quality of data, thus resulting in a significant impact on the development of automated driving systems.Â
- Open Access
- 13 November 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE) in TechRxiv
A noise analysis of 4D RADAR: robust sensing for automotive?
The sensor suite for assisted and automated driving functions vehicle is critical to the function of a vehicle, but also the first and most important limitation to the level of automation that the system can achieve. The advancement of 4D RADARs, providing better resolution in both azimuth and elevation compared to traditional RADAR, can assist to achieve more robust situational awareness, whilst also providing more data for perception algorithms and sensor fusion. However, like all perception sensors, 4D RADAR is also affected by numerous noise factors. To explore the sources of noise, this work identifies, classifies, and analyses automotive 4D RADAR noise factors. Overall, 22 noise factors have been considered, in combination with their effect on six 4D RADAR outputs. Finally, this work also presents and applies, for the first time, a dissimilarity metric to collected 4D RADAR data in the presence of rain with different intensities. The proposed metric is used to assess the effect of noise on the variability of the measured data, in addition it can be used to compare any 4D RADAR data. The metric, combined with other pointcloud evaluations, shows that as rainrate intensifies, the size of the pointcloud decreases, but also the variation in the measurements increases. This work presents the importance of evaluating, companding, and quantifying noise for 4D RADAR, and can pave the way for more in depth analysis of its modelling and testing of 4D RADAR for assisted and automated driving functions.
- 13 November 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE) in TechRxiv
Open AccessA noise analysis of 4D RADAR: robust sensing for automotive?
The sensor suite for assisted and automated driving functions vehicle is critical to the function of a vehicle, but also the first and most important limitation to the level of automation that the system can achieve. The advancement of 4D RADARs, providing better resolution in both azimuth and elevation compared to traditional RADAR, can assist to achieve more robust situational awareness, whilst also providing more data for perception algorithms and sensor fusion. However, like all perception sensors, 4D RADAR is also affected by numerous noise factors. To explore the sources of noise, this work identifies, classifies, and analyses automotive 4D RADAR noise factors. Overall, 22 noise factors have been considered, in combination with their effect on six 4D RADAR outputs. Finally, this work also presents and applies, for the first time, a dissimilarity metric to collected 4D RADAR data in the presence of rain with different intensities. The proposed metric is used to assess the effect of noise on the variability of the measured data, in addition it can be used to compare any 4D RADAR data. The metric, combined with other pointcloud evaluations, shows that as rainrate intensifies, the size of the pointcloud decreases, but also the variation in the measurements increases. This work presents the importance of evaluating, companding, and quantifying noise for 4D RADAR, and can pave the way for more in depth analysis of its modelling and testing of 4D RADAR for assisted and automated driving functions.
- 11 September 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Intelligent Transportation Systems
- Vol. 25 (1) , 203-213
Influence of AVC and HEVC Compression on Detection of Vehicles Through Faster R-CNN
Situational awareness based on the data collected by the vehicle perception sensors (i.e. LiDAR, RADAR, camera and ultrasonic sensors) is key for achieving assisted and automated driving functions in a safe and reliable way. However, the data rates generated by the sensor suite are difficult to support over traditional wired data communication networks on the vehicle, hence there is an interest in techniques that reduce the amount of sensor data to be transmitted without losing key information or introducing unacceptable delays. These techniques must be analysed in combination with the consumer of the data, which will most likely be a machine learning algorithm based on deep neural networks (DNNs). In this paper we demonstrate that by compression tuning the DNNs (i.e. transfer learning by re-training with compressed data) the DNN average precision and recall can significantly improve when uncompressed and compressed data are transmitted. This improvement is achieved independently from the compression standard used for compression-training (i.e. AVC and HEVC), and also when training and transmitted data use the same compression standard or different compression standards. Furthermore, the performance of the DNNs is stable when transmitting data with increasing lossy compression rate, up to a compression ratio of approximately 160:1; above this value the performance starts to degrade. This work paves the way for the use of compressed sensor data in automated driving in combination with the optimisation of compression-tuned DNNs.
- 11 September 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Intelligent Transportation Systems
- Vol. 25 (1) , 203-213
Influence of AVC and HEVC Compression on Detection of Vehicles Through Faster R-CNN
Situational awareness based on the data collected by the vehicle perception sensors (i.e. LiDAR, RADAR, camera and ultrasonic sensors) is key for achieving assisted and automated driving functions in a safe and reliable way. However, the data rates generated by the sensor suite are difficult to support over traditional wired data communication networks on the vehicle, hence there is an interest in techniques that reduce the amount of sensor data to be transmitted without losing key information or introducing unacceptable delays. These techniques must be analysed in combination with the consumer of the data, which will most likely be a machine learning algorithm based on deep neural networks (DNNs). In this paper we demonstrate that by compression tuning the DNNs (i.e. transfer learning by re-training with compressed data) the DNN average precision and recall can significantly improve when uncompressed and compressed data are transmitted. This improvement is achieved independently from the compression standard used for compression-training (i.e. AVC and HEVC), and also when training and transmitted data use the same compression standard or different compression standards. Furthermore, the performance of the DNNs is stable when transmitting data with increasing lossy compression rate, up to a compression ratio of approximately 160:1; above this value the performance starts to degrade. This work paves the way for the use of compressed sensor data in automated driving in combination with the optimisation of compression-tuned DNNs.