Freespace Optical Flow Modeling for Automated Driving
- 18 August 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE/ASME Transactions on Mechatronics
- Vol. 29 (2) , 1511-1520
Abstract
Optical flow and disparity are two informative visual features for autonomous driving perception. They have been used for a variety of applications, such as obstacle and lane detection. The concept of “U-V-Disparity” has been widely explored in the literature, while its counterpart in optical flow has received relatively little attention. Traditional motion analysis algorithms estimate optical flow by matching correspondences between two successive video frames, which limits the full utilization of environmental information and geometric constraints. Therefore, we propose a novel strategy to model optical flow in the collision-freespace (also referred to as drivable area or simply freespace) for intelligent vehicles, with the full utilization of geometry information in a 3-D driving environment. We provide explicit representations of optical flow and deduce the quadratic relationship between the optical flow component and the vertical coordinate. Through extensive experiments on several public datasets, we demonstrate the high accuracy and robustness of our model. In addition, our proposed freespace optical flow model boasts a diverse array of applications within the realm of automated driving, providing a geometric constraint in freespace detection, vehicle localization, and more. We have made our source code publicly available at https://mias.group/FSOF .Keywords
All Related Versions
Funding Information
- National Key R&D Program of China (2020AAA0108100)
- National Natural Science Foundation of China (62233013)
- Science and Technology Commission of Shanghai Municipal (22511104500)
- Fundamental Research Funds for the Central Universities
This publication has 25 references indexed in Scilit:
- Road Damage Detection Based on Unsupervised Disparity Map SegmentationIEEE Transactions on Intelligent Transportation Systems, 2019
- Pothole Detection Based on Disparity Transformation and Road Surface ModelingIEEE Transactions on Image Processing, 2019
- A survey of variational and CNN-based optical flow techniquesSignal Processing: Image Communication, 2019
- Road Surface 3D Reconstruction Based on Dense Subpixel Disparity Map EstimationIEEE Transactions on Image Processing, 2018
- Particle swarm optimization algorithm: an overviewSoft Computing, 2017
- A Large Dataset to Train Convolutional Networks for Disparity, Optical Flow, and Scene Flow Estimation2016
- Advanced Driver Assistance System for Road Environments to Improve Safety and EfficiencyTransportation Research Procedia, 2016
- FlowNet: Learning Optical Flow with Convolutional Networks2015
- A Database and Evaluation Methodology for Optical FlowInternational Journal of Computer Vision, 2010
- Determining optical flowArtificial Intelligence, 1981