Efficient Deep Learning for Stereo Matching

Authors:
  • WLWenjie Luo
    Wenjie Luo
  • ASAlexander G. Schwing
    Alexander G. Schwing
  • RURaquel Urtasun
    Raquel Urtasun
Top Cited Papers
Publisher website
Google Scholar
Abstract
In the past year, convolutional neural networks have been shown to perform extremely well for stereo estimation. However, current architectures rely on siamese networks which exploit concatenation followed by further processing layers, requiring a minute of GPU computation per image pair. In contrast, in this paper we propose a matching network which is able to produce very accurate results in less than a second of GPU computation. Towards this goal, we exploit a product layer which simply computes the inner product between the two representations of a siamese architecture. We train our network by treating the problem as multi-class classification, where the classes are all possible disparities. This allows us to get calibrated scores, which result in much better matching performance when compared to existing approaches.

This publication has 22 references indexed in Scilit: