On the Relation between Rectified Flows and Optimal Transport
Preprint
Abstract
This paper investigates the connections between rectified flows, flow matching, and optimal transport. Flow matching is a recent approach to learning generative models by estimating velocity fields that guide transformations from a source to a target distribution. Rectified flow matching aims to straighten the learned transport paths, yielding more direct flows between distributions. Our first contribution is a set of invariance properties of rectified flows and explicit velocity fields. In addition, we also provide explicit constructions and analysis in the Gaussian (not necessarily independent) and Gaussian mixture settings and study the relation to optimal transport. Our second contribution addresses recent claims suggesting that rectified flows, when constrained such that the learned velocity field is a gradient, can yield (asymptotically) solutions to optimal transport problems. We study the existence of solutions for this problem and demonstrate that they only relate to optimal transport under assumptions that are significantly stronger than those previously acknowledged. In particular, we present several counter-examples that invalidate earlier equivalence results in the literature, and we argue that enforcing a gradient constraint on rectified flows is, in general, not a reliable method for computing optimal transport maps.Keywords
All Related Versions
This publication has 10 references indexed in Scilit:
- Flow Matching: Markov Kernels, Stochastic Processes and Transport Plans2025
- Optimal Flow Matching: Learning Straight Trajectories in Just One Step2024
- Normalizing flow neural networks by JKO scheme2023
- Stochastic Normalizing Flows for Inverse Problems: A Markov Chains ViewpointSIAM/ASA Journal on Uncertainty Quantification, 2022
- Wasserstein Iterative Networks for Barycenter Estimation2022
- Optimal Transport for Domain AdaptationIEEE Transactions on Pattern Analysis and Machine Intelligence, 2016
- Optimal Transport for Applied Mathematicians2015
- Tweedie’s Formula and Selection BiasJournal of the American Statistical Association, 2011
- A computational fluid mechanics solution to the Monge-Kantorovich mass transfer problemNumerische Mathematik, 2000
- Concerning nonnegative matrices and doubly stochastic matricesPacific Journal of Mathematics, 1967