Physics Perception in Sloshing Scenes With Guaranteed Thermodynamic Consistency
- 22 March 2022
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Pattern Analysis and Machine Intelligence
- Vol. 45 (2) , 2136-2150
Abstract
Physics perception very often faces the problem that only limited data or partial measurements on the scene are available. In this work, we propose a strategy to learn the full state of sloshing liquids from measurements of the free surface. Our approach is based on recurrent neural networks (RNN) that project the limited information available to a reduced-order manifold to not only reconstruct the unknown information but also be capable of performing fluid reasoning about future scenarios in real-time. To obtain physically consistent predictions, we train deep neural networks on the reduced-order manifold that, through the employ of inductive biases, ensure the fulfillment of the principles of thermodynamics. RNNs learn from history the required hidden information to correlate the limited information with the latent space where the simulation occurs. Finally, a decoder returns data to the high-dimensional manifold, to provide the user with insightful information in the form of augmented reality. This algorithm is connected to a computer vision system to test the performance of the proposed methodology with real information, resulting in a system capable of understanding and predicting future states of the observed fluid in real-time.Keywords
All Related Versions
Funding Information
- Spanish Ministry of Economy and Competitiveness (PID2020-113463RB-C31)
- Regional Government of Aragón and the European Social Fund
- Research Group T88
This publication has 59 references indexed in Scilit:
- Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation2014
- Simulation as an engine of physical scene understandingProceedings of the National Academy of Sciences, 2013
- Modeling and control of physical processes using proper orthogonal decompositionMathematical and Computer Modelling, 2001
- Thermodynamically Admissible Form for Discrete HydrodynamicsPhysical Review Letters, 1999
- Nonlinear Component Analysis as a Kernel Eigenvalue ProblemNeural Computation, 1998
- Dynamics and thermodynamics of complex fluids. I. Development of a general formalismPhysical Review E, 1997
- Long Short-Term MemoryNeural Computation, 1997
- Comparing images using the Hausdorff distanceIEEE Transactions on Pattern Analysis and Machine Intelligence, 1993
- Smoothed Particle HydrodynamicsAnnual Review of Astronomy and Astrophysics, 1992
- The fluctuation-dissipation theoremReports on Progress in Physics, 1966