Reinforcement Learning for the Face Support Pressure of Tunnel Boring Machines
Open Access
- 13 March 2023
- journal article
- research article
- Published by MDPI AG in Geosciences
- Vol. 13 (3) , 82
Abstract
In tunnel excavation with boring machines, the tunnel face is supported to avoid collapse and minimise settlement. This article proposes the use of reinforcement learning, specifically the deep Q-network algorithm, to predict the face support pressure. The algorithm uses a neural network to make decisions based on the expected rewards of each action. The approach is tested both analytically and numerically. By using the soil properties ahead of the tunnel face and the overburden depth as the input, the algorithm is capable of predicting the optimal tunnel face support pressure whilst minimising settlement, and adapting to changes in geological and geometrical conditions. The algorithm reaches maximum performance after 400 training episodes and can be used for random geological settings without retraining.Keywords
All Related Versions
Funding Information
- Otto Pregl Foundation for Geotechnical Fundamental Research
This publication has 79 references indexed in Scilit:
- Experimental study on face instability of shield tunnel in sandTunnelling and Underground Space Technology, 2013
- Evaluation of tunnel face stability by transparent soil modelsTunnelling and Underground Space Technology, 2012
- TBM versus NATM from the contractor's point of view / TBM versus NÖT aus Sicht des UnternehmersGeomechanics and Tunnelling, 2011
- Inductive Transfer2011
- Settlements induced by tunneling in Soft GroundTunnelling and Underground Space Technology, 2007
- Modelling TBM performance with artificial neural networksTunnelling and Underground Space Technology, 2004
- A 3D finite element simulation model for TBM tunnelling in soft groundInternational Journal for Numerical and Analytical Methods in Geomechanics, 2004
- Face stability conditions with earth-pressure-balanced shieldsTunnelling and Underground Space Technology, 1996
- Upper and lower bound solutions for the face stability of shallow circular tunnels in frictional materialGéotechnique, 1990
- The stability of shallow tunnels and underground openings in cohesive materialGéotechnique, 1980