When phonons couple to fermions in Weyl semimetals, the interaction may turn the system into an insulator. There are several phases the insulating state can be associated with, in particular a number of phases in which the time reversal and the sublattice symmetries are spontaneously broken. The examples are many body states commensurate to the Haldane staggered flux or to the modulated strain lattice models. We find that the effective field theories describing each of these phases exhibit the presence of phase specific topological terms. The coefficients of those generalized Chern-Simons terms are related to the topological invariants of microscopic model and hence to the quantized Hall conductivities with phase specific features.