The linearized Einstein field equations provide a low energy wave equation for propagation of gravitational fields which may be originated from a high energy source. Motivated by loop quantum gravity (LQG), we propose the polymer quantization scheme to derive the effective propagation of such waves on a classical FLRW spacetime. To overcome the challenge of polymer quantizing a time-dependent Hamiltonian, we rewrite such a Hamiltonian in a time-independent manner in the extended phase space, polymerize it, and then transform it back to the usual phase space. This way we obtain a time-dependent polymer Hamiltonian for the gravitational waves. We then derive the effective equations of motion and show that i) the form of the waves are modified ii) the speed of the waves depend on their frequencies iii) the quantum effects are amplified by the distance/time the waves travel.