Soil is washing out under liner. Any suggestions?

We are in the middle of a pool renovation. Concrete deck was ripped up, plumbing was replaced and liner just replaced. Before the pool could be filled, it rained and some of the surrounding soil caved in and washed out under the edge of the steel wall and under the liner. Pool company placed tarps over the deck soil and will be pull back liner Monday to get to the washout. I was planning on waiting until Spring to have deck pavers installed over concrete base. Any suggestions on how to prevent this from happening again before then?