Moorland residents count the cost of the floods to now face an impossible dilemma between abandoning their homes or risk costly renovations.
One resident built a giant clay wall to protect his house, but other locals could do nothing to stop the rising waters.
Environment Agency chairman Lord Smith was greeted by angry Somerset locals as he visited the area for the first time since the crisis.
Engineering works continue in Dawlish to repair the sea wall on which the main rail line connecting Cornwall with the rest of the country sits.
But successive bands of rain are expected to continue until at least Tuesday, putting the recovery efforts at risk.
High tides and stormy seas destroyed around 80 metres of the wall, causing a significant stretch of the railway to collapse into the sea.
The road adjacent to the railway and several houses has also been damaged, as was Dawlish station itself and several other sites in the area.
FLAG (Flooding on the Levels Action Group) tweeted its thanks to volunteers who supported the flood relief effort in Somerset on Friday after more specialist pumping equipment was taken to the area.
Hayley Matthews says she has "lost everything" because of the floods.
Ms Matthews, who lives in the village of Moorland, which has been largely evacuated due to the severity of the floods told ITV News:
"I'm now living in a caravan, my kids are living with their grandparents and we're just spread everywhere and there's just devastation. I've lost my house, I've lost my family, I've lost everything."
The centre of the village of Moorland in Somerset in now almost impossible to get through due to the severe flooding.
Local MP Ian Liddell-Grainger, who represents Bridgwater and West Somerset, described Lord Smith as a "coward" and a "little git" ahead of his meeting with flooded residents today.
He said: "I will tell him what I bloody well think of him - he should go, he should walk. I'm livid. This little git has never even been on the telephone to me.
"When I find out where he is, I will give it to him. He has not told the local MPs, the local council or the local press where he is going to be.
"He's a coward."
Jim Winkworth, a farmer and landlord of the King Alfred pub in the village of Burrowbridge, said he was "bloody mad" after a meeting with Lord Smith.
Asked how he felt by the Environment Agency chief's refusal to apologise, he said: "Bloody mad. We thought that's the least he could do today and he's not apologising or admitting any liability."
Speaking of Lord Smith's successor when he is due to stand down in the summer, Mr Winkworth said: "Whoever gets his job needs to be someone who is prepared to listen to people on the ground and actually kick some arse, get some work done and actually do some dredging and maintain structures".
Lord Smith reportedly told residents that it had set aside £400,000 for dredging but that this was not enough and there was "no point starting a job and not finishing it".