Lib Dem Care Minister Norman Lamb has said the evidence was "clear" that the controversial "spare-room" policy was not working.
He told BBC2's Newsnight that in his North Norfolk constituency he came across "many cases" where people may be willing to move, but the state of the housing market and the shortage of social housing just makes it impossible.
"So they are stuck in a situation," he said.
"It was also wrong for disabled people who needed an extra room for a carer to use or to be adapted in some way to be hit".
The Liberal Democrats called for a reform of the bedroom tax in a dramatic withdrawal of support for the controversial welfare reform.
More top news
Leicester City have sacked manager Claudio Ranieri less than nine months after he guided them to a historic Premier League title
Around 40 people were in the sports hall at Southwood Middle School in Milton Keynes when the 8ft by 5ft ceiling caved in.
Shaun Walmsley, 28, is on the run after two armed men helped him escape during an escorted hospital visit.