Business Secretary Vince Cable said his Liberal Democrat colleague Sarah Teather was right to warn plans for a £500-a-week cap on household benefits could have "very serious social consequences", but he defended the need for such a cap.
Mr Cable said it was required to prevent housing benefit "escalating out of control" but had to be accompanied by an increase in the provision of affordable housing.
"What is immoral, and I have read her article carefully, is demonising poor people," he told BBC1's Andrew Marr Show.
"We have got to cap the housing benefit element while at the same time increasing the supply of affordable housing," the Business Secretary continued.
"That is absolutely critical because without that you will have very serious social consequences which Sarah has quite rightly warned about."
More top news
An independent investigation has begun into finances at taxpayer-funded Broadmoor Hospital.
While the economy has shown signs of improving, the number of UK companies issuing profit warnings has hit a six-year high, research shows.
The Child Support Agency has collected £1.2 billion in maintenance over the past year, with £330 million coming direct from pay packets.