Business Secretary Vince Cable said his Liberal Democrat colleague Sarah Teather was right to warn plans for a £500-a-week cap on household benefits could have "very serious social consequences", but he defended the need for such a cap.
Mr Cable said it was required to prevent housing benefit "escalating out of control" but had to be accompanied by an increase in the provision of affordable housing.
"What is immoral, and I have read her article carefully, is demonising poor people," he told BBC1's Andrew Marr Show.
"We have got to cap the housing benefit element while at the same time increasing the supply of affordable housing," the Business Secretary continued.
"That is absolutely critical because without that you will have very serious social consequences which Sarah has quite rightly warned about."
More top news
A Russian tourist has been fined 20 Euros (£15,829) for engraving a 10-inch tall letter 'K' on a wall of the Colosseum in Rome with a stone.
Ex-minister Owen Paterson said David Cameron should apply to leave the EU immediately after the general election next year.
Fresh data revealed smartphone and tablet users are increasingly targeted by online crooks.