Business Secretary Vince Cable said his Liberal Democrat colleague Sarah Teather was right to warn plans for a £500-a-week cap on household benefits could have "very serious social consequences", but he defended the need for such a cap.
Mr Cable said it was required to prevent housing benefit "escalating out of control" but had to be accompanied by an increase in the provision of affordable housing.
"What is immoral, and I have read her article carefully, is demonising poor people," he told BBC1's Andrew Marr Show.
"We have got to cap the housing benefit element while at the same time increasing the supply of affordable housing," the Business Secretary continued.
"That is absolutely critical because without that you will have very serious social consequences which Sarah has quite rightly warned about."
More top news
The drugs are used to control both pain and inflammation, and are commonly taken by people with arthritis.
The veteran singer, 75, will release his 101st album - 'News of Just ... Fabulous Rock 'n' Roll' - in November.
The Duke and Duchess of Cambridge were left cautiously watching every step after making an impromptu visit aboard a steam train.