The Prime Minister said the Chancellor's remarks about the Philpott case "were absolutely right".
He said: "I think what George Osborne said was absolutely right.
"He said that Mr Philpott was the one to blame for his crimes and he should be held responsible but what the Chancellor went on to say is we should ask some wider questions about our welfare system - how much it costs and the signals that it sends.
"We do want to make clear that welfare is there to help people who work hard, it shouldn't be there as a lifestyle choice and I think that's entirely legitimate."
More top news
More than seven million people in their 30s and 40s will lose out by £10,000 each under plans to increase the state pension age to 68.
The Duke of Cambridge reveals he often talks to Prince George and Princess Charlotte about their other grandmother.
The Queen asked Harry Herbert about Diana in the weeks before her and Prince Charles' separation because she was so worried about her.