Senior Liberal Democrats have not entered the row which has seen David Cameron back Chancellor George Osborne's comments that the case prompted "wider questions about our welfare system."
Mr Alexander said: "The Philpott case is an individual tragedy. Children have died in that case.
"I think that is where we should let that case lie. I would not want to connect that to the much wider need to reform our welfare system."
More top news
Tributes are being paid to two young men from Plymouth who died after apparently taking white heroin by mistake in Amsterdam.
One might argue that David Cameron has just given a speech about a problem that doesn't exist and it is definitely one he can't change.
The complex mix of marketing, merchandising and psychology that sees shoppers parting with £360,000 a minute in the UK's shops.