Senior Liberal Democrats have not entered the row which has seen David Cameron back Chancellor George Osborne's comments that the case prompted "wider questions about our welfare system."
Mr Alexander said: "The Philpott case is an individual tragedy. Children have died in that case.
"I think that is where we should let that case lie. I would not want to connect that to the much wider need to reform our welfare system."
More top news
Jeremy Hunt could impose controversial new contracts for junior doctors by Monday, ITV News Political Editor Robert Peston has learned.
A new video has emerged online purporting to show a four-year-old British boy blowing up a car and killing three prisoners on behalf of IS.
An inquest has heard Charlie Jermyn died just 30 hours after he was born because he was not given the right antibiotics.