Senior Liberal Democrats have not entered the row which has seen David Cameron back Chancellor George Osborne's comments that the case prompted "wider questions about our welfare system."
Mr Alexander said: "The Philpott case is an individual tragedy. Children have died in that case.
"I think that is where we should let that case lie. I would not want to connect that to the much wider need to reform our welfare system."
More top news
Two pilots have been arrested on suspicion of being under the influence of alcohol as they prepared to fly from Scotland to the New York.
Two teenagers have been arrested on suspicion of drugs offences following the death of a 17-year-old youth who collapsed at Leeds Festival.
Theresa May will gather Cabinet ministers together on Wednesday to discuss her plans for Brexit.