Senior Liberal Democrats have not entered the row which has seen David Cameron back Chancellor George Osborne's comments that the case prompted "wider questions about our welfare system."
Mr Alexander said: "The Philpott case is an individual tragedy. Children have died in that case.
"I think that is where we should let that case lie. I would not want to connect that to the much wider need to reform our welfare system."
More top news
Showers in the north. Fine in the south
A British man was injured in a suspected terror attack in Finland in which two people were killed, the Government has said.
Jeremy Hunt has rejected Professor Stephen Hawking's claim that he "abused" scientific research to justify the creation of a seven-day NHS.