Senior Liberal Democrats have not entered the row which has seen David Cameron back Chancellor George Osborne's comments that the case prompted "wider questions about our welfare system."
Mr Alexander said: "The Philpott case is an individual tragedy. Children have died in that case.
"I think that is where we should let that case lie. I would not want to connect that to the much wider need to reform our welfare system."
More top news
More than 50 dog surfers of all breeds and sizes joined an annual dog surfing competition in California
A painting by artist LS Lowry is to go on show to the public for the first time.
A third of Olympic and world championships medals have been won by athletes with allegedly suspicious doping test results, report claims