Senior Liberal Democrats have not entered the row which has seen David Cameron back Chancellor George Osborne's comments that the case prompted "wider questions about our welfare system."
Mr Alexander said: "The Philpott case is an individual tragedy. Children have died in that case.
"I think that is where we should let that case lie. I would not want to connect that to the much wider need to reform our welfare system."
More top news
South Africa's president often seems able to survive anything, writes John Ray - but a vote of no confidence held in secret may change that.
No EU national currently living lawfully in the UK will be made to leave on the day of Brexit under proposals outlined by Theresa May.
A revolutionary cancer-fighting machine will deliver proton beam therapy for the first time in the UK.