Senior Liberal Democrats have not entered the row which has seen David Cameron back Chancellor George Osborne's comments that the case prompted "wider questions about our welfare system."
Mr Alexander said: "The Philpott case is an individual tragedy. Children have died in that case.
"I think that is where we should let that case lie. I would not want to connect that to the much wider need to reform our welfare system."
More top news
Labour is promising to reverse the Conservative policy of privatisation in the NHS which it claims is creating longer waiting times.
The Queen and senior members of the monarchy will attend services around the world to commemorate the centenary of the battle of Gallipoli.
The Liberal Democrats have proposed to invest an extra £10 million in mental health care for military personnel