EDL leader Tommy Robinson told the demonstration: "This is a day of respect for our Armed Forces."
The crowd repeatedly chanted "coward" after he claimed Prime Minister David Cameron was on holiday "because he doesn't care".
Mr Robinson added: "They've had their Arab Spring. This is time for the English Spring."
About 40 members of the English Defence League are holding a demonstration outside Parliament.
The group were denied permission to march through Walthamstow by the Home Secretary.
The English Defence League demonstration was briefly interrupted by anti-fascist protesters.
They were led away by officers before there was any confrontation.
For more on this story visit the ITV London News website.