Around 1,000 EDL protesters then made their way along Whitehall before taking a position on the pavement across the road from Downing Street.
A smaller group of anti-fascist demonstrators gathered opposite them holding an "EDL Racists" banner.
Both sides traded insults but were kept apart by officers and barriers.
The EDL supporters chanted: "We hate Cameron."
The anti-fascist supporters chanted: "Racist scum off our streets."
More top news
Cool and breezy for the time of year
The people behind the moving tribute marking 100 years since the Battle of the Somme were unknown - until now.
Gunmen have stormed a restaurant in Dhaka, Bangladesh, taking a number of hostages and opening fire at police. Here's what we know.