Around 1,000 EDL protesters then made their way along Whitehall before taking a position on the pavement across the road from Downing Street.
A smaller group of anti-fascist demonstrators gathered opposite them holding an "EDL Racists" banner.
Both sides traded insults but were kept apart by officers and barriers.
The EDL supporters chanted: "We hate Cameron."
The anti-fascist supporters chanted: "Racist scum off our streets."
More top news
Royal Navy vessels are following Russian warships 'every inch of the way' as they pass through the English Channel on their way to Syria.
Official figures show parents are increasingly defying government rules and taking their children on unauthorised trips during term-time.
Tabloid 'King of the Sting' given a jail sentence for tampering with evidence in the collapsed drugs trial of pop star Tulisa Contostavlos.