Around 1,000 EDL protesters then made their way along Whitehall before taking a position on the pavement across the road from Downing Street.
A smaller group of anti-fascist demonstrators gathered opposite them holding an "EDL Racists" banner.
Both sides traded insults but were kept apart by officers and barriers.
The EDL supporters chanted: "We hate Cameron."
The anti-fascist supporters chanted: "Racist scum off our streets."
More top news
Garth Linham worked as a postman for 30 years when he died of a heart attack - but bosses immediately asked for his uniform back.
The reforms are the biggest shake-up of the exam system for a generation. Here's what's changed.
The Duke of Cambridge has condemned the "violent and apparently targeted murder" of the head of a wildlife conservation foundation.