Around 1,000 EDL protesters then made their way along Whitehall before taking a position on the pavement across the road from Downing Street.
A smaller group of anti-fascist demonstrators gathered opposite them holding an "EDL Racists" banner.
Both sides traded insults but were kept apart by officers and barriers.
The EDL supporters chanted: "We hate Cameron."
The anti-fascist supporters chanted: "Racist scum off our streets."
More top news
Takeaway food and alcohol are causing a growing obesity crisis among pets, according to a leading animal welfare charity.
Teacher shortages in England continue to grow and the government has missed recruitment targets, the National Audit Office says.
The way the government plans to pay for social housing tenants to buy their homes is "extremely questionable", MPs warn.