Around 1,000 EDL protesters then made their way along Whitehall before taking a position on the pavement across the road from Downing Street.
A smaller group of anti-fascist demonstrators gathered opposite them holding an "EDL Racists" banner.
Both sides traded insults but were kept apart by officers and barriers.
The EDL supporters chanted: "We hate Cameron."
The anti-fascist supporters chanted: "Racist scum off our streets."
More top news
A woman involved in a car crash had to be taken to hospital by helicopter with serious injuries.
Search for missing seven-year-old underway after he was reportedly abandoned in a forest by his parents as "punishment" for throwing rocks.
Shooting of a 400-pound gorilla who grabbed a four-year-old boy after he entered his enclosure sparks public outrage and prompts petition.