Around 1,000 EDL protesters then made their way along Whitehall before taking a position on the pavement across the road from Downing Street.
A smaller group of anti-fascist demonstrators gathered opposite them holding an "EDL Racists" banner.
Both sides traded insults but were kept apart by officers and barriers.
The EDL supporters chanted: "We hate Cameron."
The anti-fascist supporters chanted: "Racist scum off our streets."
More top news
Police have expressed concern for a missing 13-year-old girl who was last seen on Saturday.
Fat and unfit police officers who fail fitness tests must lose weight or "we haven't got a job for them", Sir Bernard Hogan-Howe has said.
Jeremy Hunt has accused staffing agencies of "ripping off the NHS" as he announced new measures to clampdown on