Around 1,000 EDL protesters then made their way along Whitehall before taking a position on the pavement across the road from Downing Street.
A smaller group of anti-fascist demonstrators gathered opposite them holding an "EDL Racists" banner.
Both sides traded insults but were kept apart by officers and barriers.
The EDL supporters chanted: "We hate Cameron."
The anti-fascist supporters chanted: "Racist scum off our streets."
More top news
Data-selling companies trade personal addresses and phone numbers for as little as 4p per record, a watchdog has warned.
A bitterly cold airmass covers the UK this weekend.
The emotion of Donald Trump's inauguration was too much for Jessica Starr, who told ITV News: "I'm so sorry... this is not America."