Around 1,000 EDL protesters then made their way along Whitehall before taking a position on the pavement across the road from Downing Street.
A smaller group of anti-fascist demonstrators gathered opposite them holding an "EDL Racists" banner.
Both sides traded insults but were kept apart by officers and barriers.
The EDL supporters chanted: "We hate Cameron."
The anti-fascist supporters chanted: "Racist scum off our streets."
More top news
Here are the key moments that will take place on the day Article 50 is triggered and the UK begins the formal process of leaving the EU.
A man has been charged in connection with a crash which killed a four-year-old girl.
Philip, 95, used the vehicle for engagements in London allowing him to travel around the city unnoticed.