Firefighters based at the fire station nearby had heard shouting in the street and went out to investigate, where they were confronted and threatened by the man.
The 26-year-old suspect remained hostile and struck the window of one of the first police cars when they arrived.
Eyewitness Jenilee Graham said she was unaware there was a situation developing until a woman stopped her and told her to get away.
The 23-year-old City worker, from south London, said:
"I was coming back from Asda with my mum when we saw a woman who told us to stop where we were going. We didn't know what was happening, but then we saw the man who the woman was talking about pop out from behind a bus. He ran towards us, then he darted down a side street. It was obviously pretty scary."
More top news
Rashan Charles, 20, died after being apprehended by Metropolitan Police officers after running into a shop in Dalston, east London.
The House of Commons Commission will consider how long the bongs should be halted following concerns raised by a number of MPs.
The chimes are being stopped to allow extensive renovation work to the Elizabeth Tower, the Great Clock and its bell.