The 42-year-old was challenged by police just before 9pm yesterday but failed to respond so the electronic weapon was used.
The man had been shouting in the road and appeared to have a knife that he was pointing at his throat.
He suffered a minor head injury when he fell and was taken to hospital as a precaution. He was later arrested on suspicion of possession of a knife and affray, and remains in custody.
Two police officers from the Diplomatic Protection Group fired the Taser.
It follows a separate incident last month when police outside Buckingham Palace used a Taser on another man who was also accused of brandishing a knife.
More top news
George Osborne told MPs London would shoulder a large part of his 37% reduction in transport funding.
The prison was originally opened in 1852 as a mixed prison before becoming the first female-only local prison in England in 1902.
A man who tried to help a woman, who was being assaulted by other passengers on the Victoria Line, ended up being punched in the face.