Haye's February 8 match against fellow Brit Tyson Fury will now be cancelled.
It's the second time Haye has had to pull out of the fight; he previously cancelled in September after sustaining an eye injury.
More top news
Corbyn was unveiling a poster less than a mile away as Khan gave his final campaign speech to party supporters in London.
Hay fever is an allergic reaction to airbourne pollen. There are 2 million sufferers in London (that's one in 5 people).
The man suffered head injuries after falling from Westminster Bridge and landing on concrete steps.