Conservative London Assembly member Andrew Boff said it still wasn't clear where the cash was coming from and who's paying for the transformation of the stadium.
Andrew Boff added: "We still don't really know, but chances are we're all contributing. Taxpayers shouldn't be paying for Premiership football clubs.
"The £154 million has to come from an already stretched LLDC budget and the knock-on effect is that the rest of the transformation of the park - the really important stuff such as housing - will suffer as a result.
"Only by ditching the requirement for the athletics track, are we likely to see more bids from the private sector, for a proper football stadium rather than the hybrid fudge we currently have."
More top news
The memorial will focus on remembering the 71 victims of the tower block fire.
A woman died as she crossed the road when she was struck by four separate motorists who police believe did not stop.
Patrols including local volunteers have been set up after the grisly finds in Thamesmead in the last month.