Local resident Nicolo Wojewoda has started a petition calling on the Sincura Group to return the Banksy to Tottenham.
The artwork is now to be auctioned by the Sincura Group - the same company which arranged the sale of Banksy's "Slave Labour" in May.
The Sincura Group claims the street graffiti has been "salvaged for renovation" and is now under their management. A statement on its website reads:
"A number of attempts have been made over the past to deface the piece...
"With extensive building works taking place in the local vicinity, and further concerns upon its safety, the piece has been removed to be sensitively restored to its former glory."
It added that it intends to sell the artwork, created by street artist Banksy in 2009, next year and in the meantime it has been "gifted" to a local charity.
Residents in Tottenham are furious after another piece of their heritage was taken away from them.
The work by Banksy - called 'No Ball Games' - was spared onto a wall four years ago. It's believed the same group responsible for auctioning another piece are behind the removal.
'Slave Labour' was removed from a wall in Wood Green last February and sold for around £750,000.
Watch the video of the art being moved from Tottenham, below.