Deptford resident Laura Ballard said: "All the lorries have been turning here. Coming on and off site.
"We've had men parking here, who are not supposed to be parking here all through the night, coming back to their vehicles, laughing, shouting, joking, slamming their doors, changing their outfits before going home. It's not acceptable.
"They were told they were not supposed to park here. This has been going on since July or August."
More top news
George Osborne told MPs London would shoulder a large part of his 37% reduction in transport funding.
The prison was originally opened in 1852 as a mixed prison before becoming the first female-only local prison in England in 1902.
A man who tried to help a woman, who was being assaulted by other passengers on the Victoria Line, ended up being punched in the face.