The owner of the house and white van which Emily Thornbury took a photo of before posting it on Twitter has said the MP is a "snob".
Dan Ware,told The Sun: "I've not got a clue who she is, but she's a snob".
He said the flags had been left up since being raised when England played in the football World Cup in May.
"We will continue to fly it," he added.
Mr Ware, a 37-year-old father of four, told the newspaper he could not remember when he last voted.
Shadow education secretary Tristram Hunt has said he is "very sad" to lose his "trusted and good" colleague Emily Thornberry following the MP's resignation.
He told BBC2's Newsnight: "I think it's very sad to lose a trusted and good colleague in the run-up to a general election.
"But we should also be very clear that we are hugely in favour in the Labour Party of people expressing pride in their national identity and national symbols.
Labour revealed that Emily Thornberry had spoken to leader Ed Miliband a second time following her initial apology.
A party source said: "Ed and Emily had a second conversation.
"She thought the right thing to do was to resign. Ed agreed."
The owner of the house pictured in a tweet posted by Emily Thornberry has branded the Labour MP "a snob".
"Any hint that you're patronising your voters is very, very dangerous indeed," ITV News Political Editor Tom Bradby said from outside the Rochester home.
Emily Thornberry said she was resigning from the shadow cabinet as she "will not let anything distract from Labour's chance to win" the next General Election.
Ms Thornberry, who was shadow attorney general, said in a statement: "Earlier today I sent a tweet which has caused offence to some people. That was never my intention and I have apologised.
"However I will not let anything distract from Labour's chance to win the coming General Election.
"I have therefore tonight told Ed Miliband I will resign from the shadow cabinet."
Shadow attorney general Emily Thornberry has resigned from the shadow cabinet, the Labour Party has said.
It follows controversy over a tweet she posted earlier today of a house draped with England flags and the words "Image from Rochester".
A Labour MP has angered Ed Miliband after she tweeted a picture of a house draped with England flags with the words "Image from Rochester."Read the full story ›
Ed Miliband MP, Leader of the Labour Party, has promised straight answers when he is grilled by young voters in his Leaders Live Q&A on Monday 8th December.
The 2015 General Election is going to be hugely important for the future of Britain – and particularly for young people. Leaders Live will give young people a chance to ask political leaders direct questions and get straight answers. I’m really looking forward to being involved.
Labour has extended its poll lead to four points but just one in five people can imagine Ed Miliband as prime minister, according to a poll.Read the full story ›
Eight out of ten Britons feel the economic recovery has had little or no impact on their personal circumstances, new research reveals.
Asked what effect the upturn had had on them, 49% said there had been "none at all", while 31% said "not very much".
The Ipsos MORI poll for the Evening Standard also found pessimism about the future, with 75% of respondents saying economic growth would have either no impact or "not very much".
The political implications of the survey are potentially interesting, with the Conservatives trumpeting the UK's improved overall economic performance, but Labour arguing that many are not feeling the benefits of growth.