The owner of the house and white van which Emily Thornbury took a photo of before posting it on Twitter has said the MP is a "snob".
Dan Ware,told The Sun: "I've not got a clue who she is, but she's a snob".
He said the flags had been left up since being raised when England played in the football World Cup in May.
"We will continue to fly it," he added.
Mr Ware, a 37-year-old father of four, told the newspaper he could not remember when he last voted.
More top news
The SNP withdrew its support after alleged anti-Semitic comments came to light.
Nigel Dodds slumped to unprecedented defeat to Sinn Fein’s John Finucane in a North Belfast campaign dominated by Brexit.
Chuka Umunna and Sam Gyimah, both of whom joined from other parties, failed in their bids to win seats.