Conservatives in South Suffolk are being balloted over whether Tim Yeo MP should stand as their candidate in the next general election.
Tim Yeo was de-selected in November followed him being cleared by the Parliamentary Commissioner for Standards of breaking lobbying rules.
Simon Barrett, from South Suffolk Conservative's Association, said: "We have events, we have actions that need to be taken, meetings with district council, meetings with county council.
"He hasn't really been around making himself known and where there are issues that we have as a local issue that needs maybe the input of the local MP and more access to him, it's been very difficult to get him involved."
Conservative MP Tim Yeo is foregoing his select committee chair's salary - worth £14,728 a year - after stepping down from the role while he awaits the conclusion of the Standards Commissioner's inquiry.
South Suffolk Conservative MP Tim Yeo has formally stepped aside as chairman of an influential Commons committee while he faces investigation into claims that he used his position to help business clients.
Members on the Energy and Climate Change Committee unanimously accepted his offer to step down temporarily while the Parliamentary Standards Commissioner carries out his inquiry.
Tim Yeo has formally stood aside as chairman of an influential House of Commons committee after claims that he used his position to help business clients.
Members on the Energy and Climate Change Committee unanimously accepted the Conservative MP's offer to step down temporarily while the Parliamentary Standards Commissioner carries out an inquiry.
After meeting fellow committee members behind closed doors at the House of Commons, Mr Yeo left before the meeting moved into open session.
Mr Yeo said: "They have unanimously accepted my offer to stand aside for the duration of the inquiry."
The former minister said in a statement last night that he took the decision to ensure the "smooth running" of the committee, and insisted he had not breached Commons rules when he spoke to undercover reporters from the Sunday Times.
Shadow cabinet office minister Gareth Thomas said it was "difficult to see how he can continue" while he was under investigation.
The political blogger Paul Staines, who runs the Guido Fawkes website, has also reported the MP to the Metropolitan Police and asked them to investigate.
Mr Yeo is under fire after an undercover Sunday Times investigation appeared to show him claiming he could exert influence behind the scenes for private companies.
Earlier, in an interview on BBC Radio Wales he insisted he would not quit the committee chairmanship while the allegations were investigated.
The newspaper's footage showed Mr Yeo seemingly suggesting that he had coached a client, John Smith, managing director of GB Rail Freight, on how to influence the committee - a meeting at which he excused himself asking questions because of the conflict of interest.
"I was able to tell him in advance what he should say," he said.
Mr Yeo told BBC Radio Wales: "What happened was I travelled with the person concerned in the company of two other people five days before his appearance before the committee in a train.
"During that conversation I spoke very briefly to him about his forthcoming appearance in front of the committee, so I could explain to him that because of the business connection between us - which, of course, was properly declared and registered - I wouldn't take part in questioning."
He added: "I did not do so, I did not coach John Smith as the paper alleges, he's not a paying client as the paper alleges, and like many business executives giving evidence to select committees, he actually sought advice from the public affairs company which his company retains for that purpose."
Mr Yeo referred himself to parliamentary standards commissioner Kathryn Hudson after the Sunday Times sting. Its reporters approached the MP posing as representatives of a solar energy company, offering to hire him at £7,000 a day to push for new laws to boost its business.