Shadow cabinet office minister Gareth Thomas said it was "difficult to see how he can continue" while he was under investigation.
The political blogger Paul Staines, who runs the Guido Fawkes website, has also reported the MP to the Metropolitan Police and asked them to investigate.
Mr Yeo is under fire after an undercover Sunday Times investigation appeared to show him claiming he could exert influence behind the scenes for private companies.
Earlier, in an interview on BBC Radio Wales he insisted he would not quit the committee chairmanship while the allegations were investigated.
The newspaper's footage showed Mr Yeo seemingly suggesting that he had coached a client, John Smith, managing director of GB Rail Freight, on how to influence the committee - a meeting at which he excused himself asking questions because of the conflict of interest.
"I was able to tell him in advance what he should say," he said.
Mr Yeo told BBC Radio Wales: "What happened was I travelled with the person concerned in the company of two other people five days before his appearance before the committee in a train.
"During that conversation I spoke very briefly to him about his forthcoming appearance in front of the committee, so I could explain to him that because of the business connection between us - which, of course, was properly declared and registered - I wouldn't take part in questioning."
He added: "I did not do so, I did not coach John Smith as the paper alleges, he's not a paying client as the paper alleges, and like many business executives giving evidence to select committees, he actually sought advice from the public affairs company which his company retains for that purpose."
Mr Yeo referred himself to parliamentary standards commissioner Kathryn Hudson after the Sunday Times sting. Its reporters approached the MP posing as representatives of a solar energy company, offering to hire him at £7,000 a day to push for new laws to boost its business.
More top news
The Polish ambassador has called on the government to condemn a series of cards containing the words 'no more Polish vermin'.
Increasingly cloudy, with some rain possible overnight. Sunny spells Monday.
A rare Aston Martin that was left in a Hertfordshire back garden for decades before being stolen has sold at auction.