Energy Secretary Ed Davey said he does not want to add "a single penny" to energy bills that isn't in the public interest.
Speaking at the Fair Energy Summit in London, Mr Davey said, "I'm quite frankly fed up with commentators suggesting the Government are deliberately increasing energy bills, when in fact we are doing everything we can to reduce them".
"The bulk of the cost we add to bills is for supporting low carbon technologies and energy efficiency ... I make no apology for ensuring that we meet our legally-binding carbon targets and renewable energy targets", he added.
More top news
The 30-year-old pop star was arrested on Tuesday for "alleged road traffic offences."
Net migration to Britain was down 49,000 in the year to September 2016, the lowest level in more than two years.
Special forces say they have attacked a sprawling site adjacent to the city's airport in a bid to liberate the area from IS.