He argued that for an aluminium smelter to leave the UK and go to another country would not make much difference to climate change.
But it would make a "huge difference" to those who lost their jobs as a result, he said.
Energy companies claim that green taxes are to blame for around 10% of the average household's energy bill.
Energy Minister Michael Fallon is understood to be looking at ways to reduce the impact of environmental measures have on household energy bills, The Times reported.
More top news
The number of children dying from cancer in the UK each year is falling, according to new figures from a major charity.
A mother who poked fun at a clothing company's portrayal of a woman getting out Christmas decorations has won thousands of supporters.
David Cameron will try to convince MPs that Britain should be striking so-called Islamic State targets in Syria on Thursday.