Sir Jeremy Heywood is reported to have told Prime Minister David Cameron about the conversation.
"Our clear impression was that he was spitting tacks with Gove and was ready to resign unless the Minister was told to shut up," a Government source told the newspaper.
Mr Gove, a former journalist at the News Corporation-owned Times, told a Parliamentary Press Gallery lunch in February that he saw "dangers" in the inquiry into press cultures, practices and ethics.
Lord Justice Leveson instructed his officials to compile a full report of the comments and he phoned Sir Jeremy within 24 hours, it was reported.
More top news
Children in the North and the Midlands are less likely to get a good secondary education than those in the South, schools inspector to say.
Mild in the south but colder in the north tonight and turning frosty and icy - before rain moves in.
ITV News' Tom Brady speaks to billionaire philanthropist Bill Gates about clean energy sources and a new $7bn green tech research fund.