Sir Jeremy Heywood is reported to have told Prime Minister David Cameron about the conversation.
"Our clear impression was that he was spitting tacks with Gove and was ready to resign unless the Minister was told to shut up," a Government source told the newspaper.
Mr Gove, a former journalist at the News Corporation-owned Times, told a Parliamentary Press Gallery lunch in February that he saw "dangers" in the inquiry into press cultures, practices and ethics.
Lord Justice Leveson instructed his officials to compile a full report of the comments and he phoned Sir Jeremy within 24 hours, it was reported.
More top news
A woman who answered a lonely hearts ad was among two females who may have been tortured to death by a man and his ex-wife, police say.
A mattress which fell from the back of a van hit a passing motorcyclist - but provided him with a cushy landing, a video purportedly shows.
Leicester City manager Claudio Ranieri says his side's Premier League title victory will take time to sink in.