Taunton's Liberal Democrat MP Jeremy Browne was sacked to give other members of the party a turn in government, Nick Clegg said.
In a letter explaining why he had removed the MP from his job as Home Office minister, the Deputy Prime Minister said he was keen to "provide the opportunity for as many in our ranks as possible to contribute their skills to Ministerial office".
The decision to kick him out of government, particularly from such a high profile role, was one of the surprise moves of the reshuffle.
Mr Clegg wrote: "It is always very difficult to move colleagues out of government but as you know, I have always been keen that we provide the opportunity for as many in our ranks as possible to contribute their skills to Ministerial office during this Parliament
so that, just as the Government has benefited from your contribution over the past three years, it can also gain from those of other colleagues in the remaining years of this parliament.
"I am immensely grateful to you for your commitment and support over the past few years. You have made a major contribution to this historic coalition government and as one of the very few ministers who have served in two departments,
I have no doubt there will be an opportunity for your experience to be deployed in government in the future."
Mr Browne, who also served as a minister in the Foreign Office, said he remained supportive of the Government but cautioned against "lapsing into transactional trade-offs and deferred decision making".
He added: "I supported your election as party leader and I admired your decision to take our party into government.
"Easy and permanent opposition may be alluring to some but you are right not to find it seductive."
More top news
Almost 20,000 hand-made shrouded figures have been laid out to mark the 100th anniversary of the Battle of the Somme.
The RAF's new state of the art fighter jet has touched down for the first time at Fairford in Gloucestershire.
It'll be a mixed start to the day but the clouds will soon clear up making it a much brighter afternoon.