Three other people were arrested in Tottenham, north London, at the same time as McLoughlin, police said.
The 54-year-old man from Tottenham, 45-year-old woman from Edmonton, north London, and 50-year-old man from Hackney were arrested on suspicion of assisting an offender.
All four are being questioned at Hatfield police station, Hertfordshire Police said.
More top news
The operation carried out by Westminster City Council led to the seizure of £8,000 worth of cigarettes.
Armed troops have been stationed around Parliament to free up armed police to patrol the streets in the wake of the Manchester bomb attack.
Chelsea had planned an open top bus tour to show off the Premier League trophy and hope to add the FA Cup in Saturday's final with Arsenal.