There is currently a two-month delay from the time an offender is charged by the police to the sentence being handed down in a magistrates' court, the think-tank Policy Exchange said.
Max Chambers, head of crime and justice at Policy Exchange, and author of the report, said:
There is no good reason for our criminal justice system to operate in such a leisurely fashion.
Police Courts would mean much swifter justice for low-level crime, reflecting the fact that if a punishment is to be meaningful and actually change behaviour, it has to be delivered very quickly.
Putting magistrates in police stations will also bring much greater oversight to the use of cautions, about which there has been legitimate public concern.
As budgets are reduced dramatically, the courts system will inevitably have to change.
Fewer buildings will be part of the solution, but government must take care to protect the local justice landscape, underpinned by volunteer magistrates, that has served us so well for hundreds of years.
More top news
The BBC, The Daily Mail, The Guardian, and Buzzfeed were among organisations not allowed access to a government meeting.
Mexico's Foreign Minister has warned Donald Trump against imposing a tax to pay for a border wall between the two nations.
Rain will affect many northern areas at first, pushing further south through the day.