There is currently a two-month delay from the time an offender is charged by the police to the sentence being handed down in a magistrates' court, the think-tank Policy Exchange said.
Max Chambers, head of crime and justice at Policy Exchange, and author of the report, said:
There is no good reason for our criminal justice system to operate in such a leisurely fashion.
Police Courts would mean much swifter justice for low-level crime, reflecting the fact that if a punishment is to be meaningful and actually change behaviour, it has to be delivered very quickly.
Putting magistrates in police stations will also bring much greater oversight to the use of cautions, about which there has been legitimate public concern.
As budgets are reduced dramatically, the courts system will inevitably have to change.
Fewer buildings will be part of the solution, but government must take care to protect the local justice landscape, underpinned by volunteer magistrates, that has served us so well for hundreds of years.
More top news
Isolated afternoon showers are likely over Scotland.
"I definitely get less money than a male in my situation would," she said. "Definitely."
Muscular Dystrophy UK said the lack of an option to label abusive tweets based on disability was preventing more reporting.