There is currently a two-month delay from the time an offender is charged by the police to the sentence being handed down in a magistrates' court, the think-tank Policy Exchange said.
Max Chambers, head of crime and justice at Policy Exchange, and author of the report, said:
There is no good reason for our criminal justice system to operate in such a leisurely fashion.
Police Courts would mean much swifter justice for low-level crime, reflecting the fact that if a punishment is to be meaningful and actually change behaviour, it has to be delivered very quickly.
Putting magistrates in police stations will also bring much greater oversight to the use of cautions, about which there has been legitimate public concern.
As budgets are reduced dramatically, the courts system will inevitably have to change.
Fewer buildings will be part of the solution, but government must take care to protect the local justice landscape, underpinned by volunteer magistrates, that has served us so well for hundreds of years.
More top news
Chancellor George Osborne has announced a £500m investment for the Faslane naval base in Scotland, home of the UK's nuclear deterrent.
Five-times major winner Maria Sharapova has pulled out of the US Open tennis championships due to a leg injury.
Police are hunting for a mother who has disappeared with her 10-week-old baby.