There is currently a two-month delay from the time an offender is charged by the police to the sentence being handed down in a magistrates' court, the think-tank Policy Exchange said.
Max Chambers, head of crime and justice at Policy Exchange, and author of the report, said:
There is no good reason for our criminal justice system to operate in such a leisurely fashion.
Police Courts would mean much swifter justice for low-level crime, reflecting the fact that if a punishment is to be meaningful and actually change behaviour, it has to be delivered very quickly.
Putting magistrates in police stations will also bring much greater oversight to the use of cautions, about which there has been legitimate public concern.
As budgets are reduced dramatically, the courts system will inevitably have to change.
Fewer buildings will be part of the solution, but government must take care to protect the local justice landscape, underpinned by volunteer magistrates, that has served us so well for hundreds of years.
More top news
Dippy the Diplodocus is to forced into retirement and moved out of the Natural History Museum's main hall.
Alice Biggar has managed to survive on cheap tins, heavily-reduced supermarket goods and even chicken bones from butchers.
People should go online to report crimes instead of dialling 999, Home Secretary Theresa May has claimed.