Prisons minister, Jeremy Wright said new prison reform plans are aimed at "making sure people turn their lives around".
Offenders leaving prison could soon serve at least a year under supervision once they are back in the community.
Under the proposals, a network of around 70 "resettlement prisons" will be created so nearly all offenders will be released into the area in which they will live and be supervised.
Speaking to Daybreak he said: "We want to make sure that [ex-prisoners] stay in one place long enough to engage in the rehabilitation that they need", he added, "its important that we have some kind of control over them".
More top news
Few can truly claim to be ‘the voice’ of a sport but Alastair Stewart says few could argue O’Sullevan was not that ‘voice’ for horse racing.
Tributes have been paid to the 'voice of racing' Sir Peter O'Sullevan, following his death aged 97.
ITV News has footage of migrants in Calais attempting to gain entry to the Channel Tunnel and the hope of a better life in the UK.