Labour has deprived the Tories of outright control of Waveney District Council by retaining their seat at Oulton.
The by-election was called following the death of Labour councillor Mike Ives-Keeler in June.
The seat won by Labour's Len Jacklin, with the Tory councillor in second place.
A Labour government will give councils new powers to stop pay day lenders and betting shops swamping high streets, Ed Miliband pledged.
Businesses that do well out of hard times are springing up in place of shops, restaurants and banks but town halls are almost powerless to act, the party leader warned.
He set out Labour proposals to change planning laws so councils could refuse permission for certain businesses, including payday lenders that "engulf" people in debt.
The Labour leader Ed Miliband is due to launch his party's campaign for the 2013 local elections in the region today, Monday 8th April. Mr Miliband who recently held a policy launch in Bedford, will visit battleground constituencies in the East as part of a three day campaign.
The Lib Dem Energy Secretary Ed Davey has told ITV News he is "delighted" Labour has "seen the error of their ways" by announcing plans for a "mansion tax" on houses worth £2 million:
In what turned out to be a bruising encounter for the Conservatives, Labour made sweeping gains across our region in the local elections.