David Seeckts, Head of Manufacturing Midlands at Premier Foods said the 511 jobs were going at Birmingham because the firm lost a significant bread contract for 2013 and because of general competition and the nature of the industry.
The Birmingham site opened in 1964. There are 323 production jobs and 188 in distribution.
The plan is for the closure to go ahead by the second quarter of next year.
More top news
A pensioner who made neighbours' lives a misery, including displaying images of Miss Piggy to torment an overweight woman, has been jailed.
A newly promoted police officer caused a sensation with local women on Facebook
Headteachers could strike in protest at government plans to force schools to become academies