David Seeckts, Head of Manufacturing Midlands at Premier Foods said the 511 jobs were going at Birmingham because the firm lost a significant bread contract for 2013 and because of general competition and the nature of the industry.
The Birmingham site opened in 1964. There are 323 production jobs and 188 in distribution.
The plan is for the closure to go ahead by the second quarter of next year.
More top news
Des Coleman has the latest forecast for the West Midlands
Des Coleman has the latest weather forecast for the East Midlands.
Des Coleman has the latest forecast for the West Midlands.