David Seeckts, Head of Manufacturing Midlands at Premier Foods said the 511 jobs were going at Birmingham because the firm lost a significant bread contract for 2013 and because of general competition and the nature of the industry.
The Birmingham site opened in 1964. There are 323 production jobs and 188 in distribution.
The plan is for the closure to go ahead by the second quarter of next year.
More top news
West Midlands weather: Cloudy with some drizzle
East Midlands weather: Some rain, getting brighter
The RSPCA is appealing for information after a dog was found with a crossbow bolt through his skull near Peterborough