Many of the victims died as they jumped from the building to escape the flames, a police official said, while witnesses added the death toll could rise.
The cause of the blaze was not immediately clear.
Bangladesh has around 4,500 garment factories that make clothes for brands including Tesco, Wal-Mart, JC Penney, H&M, Marks & Spencer, Kohl's and Carrefour.
Ready made garments make up 80 percent of the country's $24 billion annual exports.
More top news
Eurostar passengers were left stranded last night after migrants reportedly climbed on top of trains at Calais.
Andy Burnham is set to criticise those who question membership of international alliances and institutions in favour of 'isolationism'.
Wrestling legend Jimmy Snuka has been charged over the death of his girlfriend more than 30 years ago.