Many of the victims died as they jumped from the building to escape the flames, a police official said, while witnesses added the death toll could rise.
The cause of the blaze was not immediately clear.
Bangladesh has around 4,500 garment factories that make clothes for brands including Tesco, Wal-Mart, JC Penney, H&M, Marks & Spencer, Kohl's and Carrefour.
Ready made garments make up 80 percent of the country's $24 billion annual exports.
More top news
Katie Hopkins has sparked a backlash yet again after saying she would use gunships to stop migrants crossing the Mediterranean.
Michael Buble has been criticised as "disgusting" for posting a picture of a woman wearing tight shorts using the hashtag #beautifulbum.
Vinyl copies of a cover of Monty Python's 'Galaxy Song' recorded by Stephen Hawking go on sale later as part of Record Store Day.