Many of the victims died as they jumped from the building to escape the flames, a police official said, while witnesses added the death toll could rise.
The cause of the blaze was not immediately clear.
Bangladesh has around 4,500 garment factories that make clothes for brands including Tesco, Wal-Mart, JC Penney, H&M, Marks & Spencer, Kohl's and Carrefour.
Ready made garments make up 80 percent of the country's $24 billion annual exports.
More top news
A female motorcyclist who hates litter bugs seems to have taken drastic action to make people stop dropping rubbish on the streets in Russia
ITV News can reveal how many hospital trusts are being forced to recruit from abroad as they struggle to staff their wards.
You can buy just about anything on Alibaba, including some very unusual items.