Many of the victims died as they jumped from the building to escape the flames, a police official said, while witnesses added the death toll could rise.
The cause of the blaze was not immediately clear.
Bangladesh has around 4,500 garment factories that make clothes for brands including Tesco, Wal-Mart, JC Penney, H&M, Marks & Spencer, Kohl's and Carrefour.
Ready made garments make up 80 percent of the country's $24 billion annual exports.
More top news
A British soldier has become an overnight multimillionaire after scooping more than £13.2 million on a 25p stake.
Several people are thought to have been killed in a fire at a traveller's site in the Republic of Ireland.
More than 90% of hospices in England have been rated 'good' or 'outstanding' in a wave of new inspections.