Many of the victims died as they jumped from the building to escape the flames, a police official said, while witnesses added the death toll could rise.
The cause of the blaze was not immediately clear.
Bangladesh has around 4,500 garment factories that make clothes for brands including Tesco, Wal-Mart, JC Penney, H&M, Marks & Spencer, Kohl's and Carrefour.
Ready made garments make up 80 percent of the country's $24 billion annual exports.
More top news
An elephant calf had to be rescued in Sri Lanka after becoming trapped in a drain.
According to local reports, the repairman had failed to disconnect the power to the escalator before getting to work.
Millwall fans who caused problems at the match against Barnsley could face lifetime bans, the club said.