Many of the victims died as they jumped from the building to escape the flames, a police official said, while witnesses added the death toll could rise.
The cause of the blaze was not immediately clear.
Bangladesh has around 4,500 garment factories that make clothes for brands including Tesco, Wal-Mart, JC Penney, H&M, Marks & Spencer, Kohl's and Carrefour.
Ready made garments make up 80 percent of the country's $24 billion annual exports.
More top news
Mostly dry overnight in the east, strong winds and showery rain affecting Scotland & Northern Ireland
A couple have got married for the second time after the bride forgot their first big day following a car crash.
Sir Bruce Forsyth, Sir Cliff Richard and the Prime Minister have been among those paying tribute to Cilla Black following news of her death.