Many of the victims died as they jumped from the building to escape the flames, a police official said, while witnesses added the death toll could rise.
The cause of the blaze was not immediately clear.
Bangladesh has around 4,500 garment factories that make clothes for brands including Tesco, Wal-Mart, JC Penney, H&M, Marks & Spencer, Kohl's and Carrefour.
Ready made garments make up 80 percent of the country's $24 billion annual exports.
More top news
The Hollywood star refused to appear on ITV's Good Morning Britain because of host Piers Morgan's comments about the women's marches.
The former Ukip leader has torn into the Labour leader as he backed his successor Paul Nuttall to claim the vacant Stoke Central seat.
The man, in his thirties, was found with stab injuries on the upper deck of a bus in Handsworth, Birmingham, on Monday night.