It's over recent Census results, which showed a decline in the number of Welsh speakers.
The Welsh Government say the building remains open to staff and visitors as usual.
Cymdeithas are holding a peaceful protest at one of the entrances at the Welsh Government offices in Cardiff. The main reception remains open as usual to all staff and visitors.
More top news
Tesco has apologised for a mistake which meant employees facing redundancy in Cardiff didn't receive details on how to apply for other roles
Police are appealing for information after a rail staff member was almost pushed onto the tracks at Newport train station.
The mayor of Pembroke, Councillor David Boswell, has been charged with rape and indecent assault.