It's over recent Census results, which showed a decline in the number of Welsh speakers.
The Welsh Government say the building remains open to staff and visitors as usual.
Cymdeithas are holding a peaceful protest at one of the entrances at the Welsh Government offices in Cardiff. The main reception remains open as usual to all staff and visitors.
More top news
A cooler night to come with possible showers in the northwest by the early hours!
There are calls for more to be done to help refugees and asylum seekers suffering with mental health issues.
We’re looking for people with an inspirational story to tell who’ve really made a difference to others through fundraising efforts.