It's over recent Census results, which showed a decline in the number of Welsh speakers.
The Welsh Government say the building remains open to staff and visitors as usual.
Cymdeithas are holding a peaceful protest at one of the entrances at the Welsh Government offices in Cardiff. The main reception remains open as usual to all staff and visitors.
More top news
As the RAF celebrates 100 years, we'll be meeting some of the staff who bring the base at Valley on Anglesey to life!
A pilot project in north Wales is already seeing positive results says the ambulance service. It aims to reduce A&E admissions.
The former Wigan and Great Britain rugby league star previously enjoyed a successful club coaching career with Wasps.