Inspectors have warned The Queen Elizabeth Hospital in King's Lynn that it's maternity service is so poor that the safety of patients is at risk.
The Care Quality Commission has rated the hospital as inadequate and says it should be put in special measures.
Accident and emergency and medical care were also inadequate.
The hospital accepts the findings and has apologised to patients they have let down.
The trust was inspected between 4 April and 21 June 2018.
Inspectors highlighted a number of concerns and areas for improvement and the trust is now rated as Inadequate overall.
The trust has been told it must make improvements in a number of areas especially patient care records and mental capacity assessments must be consistently and competently carried out where required.
The hospital has also been told to improve the culture, working relationships and engagement of consultant staff across all services and make sure effective process for managing staff grievances and complaints are in place.