The Professor has warned Covid-19 incidents remain "really quite high" in England, warning on the easing of restrictions: "We can't lift things very much at all".
Prof Edmunds' concerns join a growing list of expert advisers to the government expressing apprehension about England's easing of lockdown.
As people flocked to beaches and beauty spots in the sunny weather over the weekend, Prof Edmunds was joined by Professor Peter Horby, of the University of Oxford, and Sir Jeremy Farrar to warn that ministers are taking risks.
All three are members of the SAGE committee.
ITV News Political Correspondent Paul Brand explains as the rules become more nuanced, there's concern about people complying with them
Speaking to ITV News, Prof Edmunds said: "I think we are taking a bit of a risk at the moment, there's a couple of things.
"One, the reproduction number is only just below one at the moment, so we don't have a lot of headroom, we can't lift things very much at all."
He continued: "Secondly, the incidents are really quiet high, so the ONS survey we are getting 8000 new infections everyday in England, in just the community, that's not counting cases that may occur in hospitals and care homes, and even other settings such as prisons.
"That's quite a lot of cases, 8,000 everyday."
Prof Edmunds warned, however, that "the track and trace is going to be more effective if the cases are lower."
He added: "I don't think we will have a major second peak, I don’t think the government would ever let that happen, my issue is if we keep the incidents flat."
Deputy chief medical officer for England, Professor Jonathan Van-Tam was quizzed on the comments made by Prof Edmunds and some other SAGE members at Saturday's Downing Street Briefing.
Prof Van-Tam said: "Our science advice has been so far that the social distancing that has already been eased is consistent with keeping the R below one.
"The consensus of scientific advice is that the next set of measures announced for Monday, with contact tracing in place, should also keep the R within one.
"Our advice is then to continue to watch this very carefully and we will continue to give further advice to the government about whether we think it is possible to make further easements after that."
He added that scientific opinions "always vary to some extent".
When asked about the difficulty of asking people to return to a stricter lockdown if the R rate increases, Mr Dowden said the government has been taking "very tentative steps" while "emphasising the need to maintain social distancing."
On Saturday night, Professor Anthony Costello - a former World Health Organisation director - was another scientist to warn about the government's handling of the crisis.
He tweeted the UK could face a "resurgence" of Covid-19.
Prof Edmunds told ITV News, ""The message we are getting from the government seems to be to rush this a little bit, I don't see how we are at the moment taking small steps and taking it incrementally.
"It doesn't seem to me to be like that. It's the combination of taking multiple steps, altogether that worries me."
England's lifting of restrictions goes further than the easing of lockdowns announced in the other three nations.
Coronavirus: Everything you need to know