Earlier problems on the C2C line between London and Southend have now cleared.
More top news
Two members of the public were injured along with two police officers who were in the unmarked vehicle.
Scotland Yard recorded 1,235 Islamophobic attacks in the last 12 months, compared with 811 in 2015.
Officers say the child, aged two, was targeted in the Lewisham Shopping Centre.