A thick log or dead deer across the tracks of a high speed train could lead to catastrophe.
I once rode the Eurostar from London to Paris and as I recall all the high speed sections were enclosed in very high, barbed wire fence. So some security is definitely needed. Collision energy goes up with the square of velocity.