This is the kind of thinking that CBT addresses.

Of course lowering your stress level is always a valid response, if possible.

But it is possible to handle even very stressful situations without damaging yourself with anxiety and depression. These are skills you can build up, and are very useful to have.