I have ADHD and simply engaging in a conversation while driving is enough for me to miss turns, exits, etc. Sure, in the event of an impending crash I might go into the zone and avoid danger, but my general awareness is noticeably impacted.
It seems to be less so for people without ADHD in my experience, but we can't just say it has zero effect. It's better to discuss the threat to safety in terms of potential, since that accounts for individual variance.