If only there was some happy middle ground between never asking and always asking ...
I'd be totally fine with default-on voip sound - with a red, muted mic button and a bubble saying 'tap to unmute'.