That can actually turn into a good thing. When you're not facing the other person, you should become better and better at communicating what exactly is the issue. At the very worse this leaves a paper trail that can indicate "see I worked on this"