But it has an impact on your team's ability to deliver value over the long term. Social bonding increases generally increases trust and trust increases willingness to communicate. If I've had multiple positive social experiences with you over time (IE chit-chat), then I'll be more willing to communicate with you about technical issues as well. If you make me uncomfortable and nervous socially, I'm going to wait longer to bring up a possible integration issue or requirements conflict. Over time that is WAY worse then slower deliver of features in isolation.
Different projects and organizations vary, but I've been on teams where a "brillant" but anti-social person left (or was ejected) and seen overall throughput for the team shoot up. And I've seen people brand new to coding (and without much skill in it) still deliver value rapidly because they are relentless communicators. I've stopped valuing the former and started valuing the later.
My ability to feign interest in your baby pictures does not in any way indicate my ability to deliver a sprint task.