But this is only because you are now out of a sudden in such a situation. If you knew it was like this for ever and its up to you how much human contact you still get you can team up with some friends (or collegues that you especially like) instead of those collegues you got randomly assigned to. I have this that while my contract is running out right now and I am ready to work on something new, I kind of know that I will miss my old collegues and while I will certainly get to like new ones as well, there is something to it to keep up you old team for longer.

Or to put it short: Why do I have to switch my lunch group, just because I switch the employer. Remote does not mean you have to stay alone or with family all day.