Yeah, this is the most annoying thing for me too. They have an endless stream of recommendations if you go to www.youtube.com/feed/recommended , so why not put it in the main page?

I can only assume that it's an intentional marketing thing to get people to watch other things.