> Seems like you need to have the money to build part of a fab if you want to buy one, idk who would even consider loaning that amount of money to a third party

Governments are happy to subsidise fabs, and VCs are even happier to invest in AI flavoured semiconductors if you can market it that way.