i dont believe this for a second. Inference margins are huge, if they stopped R&D tomorrow they would be making an incredible amount of money, but they cant stop investing because they have competitors.
I don't know if the site is just broken for me at the moment, but this has used to track how much people were costing the companies (based on tokens per $ if I remember correctly): https://www.viberank.app/
Plenty of people are to blow through resources pretty quickly, especially when you have non-deterministic output and have to hit "retry" a few times, or back-and-forth with the model until you get what you want, whereby each request adds to total tokens used in the interaction.
AI companies have been trying to clamp down but so far unsuccessful, and it may never be completely possible without alienating all of their users.
This is unrelated to the original assertion: "If they charged users what it actually costs to run their service, almost nobody would use it."
5 million paying customers on 800 million overall active users is an absolutely abysmal conversion rate. And that's counting the bulk deals with extreme discounts (like 2.50 USD/month/seat) which can only be profitable if a significant number of those seats never use ChatGPT at all.
its all pretty simple