how should the cost decrease because more companies are using it. The AI itself has a fixed demand of computational ressources, that are with respect to Chat GPT ridicously big. As a normal company you cannot even get instances at AWS to deploy this model yourself, and the biggest instance offered there costs 15k$/hour. (but has just 1/4 of the VRAM needed). So every company has to deal with these high costs, if they do not get their money back with a business model on top of the model, there is no way to lower the prices.

That is also why using a chat bot as a search engine makes no business sense for Google and Microsoft. They get the money from the websites by bringing users to the website and displaying ads. If they already return a somewhat reasonable answer, nobody will enter the websites --> no money for Google and Microsoft through ads etc.