I agree. I spent Christmas playing around with the GPT4 API. I quickly discovered many ideas on how to use it. But many of my ideas depended on much lower infe

I agree. I spent Christmas playing around with the GPT4 API. I quickly discovered many ideas on how to use it. But many of my ideas depended on much lower inference cost and much higher context sizes. I equate this problem to the cost of loading a website in 1996 vs 2024. My wild guess is that we are probably in 1997 right now. Therefore, I concluded that not only would LLMs be ubiquitous in the future, I should invest in companies trying to solve the inference cost problem right now.