3 ms·
The cost angle is interesting, I'm not close enough to the industry to say for sure. But from what I'm reading inference and tokens are only getting cheaper. R
by rco8786 1y ago
The cost angle is interesting, I'm not close enough to the industry to say for sure. But from what I'm reading inference and tokens are only getting cheaper.
Regarding usage - I don't think LLMs are going away. I think LLMs are going to be what finally topples Google search. Even my less technical friends and acquaintances are frequently reaching for ChatGPT for things they would have Googled in the past.
I also think we'll see the equivalent of Google Adwords start to pop up in free consumer LLMs.