3 ms·
Just like supermarkets know what products you are buying, LLM inference providers what requests you are making. And just like supermarkets list the most profita
by 29athrowaway 2y ago
Just like supermarkets know what products you are buying, LLM inference providers what requests you are making. And just like supermarkets list the most profitable products and then clone them, LLM inference providers could come up with their own versions of the most profitable products based on LLMs.
My prediction is that the thin layer built on top of LLMs will be eaten up starting from the most profitable products.
By using inference APIs you are doing their market research for free.