3 ms·
I’m guessing they are already doing this. Adding an LLM is asking to add a very expensive thing to the long tail of queries which likely cannot be cached.
by janalsncm 3y ago
I’m guessing they are already doing this. Adding an LLM is asking to add a very expensive thing to the long tail of queries which likely cannot be cached.