3 ms·
how do you tolerate the sheer latency of running the "vast majority" of your web searches through an llm
by evertedsphere 1y ago
how do you tolerate the sheer latency of running the "vast majority" of your web searches through an llm
- esseph 1y agoHow many searches previously to find the right question to ask x search time = total_search_time # of searches is lower, total-search_time drops
- criddell 1y agoFor me ChatGPT is great when I don’t really know what I don’t know. I still end up having to do a google search after to verify that the AI result isn’t insane. So for me ChatGPT often is just adding an extra step.
- ChocolateGod 1y agoThe LLM can read through the results quicker than you can and provide the information you were looking for.
- bigstrat2003 1y agoWell, it provides something at any rate. Whether or not it's the information you were looking for is very much a matter of luck.