5 ms·
Maybe searches just arent that unique and they will cache all but the long tail of answers
by kjkjadksj 4y ago
Maybe searches just arent that unique and they will cache all but the long tail of answers
- altdataseller 4y ago15% of searches are unique according to https://www.seroundtable.com/amp/15-of-search-queries-google-new-30025.html https://www.seroundtable.com/amp/15-of-search-queries-google...
- onlyrealcuzzo 4y agoWhat's the decay? How many searches are only searched 2 and 3 times? I'd question if it's worth it to store the results an AI output for 3 years so that you don't need to regenerate it when someone searches it in the future. For 1 - you're probably going to have a meaningfully better model every year...
- brookst 4y agoYes, there’s a graph of cache duration to hit ratio. With no data or particular domain expertise, I’d bet a 24 hour cache would hit at least 30% of the time, and a 7 day cache 60% of the time. The problem is that a lot of the misses will be for recent events. How do you know whether “how many 737 maxes have crashed” should be served with a cache that is 3 months old?
- deleted 4y ago[deleted]
- conductr 4y agoThis will go up because they're telling everyone to search like this: I need to throw a dinner party for 6 people who are vegetarian. Can you suggest a 3-course menu with a chocolate dessert? As compared to the autocomplete feature which guided people into cached search terms
- seydor 4y agoNot really possible to cache. The model takes as input the entire chat (or some version of personalized history i guess). But it s more likely that bing will discriminate between simple "keyword queries" and elaborate quesitons