3 ms·
> The idea is simple: Give GPT3 a list of items and ask it to return a list of categories those items belong to. 60 seconds to sort 400 tabs is a hell of a pri
by salamo 4y ago
> The idea is simple: Give GPT3 a list of items and ask it to return a list of categories those items belong to.
60 seconds to sort 400 tabs is a hell of a price to pay. It needs to be worth it. Do you really need semantic search? Do you really need semantic search that queries a huge proprietary model?
(A really cool feature that Chrome doesn't have would be the ability to search the content of the webpage as well.)
What about something simpler, both architecturally and computationally. Start with something boring, like BM25. In my experience it works surprisingly well. If that's not good enough, then running a free model from Huggingface would be the next best option.
The benefit of this approach is that you can do it in the browser, in real-time (or at least locally with a downloaded model). Even 400 tabs will be a piece of cake. Plus you won't need to proxy precious API calls to a service which may become unavailable or very expensive with no warning.