4 ms·
The web and connecting to other services is very important for almost all of my use cases. While I believe we are going to get better and faster models, the web
by gizmodo59 2mo ago
The web and connecting to other services is very important for almost all of my use cases. While I believe we are going to get better and faster models, the web index is certainly not downloadable and maintainable for 99.99% of the folks who are able to use local models. Any good solutions exist?
- pbronez 2mo agoThere are many search APIs available, I like Kagi's. Microsoft and Amazon both provide web snapshot services that purport to give you a kind of agent-first internet archive. You can approximate something like that using common crawl, but it's a huge amount of data. Downloading the internet is impossible or a bad idea for almost everyone.
- morgoo 2mo agoIf you're really into self-hosting I've been experimenting with SearXNG and early signs are promising