3 ms·
It's a relevant question about the economic model for the web. On one hand, the replacement of search with a LLM-based approach threatens the existing, advertis
by btbuildem 2y ago
It's a relevant question about the economic model for the web. On one hand, the replacement of search with a LLM-based approach threatens the existing, advertising-based model. On the other hand, the advertising model has produced so much harm: literally irreparable damage to attention spans, outrage-driven "engagement", and the general enshittification of the internet to mention just a few. I find it a bit hard to imagine whatever succeeds it will be worse for us collectively.
My question is, how to reproduce this level of functionality locally, in a "home lab" type setting. I fully expect the various AI companies to follow the exact same business model as any other VC-funded tech outfit: free service (you're the product) -> paid service (you're still the product) -> paid service with advertising baked in (now you're unabashedly the product).
I fear that with LLM-based offerings, the advertising will be increasingly inseparable, and eventually undetectable, from the actual useful information we seek. I'd like to get a "clean" capsule of the world's compendium of knowledge with this amazing ability to self-reason, before it's truly corrupted.
- fzzzy 2y agoYou need a copy of r1 and enough ram to run it, and a web searching tool, or a rag database with your personal data store.
- btbuildem 1y agoR1 would be the reasoning model - as in, the initial part of the output being the "train of thought" revealed before the "final answer" is provided. I was able to deploy a heavily quantized version of that locally, and run it with RAG (Open Webui in this instance) -- with web search enabled, sure, but it's still a far cry from an actual "research" model that know when and how to seek extra data / information.