3 ms·
This is so weird, why does every user has to use their LLM subscriptions/keys instead of just storing the summarization of the HN posts as a static website some
by mattigames 2y ago
This is so weird, why does every user has to use their LLM subscriptions/keys instead of just storing the summarization of the HN posts as a static website somewhere? (e.g. summarize once for all users)
- t-writescode 2y agoThat costs money to host a server, summarize yourself, etc. While it is possible, such a service would require advertisements, a (probably monthly) fee, or a benevolent patron to pay for the costs. With this, the only necessary benevolence is the creator of the extension.
- rgbrgb 2y agothe server cost is basically nothing since since it's static content. probably fits into free offerings from cloudflare. the summarization is where the cost is and it would be cool to have some crowdsourced contributor model there. smells like a cool crypto/ai crossover project in the making (or maybe drop the crypto and have upvote-driven "moderation").
- deleted 2y ago[deleted]
- mistrial9 2y ago.. because being a threaded extension of some central hub connected to some other central hub is exactly the "vibe" ?
- ivanyu 2y agoWhen I was incubating the idea, I thought about different concepts: 1. The current bring-your-own-key. 2. A central summary storage, filled by me. 3. A central summary storage, crowdsourced. 4. A paid subscription, where I effectively run some LLM proxy. I wanted something low overhead and be just the right size for yet another weekend project which I could drop at any moment. Supporting some infrastructure, having moderation headaches, let alone receiving payments ruled out pretty much everything but the current approach.
- ukuina 2y agoThis is exactly what I built with https://hackyournews.com https://hackyournews.com