3 ms·
`how to build a birdhouse to attract a bluebird` https://ithy.com/article/4b116d2032e54c03862db84e71bcfc8f https://ithy.com/article/4b116d2032e54c03862db84e71b
by sergiotapia 2y ago
`how to build a birdhouse to attract a bluebird`
https://ithy.com/article/4b116d2032e54c03862db84e71bcfc8f https://ithy.com/article/4b116d2032e54c03862db84e71bcfc8f
https://big-agi.com/ https://big-agi.com/ has this "BEAM" concept as well where you can put your message through as many models as you have configured then run fuse/guided/compare/custom to merge them all together into one comprehensive. more expensive response.
https://files.catbox.moe/tr82vs.png https://files.catbox.moe/tr82vs.png
https://files.catbox.moe/beuyfx.png https://files.catbox.moe/beuyfx.png
However Ithy does produce something much much better! This is really cool! I wonder if you could cache questions and answers, and start creating your own "reddit" knowledgebase to RAG from and avoid having to dive deep again $$$.
- wluk 2y agoThanks! Yeah that's an excellent idea - this is my response from another thread: I have a feeling that Perplexity and ChatGPT are doing something similar [caching], since common questions I'd ask like "top movies this year" will be answered nearly-instantaneously, way faster than GPT-4o could have done on its own. The only explanation for this is that so many users ask certain questions, they cache the response and return the cached answer. I'd love to do this for Ithy, but it'll be a while before I get the scale of ChatGPT/Perplexity that's needed for this...
- ricktdotorg 2y agoi started looking into using Cloudflare AI gateways for this exact [caching] reason a few months ago but got distracted with GPU Cloud Run so i never did get decent load/numbers on the AI gateway cache to see if it was worth bothering about