4 ms·
I'm sorry for being ignorant but how does this work? Is there an LLM underneath? Does it use ChatGPT? If so, how do you maintain the privacy and how are you abl
by wheresmyshadow 2y ago
I'm sorry for being ignorant but how does this work? Is there an LLM underneath? Does it use ChatGPT? If so, how do you maintain the privacy and how are you able to cover expenses? I'm just curious, it looks pretty great though.
- pedrok 2y agoHey! Yeah, it runs on an open-source llama3 image, and since the requests aren’t too wild, it costs me about $2 a month to keep it up. Thanks!
- wheresmyshadow 2y agoI see, thanks for the info! I played with it for a bit and I really enjoy the results. A dark mode would be amazing to have but still great job!
- pedrok 2y agoThank you so much for your feedback!
- android521 2y agoCould you share a bit on where you host it ? it is 8 B ,right?
- pedrok 2y agoHi there, I utilize the Groq/Llama-3-Groq-70B-Tool-Use model. I initially hosted it on Hugging Face for some time, but eventually, I transitioned to using the Groq API directly.