4 ms·
It's not a local model. It queries some endpoint on someone else's computer.
by ok123456 3y ago
It's not a local model. It queries some endpoint on someone else's computer.
- toomuchtodo 3y agoNot local yet. Considering the LLM/generative AI velocity we’ve seen, it’s only a matter of time. It’s helpful to see what others build, providing signal it can be built. If you’re not comfortable using it in your workflow, consider it a peek at what’s to come. Very exciting times. And it's open source.
- shishirpatil 3y agoYes indeed. The models are too computationally expensive to run locally (7.5Billion parameters). Though you could in-principle swap in any local model.
- Tostino 3y agoWhat are you talking about? 7b parameter models run insanely fast if you can offload to gpu, and are entirely reasonable speed if CPU only.
- kajecounterhack 3y agoDo y'all have plans to release the model for those who have 16gb graphics cards? (I'm assuming the model is fp16?)
- f0e4c2f7 3y agoDoes it prompt for an API key?
- shishirpatil 3y agoNope. No API key needed since we mostly serve our own Gorilla models.
- ororroro 3y agohttps://huggingface.co/gorilla-llm https://huggingface.co/gorilla-llm
- bfung 3y agoYep, some google cloud server: SERVER_URL = "http://34.135.112.197:8000"
- deleted 3y ago[deleted]