4 ms·
I've been playing a lot with Llama 2 13B recently, and it's really not bad at all. With oobabooga[1] you get a proper UI for it and even get an OpenAI-compatibl
by pocketarc 3y ago
I've been playing a lot with Llama 2 13B recently, and it's really not bad at all. With oobabooga[1] you get a proper UI for it and even get an OpenAI-compatible API, so you just change the endpoint in your OpenAI library and it all works. I've been using that to test changes to my bots.
As another poster mentioned though, it's nowhere near the level of GPT-4. It's close enough to GPT 3.5 though, you should try it out!
[1]: https://github.com/oobabooga/text-generation-webui https://github.com/oobabooga/text-generation-webui
- tmikaeld 3y agoThanks, I've had oogabooga bookmarked for a while, it's time!