4 ms·

It was based on GPT 3.5 Turbo, but it just changed to a new model GPT4All-J which is improved from 3.5 turbo, but still small enough to run locally. It’s still

by jb510 3y ago

It was based on GPT 3.5 Turbo, but it just changed to a new model GPT4All-J which is improved from 3.5 turbo, but still small enough to run locally. It’s still it’s a small model compared to GPT4 so can’t imagine to competes head to head with that best.

bheadmaster 3y ago
I've tried it, I remember it being more akin to cleverbot than GPT. One thing I love about GPT - context recognition - seems somewhat broken, having model reply with random nonsense unrelated to my prompt each time. I really hope it manages to catch up eventually. In terms of privacy, a local LLM is lightyears ahead of a SaaSS LLM controlled by Microsoft.
- manyoso 3y ago
  There is a big update released today… maybe give it another go?
  - bheadmaster 3y ago
    What exactly was updated, the model weights, the code, or both? Can I find release notes anywhere? I am a little wary of the opaque installer binary that requires root permission...
    - manyoso 3y ago
      All of the above and the root permission will be fixed jn future release if yuh want to wait
sbierwagen 3y ago
It's fine tuned on ChatGPT answers, but the actual underlying model is GPT-J, a 6 billion parameter model. Roughly one twentieth the size of GPT-3, and it's capabilities are about what you'd expect from that number. I installed it, asked a few dozen questions, then uninstalled when I got garbled nonsense in response. (Not just wrong answers, but incoherent noise, repeating chunks of training prompts back to me unrelated to the question, random python code, etc)
- manyoso 3y ago
  Did you try the new version released today? The initial version had a bad bug that is now fixed with drastically better performance. Many users are reporting some quite high quality responses on discord. Check it out! Link on the homepage…
  - Zetobal 3y ago
    For smaller projects like this the discord servers are usually nothing more than an enthusiastic group gaslighting itself.

by jb510 3y ago

bheadmaster 3y ago

I've tried it, I remember it being more akin to cleverbot than GPT. One thing I love about GPT - context recognition - seems somewhat broken, having model reply with random nonsense unrelated to my prompt each time. I really hope it manages to catch up eventually. In terms of privacy, a local LLM is lightyears ahead of a SaaSS LLM controlled by Microsoft.

manyoso 3y ago
There is a big update released today… maybe give it another go?
- bheadmaster 3y ago
  What exactly was updated, the model weights, the code, or both? Can I find release notes anywhere? I am a little wary of the opaque installer binary that requires root permission...
  - manyoso 3y ago
    All of the above and the root permission will be fixed jn future release if yuh want to wait

sbierwagen 3y ago

It's fine tuned on ChatGPT answers, but the actual underlying model is GPT-J, a 6 billion parameter model. Roughly one twentieth the size of GPT-3, and it's capabilities are about what you'd expect from that number. I installed it, asked a few dozen questions, then uninstalled when I got garbled nonsense in response. (Not just wrong answers, but incoherent noise, repeating chunks of training prompts back to me unrelated to the question, random python code, etc)

manyoso 3y ago
Did you try the new version released today? The initial version had a bad bug that is now fixed with drastically better performance. Many users are reporting some quite high quality responses on discord. Check it out! Link on the homepage…
- Zetobal 3y ago
  For smaller projects like this the discord servers are usually nothing more than an enthusiastic group gaslighting itself.