4 ms·

So is this GPT-4 4 All, or GPT-3 4 ALL?

jb510 4y ago
It was based on GPT 3.5 Turbo, but it just changed to a new model GPT4All-J which is improved from 3.5 turbo, but still small enough to run locally. It’s still it’s a small model compared to GPT4 so can’t imagine to competes head to head with that best.
- bheadmaster 4y ago
  I've tried it, I remember it being more akin to cleverbot than GPT. One thing I love about GPT - context recognition - seems somewhat broken, having model reply with random nonsense unrelated to my prompt each time. I really hope it manages to catch up eventually. In terms of privacy, a local LLM is lightyears ahead of a SaaSS LLM controlled by Microsoft.
  - manyoso 4y ago
    There is a big update released today… maybe give it another go?
    - bheadmaster 4y ago
      What exactly was updated, the model weights, the code, or both? Can I find release notes anywhere? I am a little wary of the opaque installer binary that requires root permission...
      - manyoso 4y ago
        All of the above and the root permission will be fixed jn future release if yuh want to wait
- sbierwagen 4y ago
  It's fine tuned on ChatGPT answers, but the actual underlying model is GPT-J, a 6 billion parameter model. Roughly one twentieth the size of GPT-3, and it's capabilities are about what you'd expect from that number. I installed it, asked a few dozen questions, then uninstalled when I got garbled nonsense in response. (Not just wrong answers, but incoherent noise, repeating chunks of training prompts back to me unrelated to the question, random python code, etc)
  - manyoso 4y ago
    Did you try the new version released today? The initial version had a bad bug that is now fixed with drastically better performance. Many users are reporting some quite high quality responses on discord. Check it out! Link on the homepage…
    - Zetobal 4y ago
      For smaller projects like this the discord servers are usually nothing more than an enthusiastic group gaslighting itself.

It was based on GPT 3.5 Turbo, but it just changed to a new model GPT4All-J which is improved from 3.5 turbo, but still small enough to run locally. It’s still it’s a small model compared to GPT4 so can’t imagine to competes head to head with that best.

bheadmaster 4y ago
I've tried it, I remember it being more akin to cleverbot than GPT. One thing I love about GPT - context recognition - seems somewhat broken, having model reply with random nonsense unrelated to my prompt each time. I really hope it manages to catch up eventually. In terms of privacy, a local LLM is lightyears ahead of a SaaSS LLM controlled by Microsoft.
- manyoso 4y ago
  There is a big update released today… maybe give it another go?
  - bheadmaster 4y ago
    What exactly was updated, the model weights, the code, or both? Can I find release notes anywhere? I am a little wary of the opaque installer binary that requires root permission...
    - manyoso 4y ago
      All of the above and the root permission will be fixed jn future release if yuh want to wait
sbierwagen 4y ago
It's fine tuned on ChatGPT answers, but the actual underlying model is GPT-J, a 6 billion parameter model. Roughly one twentieth the size of GPT-3, and it's capabilities are about what you'd expect from that number. I installed it, asked a few dozen questions, then uninstalled when I got garbled nonsense in response. (Not just wrong answers, but incoherent noise, repeating chunks of training prompts back to me unrelated to the question, random python code, etc)
- manyoso 4y ago
  Did you try the new version released today? The initial version had a bad bug that is now fixed with drastically better performance. Many users are reporting some quite high quality responses on discord. Check it out! Link on the homepage…
  - Zetobal 4y ago
    For smaller projects like this the discord servers are usually nothing more than an enthusiastic group gaslighting itself.