4 ms·

You could use GPT-J (https://huggingface.co/EleutherAI/gpt-j-6b https://huggingface.co/EleutherAI/gpt-j-6b)

by maxilevi 4y ago

danpalmer 4y ago
Just don't let it convince you to "reduce your carbon footprint" like the last guy did.
- tough 4y ago
  Wait is this a reference to the belgian case of someone offing themselves? Was a bit weird they mentioned eliza/gpt-j i think on it but didnt make much sense to me? did that happen or just hallucinated?
  - danpalmer 4y ago
    Yes that's the one. There hasn't been much news coverage so I suspect that it wasn't quite as convincing a case as reported. Still a little worrying though, and even if not accurate, the fact it could be is definitely worrying.
    - tough 4y ago
      We cannot give meaning to tools, guns are much of a shortcut in that regard and nobody bats an eye. Schizo's tried to kill the curl creator because he was in his software everywhere and so spying on them... People is complicated. Let's not buy the bait that can kill wonderful tech, I agree the potential for harm is there, but I wouldn't blame the knive when a junkie stabs you to buy some heroin with what the gets out of you.
      - danpalmer 4y ago
        I don't disagree with you, but it's also important that there is accountability. There is currently little accountability with LLMs. One could argue that the user should be accountable, but that doesn't account for how an LLM is trained. A user should clearly not be held accountable for being harmed if using an LLM maliciously trained to harm users. Most legal systems punish negligence in a position of power, so it stands to reason that the creator of an LLM should bear some responsibility for its behaviour. It is not yet clear to me how accountability should be portioned out to the user, operator, publisher, trainer, and model creator, but my feeling is that all bear at least some responsibility for its use.
dceddia 4y ago
I just ran across a mention of gpt4all in another thread, and it looks like the team is working on training up GPT-J as an open alternative to the Llama-based model: https://github.com/nomic-ai/gpt4all#short-term https://github.com/nomic-ai/gpt4all#short-term
bufo 4y ago
No, there are waaaay better models available these days like Flan (UL2 and the older T5), or Cerebras-GPT.

You could use GPT-J (https://huggingface.co/EleutherAI/gpt-j-6b https://huggingface.co/EleutherAI/gpt-j-6b)

danpalmer 4y ago

Just don't let it convince you to "reduce your carbon footprint" like the last guy did.

tough 4y ago
Wait is this a reference to the belgian case of someone offing themselves? Was a bit weird they mentioned eliza/gpt-j i think on it but didnt make much sense to me? did that happen or just hallucinated?
- danpalmer 4y ago
  Yes that's the one. There hasn't been much news coverage so I suspect that it wasn't quite as convincing a case as reported. Still a little worrying though, and even if not accurate, the fact it could be is definitely worrying.
  - tough 4y ago
    We cannot give meaning to tools, guns are much of a shortcut in that regard and nobody bats an eye. Schizo's tried to kill the curl creator because he was in his software everywhere and so spying on them... People is complicated. Let's not buy the bait that can kill wonderful tech, I agree the potential for harm is there, but I wouldn't blame the knive when a junkie stabs you to buy some heroin with what the gets out of you.
    - danpalmer 4y ago
      I don't disagree with you, but it's also important that there is accountability. There is currently little accountability with LLMs. One could argue that the user should be accountable, but that doesn't account for how an LLM is trained. A user should clearly not be held accountable for being harmed if using an LLM maliciously trained to harm users. Most legal systems punish negligence in a position of power, so it stands to reason that the creator of an LLM should bear some responsibility for its behaviour. It is not yet clear to me how accountability should be portioned out to the user, operator, publisher, trainer, and model creator, but my feeling is that all bear at least some responsibility for its use.

dceddia 4y ago

I just ran across a mention of gpt4all in another thread, and it looks like the team is working on training up GPT-J as an open alternative to the Llama-based model: https://github.com/nomic-ai/gpt4all#short-term https://github.com/nomic-ai/gpt4all#short-term

bufo 4y ago

No, there are waaaay better models available these days like Flan (UL2 and the older T5), or Cerebras-GPT.