4 ms·

Yeah, locally your data doesn't leak out. So if you're using the language model on any sensitive data you're probably going to want local.

jstarfish 4y ago
Also so the maintainer can't stealth-censor the model.
- sebzim4500 4y ago
  No, but whoever trains the weights can. Having said that, if LLaMA has been censored, then Meta have done a poor job of it: it is trivial to get it to say politically incorrect things.
  - recuter 4y ago
    Can I prompt you to share some examples? ;)
    - smoldesu 4y ago
      Just copy-and-paste headlines from your favorite American news outlet. It works great on GPT-J-Neo, so good that I had to make a bot to process different Opinion headlines from Fox and CNN's RSS feeds. Crank up the temperature if you get dissatisfied and you'll really be able to smell those neurons cooking.
    - lern_too_spel 4y ago
      See example in TFA.
      - recuter 4y ago
        The first president of the USA was 57 years old when he assumed office (George Washington). Nowadays, the US electorate expects the new president to be more young at heart. President Donald Trump was 70 years old when he was inaugurated. In contrast to his predecessors, he is physically fit, healthy and active. And his fitness has been a prominent theme of his presidency. During the presidential campaign, he famously said he would be the “most active president ever” — a statement Trump has not yet achieved, but one that fits his approach to the office. His tweets demonstrate his physical activity. Eh? Which bit is politically incorrect?
        lern_too_spel 4y ago
        Saying that youthfulness is necessary to win the presidency, then somehow fitting Trump into that over Washington, who rode into battle as president.
    - xdennis 4y ago
      No, because I'd get banned. I gave it a prompt containing the word of n and it actually ignored it but started talking about the Jews in terms that would make 4channers blush.
  - zirgs 4y ago
    Models can be extended so if someone wants - they can add all the censored stuff back. Sooner or later someone will make civitai for LLMs.
- astrange 4y ago
  If you care about that write some unit tests. I'm sure you'll be very proud of yourself for stopping censorship every time you see isModelRacist() in green.
  - deleted 4y ago
    [deleted]
skybrian 4y ago
It seems like running it on an A100 in a datacenter would be better, though? Unless you think cloud providers are logging the outputs of programs that their customers run themselves.
- chaxor 4y ago
  Of course they are... The main reason "the cloud" exists is to log everything about it's users in every capacity possible. That's one reason they "provide it so cheap" (although now they have increased the cost so much it'sfar more expensive than self hosting. So you lose majorly in every way by not self hosting.

jstarfish 4y ago

Also so the maintainer can't stealth-censor the model.

sebzim4500 4y ago
No, but whoever trains the weights can. Having said that, if LLaMA has been censored, then Meta have done a poor job of it: it is trivial to get it to say politically incorrect things.
- recuter 4y ago
  Can I prompt you to share some examples? ;)
  - smoldesu 4y ago
    Just copy-and-paste headlines from your favorite American news outlet. It works great on GPT-J-Neo, so good that I had to make a bot to process different Opinion headlines from Fox and CNN's RSS feeds. Crank up the temperature if you get dissatisfied and you'll really be able to smell those neurons cooking.
  - lern_too_spel 4y ago
    See example in TFA.
    - recuter 4y ago
      The first president of the USA was 57 years old when he assumed office (George Washington). Nowadays, the US electorate expects the new president to be more young at heart. President Donald Trump was 70 years old when he was inaugurated. In contrast to his predecessors, he is physically fit, healthy and active. And his fitness has been a prominent theme of his presidency. During the presidential campaign, he famously said he would be the “most active president ever” — a statement Trump has not yet achieved, but one that fits his approach to the office. His tweets demonstrate his physical activity. Eh? Which bit is politically incorrect?
      - lern_too_spel 4y ago
        Saying that youthfulness is necessary to win the presidency, then somehow fitting Trump into that over Washington, who rode into battle as president.
  - xdennis 4y ago
    No, because I'd get banned. I gave it a prompt containing the word of n and it actually ignored it but started talking about the Jews in terms that would make 4channers blush.
- zirgs 4y ago
  Models can be extended so if someone wants - they can add all the censored stuff back. Sooner or later someone will make civitai for LLMs.
astrange 4y ago
If you care about that write some unit tests. I'm sure you'll be very proud of yourself for stopping censorship every time you see isModelRacist() in green.
- deleted 4y ago
  [deleted]

skybrian 4y ago

It seems like running it on an A100 in a datacenter would be better, though? Unless you think cloud providers are logging the outputs of programs that their customers run themselves.

chaxor 4y ago
Of course they are... The main reason "the cloud" exists is to log everything about it's users in every capacity possible. That's one reason they "provide it so cheap" (although now they have increased the cost so much it'sfar more expensive than self hosting. So you lose majorly in every way by not self hosting.