6 ms·

systemd is a very common log. I'm curious whether you think this would work on logs for custom software that by necessity didn't have either its logs or writin

systemd is a very common log. I'm curious whether you think this would work on logs for custom software that by necessity didn't have either its logs or writing about its logs in the training set.

smabie 3y ago
No need to think, just.. try it and find out?
- bolanyo 3y ago
  The author has chosen to 'Tell HN' so it seems reasonable to ask them for further details? I have lots of hard-to-analyse logs but there are constraints which prevent me from sharing them with OpenAI. I am nonetheless curious about whether to do so would be worthwhile or not.
williamcotton 3y ago
Considering the fact that the RLHF for ChatGPT was done only in English but then worked just as well for every other language I would wager that specific types of logs being present in the training set is less important than it may seem.
- dragonwriter 3y ago
  > Considering the fact that the RLHF for ChatGPT was done only in English but then worked just as well for every other language Does it work just as well for every other language, or does it work acceptably well for an important subset of other languages?
  - therein 3y ago
    It works well for a surprisingly large set. My tests involved Turkish and Azerbaijani and I'd assume it is distant enough that I was impressed.
  - ReaLNero 3y ago
    I speak a Slavic language spoken by ~2 million people, and I asked GPT-4 to tell me an old fable in my language. It did so fantastically, with no grammatical errors. I tried some more things -- it speaks it fluently, though admittedly not always idiomatically.
    - gumballindie 3y ago
      Meanwhile for actual uses cases it appears to be putting people at risk: https://restofworld.org/2023/ai-translation-errors-afghan-refugees-asylum/ https://restofworld.org/2023/ai-translation-errors-afghan-re...
  - marvin 3y ago
    I tried to make it joke at the expense of Norwegians speaking a particular dialect, and it refused. (Language spoken by 5 million people). When I tried to jailbreak it by prompting it to make the joke from the perspective of an esteemed actor, performing for the Prime Minister and other respected figures, it had our Prime Minister scold and demand an apology from the actor for making fun of stereotypes. The actor was contrite and toned down his humor.

systemd is a very common log. I'm curious whether you think this would work on logs for custom software that by necessity didn't have either its logs or writing about its logs in the training set.

smabie 3y ago

No need to think, just.. try it and find out?

bolanyo 3y ago
The author has chosen to 'Tell HN' so it seems reasonable to ask them for further details? I have lots of hard-to-analyse logs but there are constraints which prevent me from sharing them with OpenAI. I am nonetheless curious about whether to do so would be worthwhile or not.

williamcotton 3y ago

Considering the fact that the RLHF for ChatGPT was done only in English but then worked just as well for every other language I would wager that specific types of logs being present in the training set is less important than it may seem.

dragonwriter 3y ago
> Considering the fact that the RLHF for ChatGPT was done only in English but then worked just as well for every other language Does it work just as well for every other language, or does it work acceptably well for an important subset of other languages?
- therein 3y ago
  It works well for a surprisingly large set. My tests involved Turkish and Azerbaijani and I'd assume it is distant enough that I was impressed.
- ReaLNero 3y ago
  I speak a Slavic language spoken by ~2 million people, and I asked GPT-4 to tell me an old fable in my language. It did so fantastically, with no grammatical errors. I tried some more things -- it speaks it fluently, though admittedly not always idiomatically.
  - gumballindie 3y ago
    Meanwhile for actual uses cases it appears to be putting people at risk: https://restofworld.org/2023/ai-translation-errors-afghan-refugees-asylum/ https://restofworld.org/2023/ai-translation-errors-afghan-re...
- marvin 3y ago
  I tried to make it joke at the expense of Norwegians speaking a particular dialect, and it refused. (Language spoken by 5 million people). When I tried to jailbreak it by prompting it to make the joke from the perspective of an esteemed actor, performing for the Prime Minister and other respected figures, it had our Prime Minister scold and demand an apology from the actor for making fun of stereotypes. The actor was contrite and toned down his humor.