3 ms·
I’ve been suspicious that there was a “translate it to English” instructions in the system for other parts of the app. When generating Korean text, GPT4 has a h
by rickcarlino 3y ago
I’ve been suspicious that there was a “translate it to English” instructions in the system for other parts of the app. When generating Korean text, GPT4 has a habit of using “you” and “she” (당신/그녀) in the output, which are rarely used in Korean.
- famouswaffles 3y agoThere wouldn't be that kind of instruction for text generation in other languages because that's thing LLMs trained on other languages do natively. Unnatural responses are probably the result of English only rlhf and maybe limited training corpus. at least, asking for natural responses seem to work.
- rickcarlino 3y agoInteresting. Asking for natural responses seems to help to some extent. I have noticed that I can improve my prompts by appending “then re-write it so it sounds like a Korean native speaker”.