5 ms·
Are we supposed to assume that the only inputs for this model are the prompts shown? Is GPT-3 already trained on shells somehow?
by vlmutolo 6y ago
Are we supposed to assume that the only inputs for this model are the prompts shown? Is GPT-3 already trained on shells somehow?
- lanternfish 6y agoI think the implication is that it has read a _lot_ of information on the web, I think their training data is (in some part) based on reddit links, and that information is then just passively encoded in the model weights. Some of the information comes from the few-shot examples, at least in terms of what meta-form an 'answer' takes, but I think the implication is that GPT-3 is really just that knowledgeable.
- mromanuk 6y agoHow do they separate bad or malicious commands learned from internet? Like “List all folders” rm -fr * (just a silly example)