4 ms·
Evaluation tools can be trivially inverted to create a finetuned model which excels at malware creation. Meta's stance on LLMs seems to be to empower model dev
by MacsHeadroom 3y ago
Evaluation tools can be trivially inverted to create a finetuned model which excels at malware creation.
Meta's stance on LLMs seems to be to empower model developers to create models for diverse usecases. Despite the safety biased wording on this particular page, their base LLMs are not censored in any way and these purple tools simply enable greater control over finetuning in either direction (more "safe" OR less "safe").
- suslik 3y agoI never ran llama2 myself, but I read many times it is heavily censored.
- MacsHeadroom 3y agoThe official chat finetuned version is censored, the base model is not. The base model is what everyone uses to create their own finetunes, like OpenHermes, Wizard, etc.
- rightbyte 3y agoMalware creation? How is malware distinct from software in general from the LLMs perspective? Like, any software that has some integrated update over the internet feature is potential malware.