3 ms·
Isn't repetition essentially a way of adding weight? If you could increase the inherent weight of Wikidata, wouldn't that provide the same effect?
by rcfox 3y ago
Isn't repetition essentially a way of adding weight? If you could increase the inherent weight of Wikidata, wouldn't that provide the same effect?
- NovemberWhiskey 3y agoIf you want to increase the likelihood that answers will read like Wikipedia entries, sure.
- brandonasuncion 3y agoIs it possible to finetune an LLM on the factual content without altering its linguistic characteristics? With Stable Diffusion, you're able to use LoRAs to introduce specific characters, objects, concepts, etc. while maintaining the same visual qualities of the base model. Why can't something similar be done with an LLM?