2 ms·
How does this work for RAG? Do they make it so the model doesn’t have that fact in their weights or do they make it not talk about it when it is included in con
by seanmcdirmid 3mo ago
How does this work for RAG? Do they make it so the model doesn’t have that fact in their weights or do they make it not talk about it when it is included in context.
Ironically, Chinese models have the most uncensored versions available for download. Fairly sure they own the porn market.
- nostrebored 3mo agoIt’s in the weights. Context needs to be attended to to create a response, and the weights dictate what response is decoded. If you include retrieved context that has an American perspective, I imagine the think trace has some reconciliation about how they must be incorrect.