3 ms·
Depends on the training? If there was eg RLHF then those connections are stronger and more likely; that's a difference (but not a category difference).
by pbhjpbhj 1y ago
Depends on the training? If there was eg RLHF then those connections are stronger and more likely; that's a difference (but not a category difference).
- 0x457 1y agoYes, but I thought we're talking about category difference. Proper RLHF surely boosts "predicted next token until it couldn't" to feel more like "actually recalled".