3 ms·
>very far from any training data It's not that far from training data surely. If you're only training on next-word basis then you'll "often" see individual wor
by pbhjpbhj 2y ago
>very far from any training data
It's not that far from training data surely. If you're only training on next-word basis then you'll "often" see individual words from other languages mixed in.
It's like some sort of uber-pidgin.
- astrange 2y agoIn a high-dimensional enough space nothing is ever far from anything. nb it doesn't even train on words, just subwords