2 ms·
> In principle it could know that something is more commonly cited based on its training data Could it? Without explicit training for that, how would it be exp
by diggan 2y ago
> In principle it could know that something is more commonly cited based on its training data
Could it? Without explicit training for that, how would it be expected to know it has to be able to count occurrences of something?
- sd9 2y agoI think it would be more vibes based - commonly occurring things would be reinforced more in the weights. Rather than it explicitly counting the number of occurrences.
- diggan 2y agoSo the probabilities would be skewed towards something, but unless the model could somehow count/infer its own weights, I don't see how it could "introspect" to see if something is more common than something else.