3 ms·
>> Reducing the cross entropy between predicted and target distributions is the entire purpose of training. Nope. Test distribution. Not target distribution.
by YeGoblynQueenne 3y ago
>> Reducing the cross entropy between predicted and target distributions is the entire purpose of training.
Nope. Test distribution. Not target distribution.
- janalsncm 3y agoI’m not sure why you felt the need to correct me. Target is the correct terminology. As a sanity check I even looked up the PyTorch doc which explicitly uses “target” in their example. https://pytorch.org/docs/stable/generated/torch.nn.CrossEntropyLoss.html https://pytorch.org/docs/stable/generated/torch.nn.CrossEntr...
- YeGoblynQueenne 3y agoBecause the target distribution is not known, whatever PyTorch docs say. The test distribution is known and nobody knows what's its relation to the target distribution except a hope and a prayer.