4 ms·
I don’t trust any report of model performance from papers, unless there is a publicly accessible demo. It is way too easy to test things the model has trained
by RcouF1uZ4gsC 4y ago
I don’t trust any report of model performance from papers, unless there is a publicly accessible demo. It is way too easy to test things the model has trained on and for the model to then completely fall flat when used by people in the real world.
- nwoli 4y agoThe fb galactica model is a good example of this. Sounded really promising, impressive paper, lots of weights. But when you actually tried it it mostly produced garbage