2 ms·
> This is unfortunately non-trivial to quantitatively evaluate the performance against ChatGPT :-( Compare using the loss function?
by amelius 4y ago
> This is unfortunately non-trivial to quantitatively evaluate the performance against ChatGPT :-(
Compare using the loss function?
- junrushao1994 4y agoIn LLM world, loss or perplexity may not be the best indicator of model performance :-( Perhaps HELM (https://crfm.stanford.edu/helm/latest/ https://crfm.stanford.edu/helm/latest/) but we didn't take deeper look as we are not the developers of this model