4 ms·
Especially the OPT models they study here were known to be undertrained. It would be interesting to compare to a more modern model like llama 2.
by Legend2440 3y ago
Especially the OPT models they study here were known to be undertrained. It would be interesting to compare to a more modern model like llama 2.