3 ms·
As always you kind of need to play with the model to see how well it actually works as benchmarks can be misleading (e.g. phi-2) But at face value, a new archi
by jasonjmcghee 2y ago
As always you kind of need to play with the model to see how well it actually works as benchmarks can be misleading (e.g. phi-2)
But at face value, a new architectural approach with the same capacity (8b) trained on a dataset 1/6th the tokens, being competitive with llama3-8b is exciting