2 ms·
Part of what is going on here is that this paradigm is to train a smaller, task-specific model from a large, generalized model. When comparing to other methods
by verdverm 4y ago
Part of what is going on here is that this paradigm is to train a smaller, task-specific model from a large, generalized model. When comparing to other methods for doing this, it outperforms. So one of these smaller, specialized models can outperform PaLM on some tasks, but not all.
The other benefit comes at inference time, where you can get much faster and cheaper outputs.