3 ms·
These things go in and out of fashion. Now it's LLMs' turn to have their fifteen minutes. I think one reason why Bayesian models have not taken off is that rep
by esafak 3y ago
These things go in and out of fashion. Now it's LLMs' turn to have their fifteen minutes.
I think one reason why Bayesian models have not taken off is that representing prediction uncertainty comes at the expense of accuracy, for a given model size. People prefer to devote model capacity to reducing the bias rather than modeling uncertainty.
Bayesian models make more sense in the small-data regime, where uncertainty looms large.