3 ms·
It should be called something else, maybe Ensemble? It doesn't fuse anything.
by genxy 4mo ago
It should be called something else, maybe Ensemble? It doesn't fuse anything.
- andai 4mo agoYeah the Rio thing is a better candidate for that word, where they averaged the weights for two models: https://news.ycombinator.com/item?id=48528371 https://news.ycombinator.com/item?id=48528371
- all2 4mo agoEnsemble or 'mixture of experts' (before MoE model architecture was a thing).
- genxy 4mo agoThe good names all get applied to the wrong things. It would be awesome if we could stop every couple years and define in-domain terms we can all agree on. Like how hallucination has won out over confabulation. The precise and accurate definition almost never wins out. :(