3 ms·
At the risk of torturing this analogy beyond recognition, it’s more like having an 8 core CPU but with a weak 150W PSU such that you can only run one core at a
by zarzavat 3y ago
At the risk of torturing this analogy beyond recognition, it’s more like having an 8 core CPU but with a weak 150W PSU such that you can only run one core at a time.
- SecretDreams 3y agoAnalogy sufficiently tortured
- bee_rider 3y agoIs each core specialized to some particular type of task or something like that? Which would make this less silly of an idea.
- swyx 3y agoin my understanding with an 8 way MoE youre still running all 8 for every request. only if you’re making a router model then itd be the “weak PSU” analogy. and even then a sufficiently perfect router would essentially have to know enough about its routes to almost simulate them which idk if i can believe works