3 ms·
What would be the result if the task was given to multiple models? Instead of alloying them together and switching between models in the same chat, just let the
by stingraycharles 1y ago
What would be the result if the task was given to multiple models? Instead of alloying them together and switching between models in the same chat, just let the models try to complete the task in their own isolated context, and use the result that completed it successfully?
I would say that that’s at least something the alloying should be benchmarked against, which I didn’t find in the article.
- pama 1y agoRead till the end—what you ask is the last table.
- stingraycharles 1y agoAh damn, I really missed that. That’s super interesting, that the alloying actually performs better! I guess it’s the same as people working in a team rather than individually?
- BoiledCabbage 1y agoIt's not a team vs individually, it's specifically a team/duo with similar or same model vs a team/duo with different models. The benefit is seen by having the models be different. Each finds unique things and enhances the other.
- stingraycharles 1y agoSo it’s more like pair programming, switching turns after each iteration.
- mlboss 1y agoYeah its like a team where the task is switched between developers. In the end everybody provides different point of view to the problem and the whole team learns about the codebase.