4 ms·
>If an LLM is often going to be wrong anyway, then being able to try prompts quickly and then iterate on those prompts, could possibly be more valuable than a s
by 34679 1y ago
>If an LLM is often going to be wrong anyway, then being able to try prompts quickly and then iterate on those prompts, could possibly be more valuable than a slow higher quality output.
Before MoE was a thing, I built what I called the Dictator, which was one strong model working with many weaker ones to achieve a similar result as MoE, but all the Dictator ever got was Garbage In, so guess what came out?
- LinXitoW 1y agoSounds more like a Mixture of Idiots.
- _kb 1y agoYou just need to scale out more. As you approach infinite monkeys, sorry - models, you'll surely get the result you need.
- dingnuts 1y agowhy's this guy getting downvoted? SamA says we need a Dyson Sphere made of GPUs surrounding the solar system and people take it seriously but this guy takes a little piss out of that attitude and he's downvoted? this site is the fucking worst
- kelnos 1y agoMaybe because this site is full of people with differing opinions and stances on things, and react differently to what people say and do? Not sure who was taking SamA seriously about that; personally I think he's a ridiculous blowhard, and statements like that just reinforce that view for me. Please don't make generalizations about HN's visitors'/commenters' attitudes on things. They're never generally correct.
- charcircuit 1y agoThat doesn't seem similar to MoE at all.
- 34679 1y agoWell, I really didn't provide sufficient detail to make that determination either way.