3 ms·
> I think we are somewhat still at the “fuzzy super early adopter” stage of this local LLM game and hard data is not going to be easy to come by. What's hard a
by motorest 2y ago
> I think we are somewhat still at the “fuzzy super early adopter” stage of this local LLM game and hard data is not going to be easy to come by.
What's hard about it? You get the hardware, you run the software, you take measurements.
- GTP 2y agoYes, but we don't have enough people doing that to get quality data. Not many people are building this kind of setup, and even less are publishing their results. Additionally, if I just run a test a couple of time and then average the results, this is still far from a solid measurement.
- diggan 2y ago> but we don't have enough people doing that to get quality data But how are we supposed to get enough people doing those things if everyone say "There isn't enough data right now for it to be useful"? We have to start somewhere
- unshavedyak 2y agoI don't think they're saying anything counter to that. The people who don't require the volume of data will run these. Ie the super early adopters.
- colonCapitalDee 2y agoWe've already started, we just haven't finished yet