2 ms·
> the pace is not "overwhelming". You just started paying attention to it. I've been paying some attention since 2015 when I worked a neural net gig. And the p
by UncleOxidant 4y ago
> the pace is not "overwhelming". You just started paying attention to it.
I've been paying some attention since 2015 when I worked a neural net gig. And the pace does seem to be increasing. Just in a small corner of LLMs we see LLaMa and then alpaca and then the LORA fine tuned version of the LLaMa params and then the various effects of different levels of quantization - allowing some of these models to run on things like RPis. More people are working on this stuff now meaning that the pace is going faster. Yeah, most of it is incremental, but that doesn't mean that it isn't difficult to keep up with where the best results are being found.