2 ms·
> But the core of the product, the LLM generated answers, can't get much better without an order of magnitude increase in training data. There's no reason to b
by astrange 4y ago
> But the core of the product, the LLM generated answers, can't get much better without an order of magnitude increase in training data.
There's no reason to believe this. The model architecture and training methods aren't perfect, nor is the way it's queried.
eg: https://www.reddit.com/r/MachineLearning/comments/zr2en7/r_nonparametric_masked_language_modeling_metaai/ https://www.reddit.com/r/MachineLearning/comments/zr2en7/r_n...