4 ms·
> The frontier LLMs were trained on all the code that institutions had been keeping to themselves. Lolz! I haven’t encountered “code that institutions had been
by wiseowise 6mo ago
> The frontier LLMs were trained on all the code that institutions had been keeping to themselves.
Lolz! I haven’t encountered “code that institutions had been keeping to themselves” that got even remotely close to OSS in quality.
- cmrdporcupine 6mo agoThe quality of code inside Google's Google3 repository is more consistently high quality than most of what I see in the Exterior World. But there's no way that Google is releasing a model trained on it. Way too high of a risk of IP leakage.