3 ms·
You're conflating the "code" of an LLM which is just basic calculus with the vast data, fine tuning, human confirmation and filtering that make these things wor
by sirsinsalot 4y ago
You're conflating the "code" of an LLM which is just basic calculus with the vast data, fine tuning, human confirmation and filtering that make these things work.
You're also conflating the downloading and fine tuning of pretrained models with the creation of foundational models.
AI can iterate on model architecture all it wants, that's really 10% of the solution.
- SanderNL 4y agoNo, I mean basic development of all kind - not just AI directly - is sped up. The fact that downloading and finetuning models is the only hard part of these systems is a testament to how frigging far along we came. We forgot just how hard software development and compute in general was just a short time ago.
- sirsinsalot 4y agoYeah I agree with this, and at the same time people's expectations grow to meet the capability. I remember when writing some C to do some basic network IO felt like witchcraft.