3 ms·
These are the four main problems with LLMs (and related technologies) as I see them: 1. You can't tune them to your needs; they have restraining bolts and th
by kbolino 2y ago
These are the four main problems with LLMs (and related technologies) as I see them:
1. You can't tune them to your needs; they have restraining bolts and the training data is a generic corpus
2. You don't own your interactions with them; your data transits a network and is processed by third-party servers
3. They waste an immense amount of power relative to the usefulness of their output
4. Their responses tend toward uncanny simulacra and hallucination
Bringing the cost way down and making them trainable on consumer hardware solves or at least greatly alleviates problems 1-3. That just leaves problem 4, which might still be unsolvable and sink the whole endeavor, but at least can be focused on.
- whatshisface 2y agoIn many cases the solution to 4 is also to make them faster, because many tasks are checkable.