2 ms·
Large language models will probably never be reliable computers. The solution is either providing translation examples (aka, in-context learning, few-shot) or f
by williamcotton 4y ago
Large language models will probably never be reliable computers. The solution is either providing translation examples (aka, in-context learning, few-shot) or fine tuning a model to return some symbolic method to tell an associated computing environment to evaluate a given bit of math or code.
- barking_biscuit 4y agoIn many ways this is sort of what humans do. They have something they don't yet know how to do and they go away and learn how to do it.
- williamcotton 4y agoIt definitely feels like I have to work to maintain the state of each algorithmic step when I'm multiplying two three digit numbers in my head. It's a lot easier if I can maintain that state on a piece of paper. I'm definitely not calculating the path of a projectile in a similar manner when I catch a ball. I'm definitely not "computing" a sentence when I read it in the same way that I compute the multiplication of those two three digit numbers!
- barking_biscuit 4y ago>I'm definitely not calculating the path of a projectile in a similar manner when I catch a ball. You're not calculating it in a traditional sense, but there's definitely some systems of partial differential equations being solved in real-time.