3 ms·
We don't understand them. There is a key difference between building something from parts and running gradient descent to automatically find the network connect
by spion 4y ago
We don't understand them. There is a key difference between building something from parts and running gradient descent to automatically find the network connectivity. That difference is that we don't understand the final result at all.
- throwaway290 4y agoWe understand exactly how it works. It just works in such a way that we cannot predict the outcome, which makes it pretty bad for many applications. If you can't explain how it works doesn't mean it's not understood how it works.
- spion 4y agoWe really don't know why LLMs have the most of their emergent capabilities. The entire GPT-3 paper was about being surprised about it.
- throwaway290 4y agoMaybe we don't disagree then. We know how LLM work. Parameters. Training data. Random number generator. That stuff. We don't know why it outputs what it outputs because rngs are notoriously unpredictable and we know it. So we are surprised but that in itself is unsurprising.