3 ms·
Neural network based compression algorithms[1] are a thing, so I believe Ted Chiang's assessment is right. Memorization (albeit lossy) is also how the human bra
by supriyo-biswas 4y ago
Neural network based compression algorithms[1] are a thing, so I believe Ted Chiang's assessment is right. Memorization (albeit lossy) is also how the human brain works and develops reasoning[2].
[1] https://bellard.org/nncp/ https://bellard.org/nncp/
[2] https://www.pearlleff.com/in-praise-of-memorization https://www.pearlleff.com/in-praise-of-memorization
- brookst 4y agoThe fact that some neural network architectures can compress data does not mean that data compression is the only thing any neural network can do. It’s like saying that GPUs can render games, so GPT is a game because it uses GPU.