3 ms·
I think some patterns would appear.
by archerx 2y ago
I think some patterns would appear.
- Twirrim 2y agoWhy would you expect patterns to appear?
- koolala 2y agoEverything is a different pattern. Noise isn't random - we just call 1 very specific unique pattern of it 'random'.
- archerx 2y agoI was really into Convolutional Neural Networks back in the day and when you visualize the layers you’d get interesting patterns. I’m guessing the same would happen with LLMs but the patterns will be a lot more abstract but still some what recognizable. Here’s an example of visualizing CNN layers; https://www.researchgate.net/figure/Visualization-of-example-features-of-eight-layers-of-a-deep-convolutional-neural_fig2_279068412 https://www.researchgate.net/figure/Visualization-of-example...