> To me it shows how fundamental language is to intelligence. I believe most human intelligence is based on language. We are smart because language gives us th

> To me it shows how fundamental language is to intelligence. I believe most human intelligence is based on language. We are smart because language gives us the keys to solving all sorts of situations based on the experience of prior generations. We are wondering if GPT architecture can generate real understanding, but forgetting the training corpus. The language corpus is the real magic here. The source and accumulation point of intelligence. Take a baby and give it access to language, you get a modern human. Take a random init neural net, use language corpus for training, you get GPT4. It doesn't matter what the model is - brain or transformer, it doesn't matter if it's a transformer or just a RNN (RWKV). What matters is the training signal. We should not get so hung up on the model architecture and substrate when thinking about LLM capabilities. Language is a separate evolutionary system of ideas and concepts. It is a self replicator, like DNA. Language just got a new pathway for self replication with LLMs. Every new token visits the whole model and by extension the distillation of our culture before being emitted.