> Leading researchers are scratching their heads trying to figure out the model. Don't think so? The base model seems like a straightforward improvement over p

> Leading researchers are scratching their heads trying to figure out the model. Don't think so? The base model seems like a straightforward improvement over previous LLMs. They trained it with more parameters (and therefore expense) than anyone else. The collection of training text corpora and reinforcement methods are hard to copy, they take practice and experience. But they aren't very mysterious, as I understand it. > There is a world causality model, they are claiming it has emerged from the LLM but nobody really knows how that solves some of the hard stuff. Again, not mysterious. There is a point during training neural networks where you can see a "circuit" has been created for generalizing a problem. This is visible with very small neural nets. You can name which neurons have specialized in a particular task. When you have hundreds of millions of parameters, this happens more often. It is very difficult for anyone to look inside any neural network and understand how it answers questions, but this is not unique to GPT. > it is an AGI, anyhow you want to cut it I agree it has a world model. But it has no apparent emotional experiences, appears to be unable to experience distress, will say "no" if you ask it whether it might be conscious, does not appear to have any of its own goals (and isn't running when you aren't asking it questions), and fails to reach the correct answer when adding small numbers more often than many children. > the OpenAI team is too small to pull off 1) the vast research 2) productionising it and 3) rolling out a product like to this to millions of users They have been working on it since 2015. The small size of the team is evident in the many outages and security issues it's been experiencing.