3 ms·

Yes, im sure OpenAI, and Google are paying incredibly high salaries to experts who dont know how LLM's work. I'm far from a computer scientist, or mathematician

• branko_d 3y ago
  No one knows how LLMs work in a sense that nobody knows how human brains work. Yes, we know a lot about individual cells, but the complexity that emerges when billions of them get connected is something that we do not understand. There is an argument that we'll never be able to fully understand our brain, because that would require more complex brain, which would make it more difficult to understand, which would require more complex brain etc... Similarly, LLMs have "hidden layer". We know everything about individual "neurons", but we couldn't connect them together ourselves in a way that training somehow does. The network that is the result of that training is "hidden" from our understanding even though its individual nodes are plain to see. Since AI can increase in complexity while human brain can't, there may come a day when AI understands the human brain, without the human brain ever being able to understand AI.