4 ms·
Do you know why these are so short? What is the algorithm/magic in all of these? I tried to make sense of it but cannot
by kureikain 2y ago
Do you know why these are so short? What is the algorithm/magic in all of these?
I tried to make sense of it but cannot
- DavidSJ 2y agoThe magic is in the billions of learned weights (~synapses). This is just the scaffolding that runs them.
- Hugsun 2y agoArchitecturally, LLMs are very simple compared to many software projects. The crux of their behavior comes from their learned weights which are gigabytes and can cost millions to obtain via training.
- chpatrick 2y agoThe magic is the structure of the model, and the real magic is the billions of weights.