10 ms·
I'm going to have to dust off some ancient math... I think LLMs are based on neuronal networks which are based on regression models which are based on systems o
by oblio 2y ago
I'm going to have to dust off some ancient math... I think LLMs are based on neuronal networks which are based on regression models which are based on systems of differential equations for which last time I studied this stuff, we only had probabilistic solutions?
It's been a bunch of decades since I did anything even remotely related to these areas (and I was never good at math).
- H8crilA 2y agoCheck out 3blue1brown, they have a series on transformers. Very approacheable. The randomness is very explicit in inference.