3 ms·
Newbie asks: what is a 'parameter' here
by _a_a_a_ 4y ago
Newbie asks: what is a 'parameter' here
- sp332 4y agoOne neuron weight. A single element of a matrix or tensor.
- throwaway1851 4y agoTake y=3x+7. 3 and 7 are parameters, which would be learned by using gradient descent to find the values that make the x’s in the training data produce the corresponding y’s. LLMs are essentially functions like this, only they have billions of parameters and are nonlinear.