2 ms·
I'm not so sold the LLM is an LLM without a sampler but it's not worth quibbling over. It's part of the statistical model anyways.
by 2ndorderthought 6mo ago
I'm not so sold the LLM is an LLM without a sampler but it's not worth quibbling over. It's part of the statistical model anyways.
- vrighter 6mo agothe llm is the trained part, the rest is the handwritten part. The sampler is handwritten, not learned.
- 2ndorderthought 6mo agoBelieve it or not in statistics and machine learning the hard coded parts of a model that impact the results are considered part of the model. But I understand that now days we don't care about these things because ai goes brrr.