3 ms·
I don't think it's necessarily about the parameter count, but the amount of training material about the Bible relative to the rest of the training material, wit
by Sabinus 2y ago
I don't think it's necessarily about the parameter count, but the amount of training material about the Bible relative to the rest of the training material, with higher parameter models able to retain more Bible information with a higher proportion of training on other topics.
- ChuckMcM 2y agoI would be interested to hear your thoughts on what a parameter in an LLM model represents.