3 ms·
Not to seem sarcastic, but 500 randomly selected primes doesn't change my mind. I read the paper, and dumbed it down to dogs and cats. Do you really feel like
by blobbers 3y ago
Not to seem sarcastic, but 500 randomly selected primes doesn't change my mind. I read the paper, and dumbed it down to dogs and cats.
Do you really feel like the efforts were significant or meaningful?
- ineedasername 3y ago>I read the paper, and dumbed it down to dogs and cats. I could read the Pricicipia, or anything, and dumb it down to dogs and cats, but that reduction to the dumb would be a failing all my own. As for the test-- a classification task benchmarked with 500 examples is a fairly decent test of a system's capabilities, be it LLM or a traditional machine learning model. And again, this was only one of a variety of tasks. While it's certainly no Principia, I don't know how you get from there to dogs and cats, nor have you explained your reasoning on how you found the path between the two.
- blobbers 3y agoWell, for starters, you take a model with 100 trillion parameters, and then you test it with... 500 examples. WAIT did you say hundred? 500 hundred? Not 500 hundred thousand right? Okay okay hold on back to the drawing board. ...dumbed down to cats and dogs.
- ineedasername 3y agoThis is simply not the way such models work and your jump from the LLM’s parameter count in its own training to testing its capabilities in a classification task is a non sequitur. …Principia and failings