3 ms·
With four parameters I can fit an elephant, and with five I can make him wiggle his trunk so there is still room for improvement.
by measurablefunc 6mo ago
With four parameters I can fit an elephant, and with five I can make him wiggle his trunk so there is still room for improvement.
- esafak 6mo agoExcept learning to reason is a far cry from curve fitting. Our brains have more than five parameters.
- est 6mo agoreasoning capability might just be some specific combinations of mirror neurons. even some advanced math usually evolves applying patterns found elsewhere into new topics
- ekuck 6mo agospeak for yourself!
- voxelghost 6mo agoAfter a quick content browse, my understanding is this is more like with a very compressed diff vector, applied to a multi billion parameter model, the models could be 'retrained' to reason (score) better on a specific topic , e.g. math was used in the paper
- measurablefunc 6mo agoI agree, I don't think gradient descent is going to work in the long run for the kind of luxurious & automated communist utopia the technocrats are promising everyone.
- sdenton4 6mo agoIt's the statistics equivalent of 'no one needs more than 640kb of RAM'
- nativeit 6mo agoMy very first PC was a Packard Bell with 640KB of RAM. If I’d known, I’d have saved all my RAM for retirement…
- deleted 6mo ago[deleted]