4 ms·
This article doesn't mention the Hutter Prize of course, since it was started a year later, but it looks like Matt has written about it since then: http://mattm
by sbierwagen 4y ago
This article doesn't mention the Hutter Prize of course, since it was started a year later, but it looks like Matt has written about it since then: http://mattmahoney.net/dc/rationale.html http://mattmahoney.net/dc/rationale.html
Right now the biggest thing holding Hutter Prize back is the shamefully low compute and memory limits: "Restrictions: Must run in ≲50 hours using a single CPU core and <10GB RAM and <100GB HDD on our test machine." http://prize.hutter1.net/ http://prize.hutter1.net/
To even begin approaching intelligence, the compute and memory limits probably need to be 100x or 1000x larger.
- fxtentacle 4y agoStrong disagree. In a completely unrelated field, I'm seeing pretty great results with knowledge distillation to generate AI language models that fit into 20 mio float16 parameters (40MB) and can process 1GB of raw text in roughly 12 hours.
- janekm 4y ago12 hours on a single CPU core, or on a GPU?
- fxtentacle 4y ago12 hours on a Ryzen 5900X with 12 cores. So not quite fast enough yet, but only 3x too slow.