2 ms·
https://en.wikipedia.org/wiki/TD-Gammon https://en.wikipedia.org/wiki/TD-Gammon
by grumpopotamus 1y ago
https://en.wikipedia.org/wiki/TD-Gammon https://en.wikipedia.org/wiki/TD-Gammon
- Y_Y 1y agoYou raise a really interesting point. I'm sure it's just missed my notice, but I'm not familiar with any projects from antediluvian AI that have been resurrected to run on modern hardware and see where they'd really asymptote if they'd had the compute they deserved.
- FeepingCreature 1y agoTo be fair, usually those projects would need considerable work to be ported to modern multicore machines, let alone GPUs.
- genewitch 1y agocan you name a couple so i can see how much work is involved? markov chains compile fast and respond fast, sure, and neural nets train pretty quick too, so i'm wondering where the cutoff is; expert systems?
- FeepingCreature 1y agoOh I have no idea, sorry if I gave the impression I have special knowledge here. I'm just deriving this from consumer multicore systems being historically rare and GPGPUs being nonexistant.
- rsfern 1y agoThis paper “were RNNs all we needed?” explores this hypothesis a bit, finding that some pre-transformer sequence models can match transformers when trained at appropriate scale. Though they did have to make some modifications to unlock more parallelism https://arxiv.org/abs/2410.01201 https://arxiv.org/abs/2410.01201
- zahlman 1y agoFor that matter, https://gist.github.com/deebs67/8fbcf8b127a63e70d4a3f8590c97701d https://gist.github.com/deebs67/8fbcf8b127a63e70d4a3f8590c97... .