3 ms·
It runs a model with 260K params, so hardly a "Large" LM. Nevertheless, a cool project.
by oac 1y ago
It runs a model with 260K params, so hardly a "Large" LM. Nevertheless, a cool project.
- aaronharnly 1y agoAnd also not exactly a Commodore 64 is it, since it requires an addon with 30x the RAM. Still very cool and impressive though!
- actionfromafar 1y agoIt's a borderline thing. The official Commodore REU only supported 8x the RAM. But you could modify it yourself to 32x. Creative Micro Design also had the third party 1750 REU which supported 32x RAM. (2 megabytes.) So it is somewhat period accurate, albeit very expensive at the time.
- robertlagrant 1y agoImagine if someone had run that LLM on that hardware in the 1980s, though. Incredible! (Probably couldn't have trained the model, but still.)
- bunchofnumbers 1y agoYou'd have needed a ZX Spectrum for that!