4 ms·
> That is not always a bad thing Sure and that's reasonable, but in the cases where performance/throughput/training time/RAM usage is the main limiting factor
by sam0x17 3y ago
> That is not always a bad thing
Sure and that's reasonable, but in the cases where performance/throughput/training time/RAM usage is the main limiting factor of a field, suddenly this stuff matters a lot. There's plenty of useful code written in COBOL and Basic from back in the day, but you don't see people using those things to train LLMs
Imagine if instead of letting Basic effectively die, we had improved it with a myriad of extensions to the point where you can run LLMs and GPU code and things in a performant-ish way on it. Now replace the word Basic with Python