machinationu

4 ms·

1. 31.▲
   by machinationu 10mo ago

   I am regularly getting close to 100% RAM usage on Windows doing data processing in Python/numpy
2. 32.▲
   by machinationu 10mo ago

   it's not. decompression always ends since it progresses through the stream always moving forward. but it might take a while
3. 33.▲
   by machinationu 10mo ago

   the issue is there is very little text before the internet, so not enough historical tokens to train a really big model