3 ms·
The answers are getting dumber so-as to not scare all the sheeple. Enough people don't realize how easily these LLM systems will replace large swaths of techni
by ProllyInfamous 3y ago
The answers are getting dumber so-as to not scare all the sheeple.
Enough people don't realize how easily these LLM systems will replace large swaths of technical instruction and bookkeeping.
The opensource stuff (e.g. Llama 13B) which you can run locally on a $1200 hardware (1 word/second) is pretty impressive, too.
- novaRom 3y agoyou can run opnellama on a 300 Euro laptop with ~500 ms/token performance in fact you can run any decent model of 3B-7B size on any contemporary hardware with enough RAM
- anotherhue 3y agoI run that on ggml on a 5 year old CPU at about twice that speed.
- rsynnott 3y ago> bookkeeping Bookkeeping?! Ah, yes, let the thing that makes shit up with impunity do your books for you. The tax authorities will be very understanding when you're audited, I'm sure.