4 ms·
I mean, a bunch of rocks falling on a keyboard can also generate tokens. So can an autocomplete software running on a 10W phone. But the quality is so far apart
by tomohelix 2y ago
I mean, a bunch of rocks falling on a keyboard can also generate tokens. So can an autocomplete software running on a 10W phone. But the quality is so far apart to the point you would find most people do not consider them on the same categories of "inference" as an LLM, not to mention a real human's mental capacity.
- mewpmewp2 2y agoBy the way, rocks falling is potential energy turned to kinetic energy so it is quite a lot of energy used. Didn't fact check this but if you drop 10 100g rocks per second from 2m height it is 30w according to GPT. Although I guess you could use one rock fall to generate A LOT of tokens if you don't use keyboard, but just use the variance data from falling rock to generate many tokens at once.