4 ms·
We supposedly consume about 100 watts at rest. Given that my flops are low (less than one!), I don't think I'm an efficient processor. At least for floating po
by celrod 3y ago
We supposedly consume about 100 watts at rest.
Given that my flops are low (less than one!), I don't think I'm an efficient processor. At least for floating point operations.
Producing paper and ink cartridges isn't free, either.
I might be competitive with an LLM + GPUs, but I imagine it'll demolish me on throughput.
- monocasa 3y agoI run inference pretty efficiently with those 100 watts.