3 ms·
It entirely depends on the speed of your hardware, but roughly we'd expect it to be 3.5 times slower than Falcon 40B.
by logicchains 3y ago
It entirely depends on the speed of your hardware, but roughly we'd expect it to be 3.5 times slower than Falcon 40B.
- jsf01 3y agoEither on a standardized set of hardware or relative to other models. Performance benchmarks exist for all sorts of compute intensive things, so surely there’s at least one for LLMs?