3 ms·
moot point if tok/s benchmark results are the same or worse.
by numpad0 2y ago
moot point if tok/s benchmark results are the same or worse.
- DrBenCarson 2y agoNot moot if you care about producing those tokens with the largest available models
- kjreact 2y agoAre the benchmarks worse? Running LLMs in system memory is rather painful. I am having a hard time finding benchmarks for running large models using system memory. Can you point me to some benchmarks you’re referring to?