7 ms·
I'd love to see a couple of things added to this, pricing and specific metrics. This would give some rationale behind the recommendations that goes a little dee
by joshka 3y ago
I'd love to see a couple of things added to this, pricing and specific metrics. This would give some rationale behind the recommendations that goes a little deeper than choose this. Choose this at $X/h for X tokens per second or this for half the price but Y tokens per second.
Also would be nice to compare some of the local GPU options (including Macbooks) vs cloud options.
Edit: I just noticed https://gpus.llm-utils.org/recommended-gpus-and-gpu-clouds-for-ai/ https://gpus.llm-utils.org/recommended-gpus-and-gpu-clouds-f...