4 ms·

well yes, locally, if you assume that someone's got about 300'000 dollars of hardware at hand... right? as you are not paying for Gemini, may I ask why, did you

well yes, locally, if you assume that someone's got about 300'000 dollars of hardware at hand... right? as you are not paying for Gemini, may I ask why, did you try it and find it inferior?

msoad 2y ago
Gemini for coding does not work for me. It gets so many things wrong
- sumedh 2y ago
  Which Gemini AI model did you use?
- xnx 2y ago
  You should try again. Gemini rates highest on coding at lmarena.
KTibow 2y ago
You actually can't pay for the latest models, they're only available as free with limits
apexalpha 2y ago
I bought two (relatively) old datacenter GPUs with 48gb VRAM total for €200 that gets me 7 token/s for a 70b model.
- 383toast 2y ago
  which GPUs?
  - zargon 2y ago
    Not the GP, but I bought a few P40s over the summer for $150 each. Last I checked they're more expensive now, but it's still cheap vram and fast enough at inference for me.
  - apexalpha 2y ago
    Nvidia M40 and P40.