3 ms·

I have a server with a bunch of PCIe slots and like 4 Nvidia GPUs with 24GB of RAM each. What's the best model I can realistically run?

• bhouston 3y ago
  Here are some scorecards: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderb... https://paperswithcode.com/sota/sentence-completion-on-hellaswag https://paperswithcode.com/sota/sentence-completion-on-hella... https://paperswithcode.com/sota/common-sense-reasoning-on-winogrande https://paperswithcode.com/sota/common-sense-reasoning-on-wi... https://paperswithcode.com/sota/common-sense-reasoning-on-arc-challenge https://paperswithcode.com/sota/common-sense-reasoning-on-ar... https://paperswithcode.com/sota/common-sense-reasoning-on-commonsenseqa https://paperswithcode.com/sota/common-sense-reasoning-on-co...