3 ms·
Curious to check this out, since they say it can run on a 4090 / Mac with >32 GB of RAM.
by abrowne2 1y ago
Curious to check this out, since they say it can run on a 4090 / Mac with >32 GB of RAM.
- ddtaylor 1y agoI can run it without issue on a 6800 XT with 64GB of RAM.
- yencabulator 1y ago"Can run" is pretty easy, it's pretty small and quantized. It runs at 3.7 tokens/second on pure CPU with AMD 8945HS.
- sneak 1y agoI just ran it on a 24GB M2 air. Slow, but functional.