2 ms·
Yes! I tried to go as far as 32k on the context window but beyond that it won't be usable on my laptop (Ryzen AI 365, 32gb RAM and 6gb of VRAM)
by SamDc73 8mo ago
Yes!
I tried to go as far as 32k on the context window but beyond that it won't be usable on my laptop (Ryzen AI 365, 32gb RAM and 6gb of VRAM)
- mirekrusin 8mo agoYou need minimum ie. 2x 24G GPUs for this model (you need 46GB minimum).