29 ms·
This looks really really interesting. Any idea whether it would run on a laptop with an Intel Core i7?
by m1sta_ 3y ago
This looks really really interesting. Any idea whether it would run on a laptop with an Intel Core i7?
- MacsHeadroom 3y agoYes, I run it on CPU using LLMStudio. It's very fast.
- Const-me 3y agoThe performance on integrated GPUs is not stellar, but it should work. On my AMD Ryzen 5 5600u with dual-channel DDR4, I’m getting 2 tokens/second. My friend with Intel Core i3 and single-channel memory was getting 1 token/second.
- ru552 3y agoVRAM is king. If you have the VRAM to hold the model parameters, you can run it.