27 ms·
I think, I need to buy new HW maybe. My 12 core 32GRAM laptop is running these local models so slowly, it's unusable (I do have an Nvidia card in it as well, bu
by paffdragon 1y ago
I think, I need to buy new HW maybe. My 12 core 32GRAM laptop is running these local models so slowly, it's unusable (I do have an Nvidia card in it as well, but I ended up disabling due to issues under Wayland/wlroots and didn't have time to fix that yet). And most of my phone's advanced AI features won't work when only on-device processing is allowed.