3 ms·
If you want the answer right now, that alone ups your compute needs to the point where you're probably better off just using a free hosted-AI service. Unless th
by zozbot234 7mo ago
If you want the answer right now, that alone ups your compute needs to the point where you're probably better off just using a free hosted-AI service. Unless the prompt is trivial enough that it can be answered quickly by a tiny local model.
- redman25 7mo agoA strix halo machine or MAC will run at less than 20watts idle. You could leave it running.