2 ms·Exactly. And most folks are using a framework like llama.cpp which does control where it’s run.by scosman 1y agoExactly. And most folks are using a framework like llama.cpp which does control where it’s run.