3 ms·
can you run large language models out of orbstack? I imagine it's not possible but am curious
by carefulobserver 3y ago
can you run large language models out of orbstack? I imagine it's not possible but am curious
- kdrag0n 3y agoTechnically yes, but CPU only. In theory it might be possible to support ANE/MPS, but it wouldn't be useful in practice because Linux software isn't built to use them, and there wouldn't be a good way to expose them.