3 ms·
Well, I should clarify... today that's done on-prem. Of course if you had a secure network and host, LLM interaction could certainly be done in the cloud. Ther
by mojomark 2y ago
Well, I should clarify... today that's done on-prem. Of course if you had a secure network and host, LLM interaction could certainly be done in the cloud.
There are also other reasons to host LLM's locally. That is systems that leverage contextual reasoning power of LLMs, but are unable to readily access the internet. A planetary rover (e.g. Mars), for example.