ichiichisan

3 ms·

1. 1.▲
   by ichiichisan 9mo ago

   then all benefit from the sandbox is lost
2. 2.▲
   by ichiichisan 9mo ago

   Does it allow access to GPUs and all system resources? That is unfortunately a limitation a lot of these sandboxes often have and you need to run a container or vm to get that.
3. 3.▲
   by ichiichisan 9mo ago

   The big issue with this is though that GPUs are not available. I believe many people have local workstation boxes where they do dev on and need proper sandboxes and stuff like firecracker is also not super useful as afaik GPU passthrough is
4. 4.▲
   H2O LLM Studio – New open source framework/GUI for fine-tuning LLMs(github.com)

   2 points by ichiichisan 3y ago|0 comments