3 ms·
From the repo: > Run LLMs locally on Cloud Workstations. Uses: > Quantized models from [Huggingface] > llama-cpp-python's webserver But sure, the blog
by gliptic 3y ago
From the repo:
> Run LLMs locally on Cloud Workstations. Uses:
> Quantized models from [Huggingface]
> llama-cpp-python's webserver
But sure, the blog post doesn't mention it.