3 ms·

Presumably he means this https://cloud.google.com/blog/products/application-development/new-localllm-lets-you-develop-gen-ai-apps-locally-without-gpus https://c

by andy99 3y ago

Presumably he means this https://cloud.google.com/blog/products/application-development/new-localllm-lets-you-develop-gen-ai-apps-locally-without-gpus https://cloud.google.com/blog/products/application-developme... The claim is correct but not related to gemma

behnamoh 3y ago
Yes, I was talking about this.
gliptic 3y ago
From the repo: > Run LLMs locally on Cloud Workstations. Uses: > Quantized models from [Huggingface] > llama-cpp-python's webserver But sure, the blog post doesn't mention it.