3 ms·
Oh it's a wrapper? I just skimmed and thought they reinvented llama.cpp for some reason, which would have been mildly interesting.
by andy99 3y ago
Oh it's a wrapper? I just skimmed and thought they reinvented llama.cpp for some reason, which would have been mildly interesting.
- williamstein 3y ago(edit: this is completely irrelevant remark. sorry) It's (1) written in Python, and (2) ollama appears nowhere in their Docker repo [1], and (3) it gets the models only from huggingface instead of the ollama repos. Thus maybe it is NOT a wrapper of ollama? [1] https://github.com/googlecloudplatform/localllm https://github.com/googlecloudplatform/localllm
- andy99 3y agohttps://github.com/GoogleCloudPlatform/localllm/blob/main/llm-tool/setup.py#L30 https://github.com/GoogleCloudPlatform/localllm/blob/main/ll... I see llama.cpp in there, but I didn't go deeper than that. Ollama is not the same thing.