3 ms·

ollama seems like taking a page from langchain book: develop something that's open source but get it so popular that attracts VC money. I never liked ollama, m

ollama seems like taking a page from langchain book: develop something that's open source but get it so popular that attracts VC money. I never liked ollama, maybe because ollama builds on llama.cpp (a project I truly respect) but adds so much marketing bs. For example, the @ollama account on twitter keeps shitposting on every possible thread to advertise ollama. The other day someone posted something about their Mac setup and @ollama said: "You can run ollama on that Mac." I don't like it when +500 people are working tirelessly on llama.cpp and then guys like langchain, ollama, etc. rip off the benefits.

slimsag 3y ago
Make something better, then. (I'm not being dismissive, I really genuinely mean it - please do) I don't know who is behind Ollama and don't really care about them. I can agree with your disgust for VC 'open source' projects. But there's a reason they become popular and get investment: because they are valuable to people, and people use them. If Ollama was just a wrapper over llama.cpp, then everyone would just use llama.cpp. It's not just marketing, either. Compare the README of llama.cpp to the Ollama homepage, notice the stark contrast of how difficult getting llama.cpp connected to some dumb JS app is compared to Ollama. That's why it becomes valuable. The same thing happened with Docker and we're just now barely getting a viable alternative after Docker as a company imploded, Podman Desktop, and even then it still suffers from major instability on e.g. modern macs. The sooner open source devs in general learn to make their projects usable by an average developer, the sooner it will be competitive with these VC-funded 'open source' projects.
- behnamoh 3y ago
  llama.cpp already has OpenAI compatible API. It takes literally one line to install it (git clone and then make). It takes one line to run the server as mentioned on their examples/server README. ./server -m <model> <any additional arguments like mmlock>
- homarp 3y ago
  >notice the stark contrast of how difficult getting llama.cpp connected to some dumb JS app is compared to Ollama. Sorry, I'm new to ollama 'ecosystem'. From llama.cpp readme, I ctrl-F-ed "Node.js: withcatai/node-llama-cpp" and from there, I got to https://withcatai.github.io/node-llama-cpp/guide/ https://withcatai.github.io/node-llama-cpp/guide/ Can you explain how ollama does it 'easier' ?
FanaHOVA 3y ago
ggml is also VC backed, so that has nothing to do with it.
udev4096 3y ago
I didn't know ollama was VC funded

slimsag 3y ago

Make something better, then. (I'm not being dismissive, I really genuinely mean it - please do) I don't know who is behind Ollama and don't really care about them. I can agree with your disgust for VC 'open source' projects. But there's a reason they become popular and get investment: because they are valuable to people, and people use them. If Ollama was just a wrapper over llama.cpp, then everyone would just use llama.cpp. It's not just marketing, either. Compare the README of llama.cpp to the Ollama homepage, notice the stark contrast of how difficult getting llama.cpp connected to some dumb JS app is compared to Ollama. That's why it becomes valuable. The same thing happened with Docker and we're just now barely getting a viable alternative after Docker as a company imploded, Podman Desktop, and even then it still suffers from major instability on e.g. modern macs. The sooner open source devs in general learn to make their projects usable by an average developer, the sooner it will be competitive with these VC-funded 'open source' projects.

behnamoh 3y ago
llama.cpp already has OpenAI compatible API. It takes literally one line to install it (git clone and then make). It takes one line to run the server as mentioned on their examples/server README. ./server -m <model> <any additional arguments like mmlock>
homarp 3y ago
>notice the stark contrast of how difficult getting llama.cpp connected to some dumb JS app is compared to Ollama. Sorry, I'm new to ollama 'ecosystem'. From llama.cpp readme, I ctrl-F-ed "Node.js: withcatai/node-llama-cpp" and from there, I got to https://withcatai.github.io/node-llama-cpp/guide/ https://withcatai.github.io/node-llama-cpp/guide/ Can you explain how ollama does it 'easier' ?

FanaHOVA 3y ago

ggml is also VC backed, so that has nothing to do with it.

udev4096 3y ago

I didn't know ollama was VC funded