3 ms·

Ollama is great but I feel like Georgi Gerganov deserves way more credit for llama.cpp. He (almost) single-handedly brought LLMs to the masses. With the lates

Ollama is great but I feel like Georgi Gerganov deserves way more credit for llama.cpp. He (almost) single-handedly brought LLMs to the masses. With the latest news of some AI engineers' compensation reaching up to a billion dollars, feels a bit unfair that Georgi is not getting a much larger slice of the pie.

freedomben 1y ago
Is Georgi landing any of those big-time money jobs? I could see a conflict-of-interest given his involvment with llama.cpp, but I would think he'd be well positioned for something like that
- moralestapia 1y ago
  (This is mere speculation) I think he's happy doing his own thing. But then, if someone came in with a billion ... who wouldn't give it a thought?
  - webdevver 1y ago
    really a billion bucks is far too much, that is beyond the curve. $50M, now thats just perfect. you're retired, nor burdened with a huge responsibility
- apwell23 1y ago
  https://ggml.ai/ https://ggml.ai/ > ggml.ai is a company founded by Georgi Gerganov to support the development of ggml. Nat Friedman and Daniel Gross provided the pre-seed funding.
mrs6969 1y ago
Agreed. Ollama itself is kind a wrapper around llamacpp anyway. Feel like the real guy is not included to the process. Now I am going to go and write a wrapper around llamacpp, that is only open source, truly local. How can I trust ollama to not to sell my data.
- rafram 1y ago
  Ollama is not a wrapper around llama.cpp anymore, at least for multimodal models (not sure about others). They have their own engine: https://ollama.com/blog/multimodal-models https://ollama.com/blog/multimodal-models
  - iphone_elegance 1y ago
    looks like the backend is ggml, am I missing something? same diff
- Patrick_Devine 1y ago
  Ollama only uses llamacpp for running legacy models. gpt-oss runs entirely in the ollama engine. You don't need to use Turbo mode; it's just there for people who don't have capable enough GPUs.
am17an 1y ago
Seriously, people astroturfing this thread by saying ollama has a new engine. It literally is the same engine that llama.cpp uses and georgi and slaren maintain! VC funding will make people so dishonest and just plain grifters
- guipsp 1y ago
  No one is astroturfing. You cannot run any model with just GGML. It's a tensor library. Yes, it adds value, but I don't think that saying that ollama also does is unfair.
benreesman 1y ago
`ggerganov` is one of the most under-rated and under-appreciated hackers maybe ever. His name belongs next to like Carmack and other people who made a new thing happen on PCs. And don't forget the shout out to `TheBloke` who like single-handedly bootstrapped the GGUF ecosystem of useful model quants (I think he had a grant from pmarca or something like that, so props to that too).

freedomben 1y ago

Is Georgi landing any of those big-time money jobs? I could see a conflict-of-interest given his involvment with llama.cpp, but I would think he'd be well positioned for something like that

moralestapia 1y ago
(This is mere speculation) I think he's happy doing his own thing. But then, if someone came in with a billion ... who wouldn't give it a thought?
- webdevver 1y ago
  really a billion bucks is far too much, that is beyond the curve. $50M, now thats just perfect. you're retired, nor burdened with a huge responsibility
apwell23 1y ago
https://ggml.ai/ https://ggml.ai/ > ggml.ai is a company founded by Georgi Gerganov to support the development of ggml. Nat Friedman and Daniel Gross provided the pre-seed funding.

mrs6969 1y ago

Agreed. Ollama itself is kind a wrapper around llamacpp anyway. Feel like the real guy is not included to the process. Now I am going to go and write a wrapper around llamacpp, that is only open source, truly local. How can I trust ollama to not to sell my data.

rafram 1y ago
Ollama is not a wrapper around llama.cpp anymore, at least for multimodal models (not sure about others). They have their own engine: https://ollama.com/blog/multimodal-models https://ollama.com/blog/multimodal-models
- iphone_elegance 1y ago
  looks like the backend is ggml, am I missing something? same diff
Patrick_Devine 1y ago
Ollama only uses llamacpp for running legacy models. gpt-oss runs entirely in the ollama engine. You don't need to use Turbo mode; it's just there for people who don't have capable enough GPUs.

am17an 1y ago

Seriously, people astroturfing this thread by saying ollama has a new engine. It literally is the same engine that llama.cpp uses and georgi and slaren maintain! VC funding will make people so dishonest and just plain grifters

guipsp 1y ago
No one is astroturfing. You cannot run any model with just GGML. It's a tensor library. Yes, it adds value, but I don't think that saying that ollama also does is unfair.

benreesman 1y ago

`ggerganov` is one of the most under-rated and under-appreciated hackers maybe ever. His name belongs next to like Carmack and other people who made a new thing happen on PCs. And don't forget the shout out to `TheBloke` who like single-handedly bootstrapped the GGUF ecosystem of useful model quants (I think he had a grant from pmarca or something like that, so props to that too).