3 ms·
With these improvements llama.cpp/ggml is really becoming a pretty competitive serving stack even for large scale cloud hosted AI. I wonder how ggerganov finds
by nvm0n2 3y ago
With these improvements llama.cpp/ggml is really becoming a pretty competitive serving stack even for large scale cloud hosted AI. I wonder how ggerganov finds the time to do all this, does anyone know if he's being sponsored?
- killthebuddha 3y agoHe founded a startup https://ggml.ai/ https://ggml.ai/
- selectodude 3y agoDoesn’t seem like much of a business model there.
- vineyardmike 3y agoIDK, I can see a future. It’s a one-man (for now) business, so minimal costs to consider. If he can swing consulting using the .cpp projects as advertising, that sounds like a good business. Additionally, I can imagine companies investing and paying for the open source work to expand access to their licensed models. Use the same interface as people use LLAMA but upgrade to BetterModel, fully compatible. Additionally, I could believe this is simply a build up to a future Acquihire, which is the most lucrative way to be hired.
- simonw 3y agoHe also raised a bunch of money, so I guess the plan is to figure out the business model as he goes.