5 ms·
I suppose I’m just struggling to see the value add. Ollama already makes it dead simple to get a local LLM running, and this appears to be a more limited vendor
by McAtNite 3y ago
I suppose I’m just struggling to see the value add. Ollama already makes it dead simple to get a local LLM running, and this appears to be a more limited vendor locked equivalent.
From my point of view the only person who would be likely to use this would be the small slice of people who are willing to purchase an expensive GPU, know enough about LLMs to not want to use CoPilot, but don’t know enough about them to know of the already existing solutions.
- SirMaster 3y agoI just looked up Ollama and it doesn't look like it supports Windows. (At least not yet)
- McAtNite 3y agoOh my apologies for the wild goose chase. I thought they had added support for Windows already. Should be possible to run it through WSL, but I suppose that’s a solid point for Nvidia in this discussion.
- SirMaster 3y agoI think there's a market for a user who is not very computer savvy who at least understands how to use LLMs and would potentially run a chat one on their GPU especially if it's just a few clicks to turn on.
- kkielhofner 3y agoWith all due respect this comment has fairly strong (and infamous) HN Dropbox thread vibes. It's an Nvidia "product", published and promoted via their usual channels. This is co-sign/official support from Nvidia vs "Here's an obscure name from a dizzying array of indistinguishable implementations pointing to some random open source project website and Github repo where your eyes will glaze over in seconds". Completely different but wider and significantly less sophisticated audience. The story link is on The Verge and because this is Nvidia it will also get immediately featured in every other tech publication, website, subreddit, forum, twitter account, youtube channel, etc. This will get more installs and usage in the next 72 hours than the entire Llama/open LLM ecosystem has had in its history.
- McAtNite 3y agoUnfortunately I’m not aware of the reference to the HN Dropbox thread. I suppose my counter point is only that the user base that relies on simplified solutions is largely already addressed with the wide number of cloud offerings from OpenAi, Microsoft, Google, whatever other random company has popped up. Realistically I don’t know if the people who don’t want to use those, but also don’t want to look at GitHub pages is really that wide of an audience. You could be right though. I could be out of touch with reality on this one, and people will rush to use the latest software packaged by a well known vendor.
- thecal 3y agoIt is probably the most famous HN comment ever made and comes up often. It is a dismissive response to Dropbox years ago: https://news.ycombinator.com/item?id=9224 https://news.ycombinator.com/item?id=9224
- McAtNite 3y agoThanks for the explanation. I guess my only hope for not looking like I had a bad opinion is people’s intertia to move beyond CoPilot.
- deleted 3y ago[deleted]
- anonymousab 3y ago> the user base that relies on simplified solutions is largely already addressed There is a wide spectrum of users for which a more white-labelled locally-runnable solution might be exactly what they're looking for. There's much more than just the two camps of "doesn't know what they're doing" and "technically inclined and knows exactly what to do" with LLMs.
- Capricorn2481 3y agoI have no idea what you're talking about and am waiting for an answer to OPs question. Downloading text-generation-webui takes a minute, let's you use any model and get going. I don't really understand what this Nvidia thing adds? It seems even more complicated than the open source offerings. I don't really care how many installs it gets, does it do anything differently or better?
- se4u 3y agoYou are forgetting about developers who may want to develop on top of something stable and with long term support. That's a big market.
- McAtNite 3y agoWould they not prefer to develop for CoPilot? In comparison this seems niche.
- dist-epoch 3y agoThere are developers which fail to install Ollama/CUDA/Python/create-venv/download-models on their computer after many hours of trying. You think a regular user has any chance?
- McAtNite 3y agoNot really. I expect those users will just use copilot.
- ribosometronome 3y agoGamers who bought an expensive card and see this advertised to them in Nvidia's Geforce app?
- imtringued 3y ago>people who are willing to purchase an expensive GPU, Codeword for people who have hardware specialized and suitable for AI.