4 ms·
When can I "apt-get install" all this fancy new AI stuff?
by amelius 2y ago
When can I "apt-get install" all this fancy new AI stuff?
- deleted 2y ago[deleted]
- Towaway69 2y agoOn my mac: brew install ollama might be a good start ;)
- dzikimarian 2y ago"ollama pull" is pretty close
- dheera 2y agoWhy tf isn't ollama in apt-get yet? F these curl|sh installs.
- diggan 2y ago> Why tf isn't ollama in apt-get yet? There are three broad groups of people in packaging: A) People who package stuff you and others need. B) People who don’t package stuff but use what’s available. C) People who don’t package stuff and complain about what’s available without taking further action. If you find yourself in group C while having no interest in contributing to group A or working within the limits of group B, then you have two realistic options: either open your wallet and pay someone to package it for you or accept that your complaints won’t change anything. Most packaging work is done by volunteers. If something isn’t available, it’s not necessarily because no one sees value in it—it could also be due to policy restrictions, dependency complexity, or simply a lack of awareness. If you want it packaged, the best approach is to contribute, fund the work, or advocate for it constructively.
- amelius 2y agoThis is not entirely fair. We can't all be involved in package management, and GP might contribute in other ways.
- jmorgan 2y agoThis is a great point. apt-get would definitely be a better install experience and upgrade experience (that's what I would want too). Tailscale does this amazing well: https://tailscale.com/download/linux https://tailscale.com/download/linux The main issue for the maintainer team would be the work in hosting and maintaining all the package repos for apt, yum, etc, and making sure the we handle the case where nvidia/amd drivers aren't installed (quite common on cloud VMs). Mostly a matter of time and putting in the work. For now every release of Ollama includes a minimal archive with the ollama binary and required dynamic libraries: https://github.com/ollama/ollama/blob/main/docs/linux.md#manual-install https://github.com/ollama/ollama/blob/main/docs/linux.md#man.... But we could definitely do better
- diggan 2y agoOnce either your current distro starts packaging any LLM tool or when you chose a different distro.
- derefr 2y agoNot apt-get per se, but most of the infra components underlying the "AI stuff" can be `conda install`-ed.
- amelius 2y agoNo thank you. I spent months trying to find the source of mysterious segfaults on my system, that magically disappeared once I moved away from conda. Sorry for not being more specific, but at this point I just lost faith in this package manager.
- yetihehe 2y agoYou can also download lm-studio for nice gui version that saves your chats and allows easy downloading of models.