mchiang

15 ms·

31.
by mchiang 1y ago
we are learning the usage patterns to be able to price this more properly.
32.
by mchiang 1y ago
login does not mean payment. It is free to use. It costs us to perform the web search, so we want to make sure it is not subject to abuse.
33.
by mchiang 1y ago
sorry that you feel the way you feel. :( I'm not sure which package we use that is triggering this. My guess is llama.cpp based on what I see on social? Ollama has long shifted to using our own engine. We do use llama.cpp for legacy an
34.
by mchiang 1y ago
Thanks for the kind words. Since the new multimodal engine, Ollama has moved off of llama.cpp as a wrapper. We do continue to use the GGML library, and ask hardware partners to help optimize it. Ollama might look like a toy and what looks t
35.
by mchiang 1y ago
Ollama is not run by Facebook. We are a small team building our dreams.
36.
by mchiang 1y ago
we have always been building in the open, and so is Ollama. All the core pieces of Ollama are open. There are areas where we want to be opinionated on the design to build the world we want to see. There are areas we will make money, and I w
37.
by mchiang 1y ago
Ollama at its core will always be open. Not all users have the computer to run models locally, and it is only fair if we provide GPUs that cost us money and let the users who optionally want it to pay for it.
38.
by mchiang 1y ago
we keep it for backwards compatibility - all the newer models are implemented inside Ollama directly
39.
by mchiang 1y ago
Thanks for the kind words. Sorry about that, we are working out some of the initial experience for Ollama.
40.
by mchiang 1y ago
In the app settings now, there is a toggle for "Expose Ollama to the network" - it allows for other devices or services on the network to access Ollama.
41.
by mchiang 1y ago
This is a feature we are looking into supporting. Thank you for reaffirming the need.
42.
by mchiang 1y ago
Rightful worry, and we had the same doubts before we embarked on this. Ollama serves developers, there is no doubt about that. The CLI isn’t getting dropped, in fact, what we’ve learned in building it is having the interface interacting wit
43.
by mchiang 1y ago
unfortunately, I don't think gemma 3 supports tool calling well. It's not trained into the model, and the 'support' for tool calling is post model training. We are working with Google, and trying to give the feedback on
44.
by mchiang 1y ago
We work closely with majority of research labs / model creates directly. Most of the times we will support models on release day. There are sometimes where the release window for major models are fairly close - and we just have to elec
45.
by mchiang 1y ago
the model is running locally - you can check by turning off the wifi.
46.
by mchiang 1y ago
One of the maintainers. The logo and all the illustrations are done by a human artist.
47.
by mchiang 1y ago
This is just wrong. Ollama has moved off of llama.cpp and is working with hardware partners to support GGML. https://ollama.com/blog/multimodal-models
48.
by mchiang 1y ago
Ben, we've had private conversations about this previously. I don't see any VC money grab nor am I aware of any. Building a product that we've dreamed of building is not wrong. Making money does not need to be evil. I, and th
49.
by mchiang 1y ago
We don't have this kind of power, and in fact, most our posts gets deleted so we don't post. We do read comments and help if we can. Negative comments help us grow and make Ollama better any way. We can take harsh feedback to make
50.
by mchiang 1y ago
Choice is good but here is why prefer Ollama over others (I'm biased because I work on Ollama). Supporting multiple backends is HARD. Originally, we thought we'd just add multiple backends to Ollama - MLX, ROCm, TRT-LLM, etc. It s
51.
by mchiang 1y ago
one of the maintainers for Ollama. I don't see it as a pivot. We are all developers ourselves, and we use it. In fact, there are many self-made prototypes before this from different individuals. We were hooked, so we built it for ourse
52.
by mchiang 1y ago
this is something we are working on. I don't have a specific timeline since it's done when its done, but it is being worked on.
53.
by mchiang 1y ago
Linux does not have the interface right now, and there are a lot of options for users. Open WebUI is an awesome project. https://github.com/open-webui/open-webui
54.
by mchiang 1y ago
I'm one of the maintainers who ran that example. I am Chinese. The English translation, I thought was pretty spot on. We don't hide the mistakes of the models or fake the demos. Overtime, of course I hope the models to improve muc
55.
by mchiang 2y ago
We partner with Cloudflare R2 to minimize the cost of hosting. Check out their pricing. The website is so minimal right now because we have been focused on the GitHub repo.
56.
by mchiang 2y ago
Can confirm it doesn't. Many Ollama posts get pushed off the front page too despite having hundreds of points. Over time I understood. If they did this for YC companies, it would ruin the trust of HN, YC, and probably the most importan
57.
by mchiang 2y ago
I’m one of the maintainers of Ollama. It’s amazing to see others build on top of open-source projects. Forks like RamaLama are exactly what open source is all about. Developers with different design philosophies can still collaborate in the
58.
by mchiang 2y ago
Ollama has the ability to pull models off Hugging Face as well: https://huggingface.co/docs/hub/en/ollama
59.
by mchiang 2y ago
the 671B model is now available: 4 bit quantized: ollama run deepseek-r1:671b (400GB+ VRAM/Unified memory required to run this) https://ollama.com/library/deepseek-r1/tags 8 bit quantization still being uplo
60.
by mchiang 2y ago
Did you mean the tags or the specific names from the distilled models?

More ›