3 ms·
https://ollama.com/ https://ollama.com/
by strangescript 2y ago
https://ollama.com/ https://ollama.com/
- rpastuszak 2y agoHow much memory do you have? I'm trying to figure out which is the best model to run on 48GB (unified memory).
- Metacelsus 2y ago32B works well (I have 48GB Macbook Pro M3)
- whimsicalism 2y agoyou’re not running r1 dude. e: no clue why i’m downvoted for this
- smokel 2y agoYou are probably being downvoted because your comment is not very helpful, and also a bit rude (ending with "dude"). It would be more helpful to provide some information on why you think this person is not using R1. For example: You are not using DeepSeek-R1, but a much smaller LLM that was merely fine-tuned with data taken from R1, in a process called "distillation". DeepSeek-R1 is huge (671B parameters), and is not something one can expect to run on their laptop.
- zubairshaik 2y agoIs this text AI-generated?
- tasuki 2y agoProbably. It's helpful tho, isn't it?
- smokel 2y agoI actually wrote it myself. I set a personal goal in trying to be more helpful, and after two years of effort, this is what comes out naturally. The most helpful thing that I do is probably not posting senseless things. I do sometimes ask ChatGPT to revise my comments though (not for these two).
- tasuki 2y agoYou have reached chatgpt level helpfulness - congrats!
- zubairshaik 2y agoWasn't a value judgement