5 ms·
How much memory do you have? I'm trying to figure out which is the best model to run on 48GB (unified memory).
by rpastuszak 2y ago
How much memory do you have? I'm trying to figure out which is the best model to run on 48GB (unified memory).
- Metacelsus 2y ago32B works well (I have 48GB Macbook Pro M3)
- whimsicalism 2y agoyou’re not running r1 dude. e: no clue why i’m downvoted for this
- smokel 2y agoYou are probably being downvoted because your comment is not very helpful, and also a bit rude (ending with "dude"). It would be more helpful to provide some information on why you think this person is not using R1. For example: You are not using DeepSeek-R1, but a much smaller LLM that was merely fine-tuned with data taken from R1, in a process called "distillation". DeepSeek-R1 is huge (671B parameters), and is not something one can expect to run on their laptop.
- zubairshaik 2y agoIs this text AI-generated?
- tasuki 2y agoProbably. It's helpful tho, isn't it?
- smokel 2y agoI actually wrote it myself. I set a personal goal in trying to be more helpful, and after two years of effort, this is what comes out naturally. The most helpful thing that I do is probably not posting senseless things. I do sometimes ask ChatGPT to revise my comments though (not for these two).
- tasuki 2y agoYou have reached chatgpt level helpfulness - congrats!
- zubairshaik 2y agoWasn't a value judgement