3 ms·

Because buying Macs is not about performance, its about feeling like you are rich. That money could have been spent on way more bang/buck performance in the fo

Because buying Macs is not about performance, its about feeling like you are rich. That money could have been spent on way more bang/buck performance in the form of a set of 4 graphics cards. Also I would probably put the odds 70:30 that Apple marketing is astroturfing on HN from the amount of posts about running llms on Macbooks, because in reality, the inference speed of any decent llm is unusable on a Macbook despite the ability to fit it into RAM.

topaz0 5mo ago
Or it could have had way more bang/buck by feeding a family of real brains for a year or two
- yard2010 5mo ago
  Excuse me for this comment, really, but I can't comprehend the absurdity, some people are buying GPUs when other people have no money for insulin so they literally die. I don't mean anything towards op or gp, quite the opposite I'm truly happy they have this kind of freedom, it must feel really nice, I just hate this game so much.
  - topaz0 5mo ago
    You and me both
- deleted 5mo ago
  [deleted]
gbgarbeb 5mo ago
40-80 tok/s is unusable to you? Ok. If you like having a box with 8-12 fans blasting hot air and noise into your office all day, nobody's stopping you.
- ActorNightly 5mo ago
  If you are not being paid by Apple, I feel sorry for you. Cause that means you are so bought into the cult that you are delusional. the 40-80 tok/sec is only for initial prompt processing, and with the "medium" models, like Qwen3.6:27b. The actual token generation is in the 10 token/second Thats very slow. And your Macbook pro will stop being a LAP-top, because it will get very warm. Meanwhile, my 2x3090s happily crank out ~100 tok/sec generation. Oh and I can run 100 tok/sec on my phone as well, because I can just access ollama on my home desktop over ssh from termux.
  - gbgarbeb 5mo ago
    Please, allow me to show you how far I can pee. It's several feet more than you can and a much mightier stream to boot.

topaz0 5mo ago

Or it could have had way more bang/buck by feeding a family of real brains for a year or two

yard2010 5mo ago
Excuse me for this comment, really, but I can't comprehend the absurdity, some people are buying GPUs when other people have no money for insulin so they literally die. I don't mean anything towards op or gp, quite the opposite I'm truly happy they have this kind of freedom, it must feel really nice, I just hate this game so much.
- topaz0 5mo ago
  You and me both
deleted 5mo ago
[deleted]

gbgarbeb 5mo ago

40-80 tok/s is unusable to you? Ok. If you like having a box with 8-12 fans blasting hot air and noise into your office all day, nobody's stopping you.

ActorNightly 5mo ago
If you are not being paid by Apple, I feel sorry for you. Cause that means you are so bought into the cult that you are delusional. the 40-80 tok/sec is only for initial prompt processing, and with the "medium" models, like Qwen3.6:27b. The actual token generation is in the 10 token/second Thats very slow. And your Macbook pro will stop being a LAP-top, because it will get very warm. Meanwhile, my 2x3090s happily crank out ~100 tok/sec generation. Oh and I can run 100 tok/sec on my phone as well, because I can just access ollama on my home desktop over ssh from termux.
- gbgarbeb 5mo ago
  Please, allow me to show you how far I can pee. It's several feet more than you can and a much mightier stream to boot.