5 ms·

I have MBP M1Max 32GB - it is $20000 now very good for LLM.

• piva00 3y ago
  I was surprised on how well Mistral's `mixtral` model runs on my work's MBP M1 Max 64GiB. I thought it'd be a total slog but it does work well enough to replace ChatGPT for quite a lot of use-cases.
  • jlokier 3y ago
    Does it spin up the fan?
    • piva00 3y ago
      Yes, heavily, I think it's the only time I heard the fans loudly with this machine.
• netdur 3y ago
  [flagged]
  • forbiddenlake 3y ago
    I can't down vote, but I don't understand how your post answers the question, perhaps because I've never owned a Mac. Are you implying that your MBP also has a lot of GPU RAM and therefore, yes, it is good for LLMs?
    • netdur 3y ago
      yes RAM is shared between CPU and GPU, I am able to run Mixtral-8x7B in this machine at decent speed, this is pretty good for testing LLM, yes
  • staticman2 3y ago
    Macbook Pros don't cost $20,000 and aren't cards...
    • netdur 3y ago
      oh thanks! I am getting down votted for a typo? reminds me grammar nazies during slashdot days... okay
      • staticman2 3y ago
        I didn't downvote you, but someone discussing an article on $329 graphic cards and asking for a card recommendation probably doesn't want a 2000 dollar laptop recommendation.
• epolanski 3y ago
  How's that relevant to my question?