3 ms·

"11 tok/SEC running 671B DeepSeek R1 on two M3 Ultra" – Alex Cheema

• ryzvonusef 2y ago
  [flagged]
  • ryzvonusef 2y ago
    Alex Cheema is the guy behind the EXO Labs, and he got the two MS Ultra from Apple early (iirc he paid full price, he just got to skip the line). Local AI is become increasingly viable, I expect a trend towards local 'mainframe' to resurge again; a tiny rack with like ~$50K of equipment that replaces at least a dozen paper-processing staff would be a viable expense for any mid-sized company.
  • deleted 2y ago
    [deleted]
• deleted 2y ago
  [deleted]