3 ms·

I wrote up a theoretical post here about LMM performance of a MacBook Pro with PIM memory: https://ben3d.ca/blog/m5-max-samsung-lpddr5-pim-650-tokens-per-secon

I wrote up a theoretical post here about LMM performance of a MacBook Pro with PIM memory: https://ben3d.ca/blog/m5-max-samsung-lpddr5-pim-650-tokens-per-second https://ben3d.ca/blog/m5-max-samsung-lpddr5-pim-650-tokens-p...

asaddhamani 2mo ago
Interesting read. Definitely hoping this works out so we can have cheap LLM machines at home
deleted 2mo ago
[deleted]