2 ms·
I just want to know max RAM configuration in the laptop form factor, and the memory bandwidth. I would like more than 800Gb/s memory bandwidth My M1 Max can do
by yieldcrv 2y ago
I just want to know max RAM configuration in the laptop form factor, and the memory bandwidth. I would like more than 800Gb/s memory bandwidth
My M1 Max can do everything I want it to, although it maxes out at 64gb RAM. but my use cases expand above 128gb and would change my approach
specifically would allow my machine to act as nodes on more distributed networks, maybe even Solana, and run larger language models - at all and faster
- raxxorraxor 2y agoWhile direct memory access of Macs is nice, they still do have performance issues compared to a PC GPU. Of course the pricing would be entirely different with >128gb here. Seems like Apple is the budget solution now. I use an adapted LLM on an old M1 macbook air and it runs very well, even for autocompleting code. Image synthesis is quite slow though, even on newer Apple chips. Hope the moat of nvidia dies soon.
- yieldcrv 2y agoI use lower parameter LLM's on M1's with very little RAM as well. but 70B+ would be useful for me too