4 ms·
If I have a fully maxed out MacBook Pro, would it make sense to just switch from Opus 4.8 to this? I've never tried running local models for coding...
by dbbk 4mo ago
If I have a fully maxed out MacBook Pro, would it make sense to just switch from Opus 4.8 to this? I've never tried running local models for coding...
- entrope 4mo agoHuggingFace says this model has 753B parameters, which will need a lot more RAM than a maxed-out MacBook Pro. With 40B active parameters, running from SSD would need patience.
- api 4mo agoI’ve wondered for a while if anyone is working on very wide channel parallel (kind of like RAID 0) SSD for this purpose. Couple that with a tensor processor and that would be interesting.
- petu 4mo agoThere's talks about HBF. F for Flash -- HBM packaging and bus width, but using NAND memory. e.g. https://www.sandisk.com/company/newsroom/press-releases/2026/2026-02-25-sandisk-and-sk-hynix-begin-global-standardization-of-next-generation-memory-solution-high-bandwidth-flash-hbf https://www.sandisk.com/company/newsroom/press-releases/2026...
- _aavaa_ 4mo agoFor an fp4 quantization it should fit with room to spare for KVCache