2 ms·
Local LLMs will be one of those things where you'll feel a difference. Not much else I can think of as well. M1 is still insane. Apps, OS emulation... just ch
by thenaturalist 1y ago
Local LLMs will be one of those things where you'll feel a difference.
Not much else I can think of as well.
M1 is still insane. Apps, OS emulation... just chuggs along.
- ziofill 1y agoI don't know how often it happens that a 5 year old chip still gets praise, but I guess not very often.
- adastra22 1y agoJust upgraded my M1 Pro to an M4 Max. Roughly an order of magnitude faster local inference, though I haven’t benchmarked it. Outside of that though, it’s really hard to tell the difference. M1 is/was a beast and plenty fast enough for daily work.
- addaon 1y agoI use my M1 Max MacBook Pro for pretty serious CFD with OpenFoam. It’s astonishing how good it is… but a newer machine would be nearly 2x faster, which matters when single runs can take 1-3 hours.