3 ms·
Contributed scores for the M3 Ultra 512 GB unified memory: https://www.localscore.ai/accelerator/404 https://www.localscore.ai/accelerator/404 Happy to test la
by jsatok 1y ago
Contributed scores for the M3 Ultra 512 GB unified memory: https://www.localscore.ai/accelerator/404 https://www.localscore.ai/accelerator/404
Happy to test larger models that utilize the memory capacity if helpful.
- deanputney 1y agoThat's very interesting. I guess it just can't compete with any of the Nvidia cards? I would think your results should show up if sorted by "generation"– maybe the leaderboard is cached...
- sipjca 1y agoTy for pointing this out, the results are taken from the db based on LocalScore, I will make some modifications to make the sorting better here
- zamadatix 1y agoNon-VRAM based options of the moment are only competitive when it comes to the size of a model they can run, since the alternative is "you can't run it at that price otherwise". Bandwidth at a given size is king, only then followed by enough compute to utilize it.