3 ms·
The setup was around $10k, but maybe more now with mem/ssd prices. This is a good list, I like my Beelink a lot, my Minisforum likes to turn itself off every c
by verdverm 8mo ago
The setup was around $10k, but maybe more now with mem/ssd prices.
This is a good list, I like my Beelink a lot, my Minisforum likes to turn itself off every couple of weeks, not sure why yet.
https://www.techradar.com/pro/there-are-15-amd-ryzen-ai-max-395-mini-pcs-in-the-world-right-now-heres-where-you-can-buy-them https://www.techradar.com/pro/there-are-15-amd-ryzen-ai-max-...
---
Performance is pretty bad (<10/tps) and context is quite limited. Still good to see progress
Prompt Size (tokens) | TFT (s) - Flash Attention Disabled | TFT (s) - Flash Attention Enabled
4096 | 53.7s | 39.7s
8192 | Out Of Memory (OOM) | 90.5s
16384 | Out Of Memory (OOM) | 239.1s
- rootusrootus 8mo ago> Minisforum likes to turn itself off every couple of weeks, not sure why yet AFAICT, the answer is "because Minisforum". I don't know if they have a design principle that they should run their systems near the edge of the thermal envelope or what, but Minisforum is the only brand I've had consistent trouble with stability on. My last one got to where it stopped booting altogether, just looped. Since then I've written off Minisforum as a brand, just not worth the hassle.
- shrubble 8mo agoI would try to add a fan or other cooling; my guess is that the CPU is handling thermal properly but something else is not.
- verdverm 8mo agoReply to one, but appreciate all three replies, thank you! Thermal is a good call, I have some cpu pastes around
- gmerc 8mo agoI put one of those notebook cooling pads underneath, that usually does the trick