2 ms·
I'm optimistic. * Intel has a history of getting this type of software working. * AMD doesn't. I don't think I'll ever trust AMD after... experiences, but In
by frognumber 3y ago
I'm optimistic.
* Intel has a history of getting this type of software working.
* AMD doesn't.
I don't think I'll ever trust AMD after... experiences, but Intel I'm bullish on Intel.
Arc A770 seems like by far the bang for the buck once software lands. 16GB for $300 if you find a good deal. Decent performance. Stick four of them in a system, and you've got 64GB for $1200 and a pretty decent amount of compute. Buy five systems like that, and you can run the largest open-source LLMs out there with Alpa for ~$6K.
That brings Facebook's GPT3-grade OPT models from corporate down to serious enthusiast level.