3 ms·
I run Yi 34B at 45K-70K context as a GPT 3.5 replacement on a Nvidia 3090. Its quite smart, and fast. The whole rig cost me $2.1K, but it could have easily be
by brucethemoose2 3y ago
I run Yi 34B at 45K-70K context as a GPT 3.5 replacement on a Nvidia 3090.
Its quite smart, and fast.
The whole rig cost me $2.1K, but it could have easily been $1.5K without splurging on certain parts like I did. And its 10 Liters, small enough to move around.
- washadjeffmad 3y agoSame, but mine is 11L (A4-H2O). Which case did you get?!
- brucethemoose2 3y agoA Node 202! I wanted something flat enough for a suitcase. https://www.reddit.com/r/sffpc/comments/18a7mal/ducted_3090_ftw3_stuffed_in_a_node_202/ https://www.reddit.com/r/sffpc/comments/18a7mal/ducted_3090_...