4 ms·
I want run open source LLMs on this prebuilt AI. Anyone tested this before?
- rar00 2y agoseems a tad expensive for (nerfed) consumer-grade GPUs IMO
- tech_no_logic 2y agocool case, i'll go for opt 2 as they have Threadripper.
- average_joey 2y agogood point is that this integrates some existing models for you to use. You can test different models with this. But still need to upgrade if you wanna try larger models. The more Vram the better
- KTibow 2y agoIt reminds me of a similar product [0] from George Hotz [0] https://tinygrad.org/#tinybox https://tinygrad.org/#tinybox