3 ms·
Testing AI and LLM on Rockchip RK3588 Using Mixtile Blade 3 SBC with 32GB RAM
- lionkor 3y agoTitle should be "Not Testing..."
- keikobadthebad 3y agoThis is just 5 paras of excuses for not testing squat.
- teraflop 3y agoThe blog post is discussing another article that actually does contain test results: https://www.cnx-software.com/2024/02/27/testing-ai-and-llm-on-rockchip-rk3588-using-mixtile-blade-3-sbc-with-32gb-ram/ https://www.cnx-software.com/2024/02/27/testing-ai-and-llm-o...
- lagrange77 3y agoThanks. Oh wow, the title is the link to the discussed article.
- rcarmo 3y agoThat's being fixed now. And the screenshot will automatically link there as well. Apologies for the inconvenience.
- lagrange77 3y agoCool, thanks for the feedback.
- ditados 3y agoI wonder how stable those libraries mentioned are, and how much RAM is needed, because I cannot run LLMs at all on my Pis.
- isoprophlex 3y ago[flagged]
- deleted 3y ago[deleted]
- imtringued 3y agoThis unfortunately is a red herring. Jetson Orin with 32GB is a more reasonable option. Yes it is expensive (950€ on arrow.de), but it is a niche product in the first place.