3 ms·
Not really what the Pi is about, though. It’s a physical computing board.
by throw46365 2y ago
Not really what the Pi is about, though. It’s a physical computing board.
- mewpmewp2 2y agoWell, you could still build a lot with it, but the issue is it would be very expensive to have something that was able to do LLM inferencing.
- pama 2y agoWithout the accelerator addon the Pi5 could do smaller models at passable speed, so I wonder if an accelerator can make this faster and allow larger models. https://robleshermoso.com/posts/ejecutando-llm-raspberry-pi-5-edge-iot/ https://robleshermoso.com/posts/ejecutando-llm-raspberry-pi-...
- mewpmewp2 2y agoBit of a confusing typo there with 2.7 trillion instead of billion, but should check out.
- throw46365 2y agoThere's an article about this stuff in The MagPi this month [0] -- and about a Stable Diffusion model trained only on truly Public Domain images. I don't think the Foundation are asleep on the idea people will want to do this, but they clearly want to focus on ethical AI stuff, which is the right call if you ask me. [0] Edit: last month, so the free PDF is available now: https://magpi.raspberrypi.com/issues/141 https://magpi.raspberrypi.com/issues/141