3 ms·
Nice to see people finding way to get the square peg though the round hole. Something that I wondered when the Raspberry Pi 5 came out is the weirdness that mi
by Lerc 3y ago
Nice to see people finding way to get the square peg though the round hole.
Something that I wondered when the Raspberry Pi 5 came out is the weirdness that might be possible now that they have their own chip doing IO cleverness.
On the PI 5, the two MIPI interfaces ave been enhanced to do either output or input, It made me wonder if the ports are now generalized enough that you could daisy chain a string of PI 5's connecting MIPI to MIPI. Then you could run inference layers on individual PIs and pass the activations down the MIPI. 10x 8Gig Pi 5's might not be the speediest way to get an 80gig setup, but it would certainly be the cheapest (for now)
- dannyw 3y agoThe cheapest way to get a 80gig setup is to to only offload some layers to GPU, and use CPU/system RAM for the rest. I run ~120GB models on my PC with a 7950X, 128GB DDR5, and RTX 3090.
- Lerc 3y agoHow much did that cost you? Looking at my local store a rtx 3090 alone costs 25x the cost of an 8gig PI 5