3 ms·
I did not see (understand) how multiple Raspberry Pis are being used in parallel. Maybe someone can point me in the right direction to understand this.
by JKCalhoun 2y ago
I did not see (understand) how multiple Raspberry Pis are being used in parallel. Maybe someone can point me in the right direction to understand this.
- jonatron 2y agoBlog post from same author explaining https://b4rtaz.medium.com/how-to-run-llama-3-405b-on-home-devices-build-ai-cluster-ad0d5ad3473b https://b4rtaz.medium.com/how-to-run-llama-3-405b-on-home-de...
- walrus01 2y agoNoteworthy nothing there really seems to be raspberry pi specific, as the raspberry pi os is based on debian, the same could be implemented on N number of ordinary x86-64 small desktop PCs for a cheap test environment. You can find older dell 'precision' series workstation systems on ebay with 32GB of RAM for pretty cheap these days, four of which together would be a lot more capable than a raspberry pi 5.