3 ms·

Blog post from same author explaining https://b4rtaz.medium.com/how-to-run-llama-3-405b-on-home-devices-build-ai-cluster-ad0d5ad3473b https://b4rtaz.medium.com/

• walrus01 2y ago
  Noteworthy nothing there really seems to be raspberry pi specific, as the raspberry pi os is based on debian, the same could be implemented on N number of ordinary x86-64 small desktop PCs for a cheap test environment. You can find older dell 'precision' series workstation systems on ebay with 32GB of RAM for pretty cheap these days, four of which together would be a lot more capable than a raspberry pi 5.