If the software were a little better Apple Silicon would be by far the most cost effective rig today for DIY LLM research or training. 192GiB RAM is enough to

If the software were a little better Apple Silicon would be by far the most cost effective rig today for DIY LLM research or training. 192GiB RAM is enough to train or inference Falcon 180B in RAM at 8-bit resolution.