Read Tim Dettmer's guide. Basically, you want nVidia, and you want lots of VRAM. Buy used for much more bang for the buck. Depending on your budget, get: - a

Read Tim Dettmer's guide. Basically, you want nVidia, and you want lots of VRAM. Buy used for much more bang for the buck. Depending on your budget, get: - an RTX 3060 with 12GB or - 1 used RTX 3090 with 24GB (approx twice as expensive as the 3060 but twice the VRAM and much faster) or - 2 used RTX 3090 cards if you need more than 24GB. Everything beyond that gets quite a bit more expensive because then you need a platform with more PCIe lanes, you may need more than one PSU and you will have problems fitting and cooling everything. With two cards and 2x24GB you can run the largest version of the LLaMA model (the 65B variant) and all its descendants with 4-bit quantization inside your GPU's VRAM, i.e. with good performance. Can can also try some low resource fine-tuning variants (LoRa etc). Oh and while you're at it also get a decent amount of RAM like 64GB or 128GB (it's very cheap right now) and a NVMe SSD. These models are quite large.