Fair -- 24GB GPUs are still quite expensive. >10x cheaper than 80GB GPUs though! We already have something we're testing that's gotten 70b training down to dua

Fair -- 24GB GPUs are still quite expensive. >10x cheaper than 80GB GPUs though! We already have something we're testing that's gotten 70b training down to dual 16GB GPUs, and we're working it making it even smaller...