Slightly off-topic, but I'd like to see a model that can fit nicely on a consumer 24GB GPU, such as a 20B model (8bit quantized, but some spare space to allow f

Slightly off-topic, but I'd like to see a model that can fit nicely on a consumer 24GB GPU, such as a 20B model (8bit quantized, but some spare space to allow for context), or perhaps 40B so that a 4-bit quant could fit into 20GB VRAM. It's disappointing to me that Meta stopped releasing the 30B after llama 1. (I know codellama exists, but that's been finetuned to one use case).