Emad Mostaque, CEO of Stability AI (behind Stable Diffusion) has said they are training language models that they plan on releasing. IIRC, though, even using al

Emad Mostaque, CEO of Stability AI (behind Stable Diffusion) has said they are training language models that they plan on releasing. IIRC, though, even using all the most up-to-date techniques like 1-byte parameter quantization and Chinchilla scaling learnings, it will still probably be on the order of magnitude of 64GB or something, so not quite usable for most people locally yet, unless you happen to have a very beefy multi-GPU machine at home.