Turboderp released a custom quantized version of dbrx-base and instruct a few days after the official model landed. https://huggingface.co/turboderp/dbrx-base-e

Turboderp released a custom quantized version of dbrx-base and instruct a few days after the official model landed. https://huggingface.co/turboderp/dbrx-base-exl2 https://huggingface.co/turboderp/dbrx-base-exl2 You are right, LLMs weights are fast getting commoditized. As fast as compute is scaling now, I don't think it can continue forever, so the huge advantages big players have is going to get wiped. I'm sure they will always be able to deliver at scale, but a super GPT4 performing model available on your local (or small player type) hardware in the next few years seems more likely than a few big mega-players and mega-models.