4 ms·
You can find 4-bit quantized versions of DBRX here: https://huggingface.co/PrunaAI/dbrx-base-bnb-4bit https://huggingface.co/PrunaAI/dbrx-base-bnb-4bit https:/
by johnpruna 3y ago
You can find 4-bit quantized versions of DBRX here:
https://huggingface.co/PrunaAI/dbrx-base-bnb-4bit https://huggingface.co/PrunaAI/dbrx-base-bnb-4bit
https://huggingface.co/PrunaAI/dbrx-instruct-bnb-4bit https://huggingface.co/PrunaAI/dbrx-instruct-bnb-4bit