4 ms·
The 4bit quant doesn't seem to work for me, I keep getting: Error: exception create_tensor: tensor 'blk.0.ffn_gate.0.weight' not found I've tried downloading i
by Me1000 2y ago
The 4bit quant doesn't seem to work for me, I keep getting:
Error: exception create_tensor: tensor 'blk.0.ffn_gate.0.weight' not found
I've tried downloading it twice now.
- Patrick_Devine 2y agoWhich version of Ollama are you using? You can check with `ollama -v`. Also, using `ollama list | grep wizardlm2` the 8x22b version should have ID `abda6e58fd1d`.
- Me1000 2y agoI ended up having to download the latest version directly from GitHub, and that fixed it. Looks like the 0.1.32 mac release hasn't been posted to your website yet.