4 ms·
Anyone compare this to ternary bonsai vs the 1 bit
by getcrunk 2mo ago
Anyone compare this to ternary bonsai vs the 1 bit
- woadwarrior01 2mo agoI haven't compared it for perf, but at first glance this appears to be an LLM (text-only) while both binary and ternary bonsai 27B models are VLMs (where the vision tower and the adapter MLP weights are unquantized and kept in float16).