4 ms·
A3B is especially nice, MoE really shines on memory bandwidth contained platforms like the DGX Spark.
by danielbln 5mo ago
A3B is especially nice, MoE really shines on memory bandwidth contained platforms like the DGX Spark.
- verdverm 5mo agolooks like MTP support has now been merged and also updated unsloth quants to go with it (not just the extras, all of 'em!)