3 ms·
Looking forward to next time, hoping you mention speculative decoding and MTP :) It would support your point about the performance of 20GB local models.
by rahimnathwani 5mo ago
Looking forward to next time, hoping you mention speculative decoding and MTP :)
It would support your point about the performance of 20GB local models.