3 ms·
Hold on.. the routed experts are in FP8 now? Previously they were in BF16. Nice, this shall cut my download time by half!
by throwdbaaway 1mo ago
Hold on.. the routed experts are in FP8 now? Previously they were in BF16. Nice, this shall cut my download time by half!
- petu 1mo agoThis time they just made FP8 "default", accompanied by "-BF16" model/page (previously "-FP8" was released alongside).