4 ms·
Thank you I will take a look at that. It looks like MoE models like Llama-4-Scout report active params (17B) not total (~109B). Some MoE models already work co
by jad-nohra 8mo ago
Thank you I will take a look at that.
It looks like MoE models like Llama-4-Scout report active params (17B) not total (~109B). Some MoE models already work correctly when HuggingFace has the full metadata. Fix is in progress.
Fixed in v0.3.1 and is live. https://vram.run/model/meta-llama/Llama-4-Scout-17B-16E-Instruct/ https://vram.run/model/meta-llama/Llama-4-Scout-17B-16E-Inst...