2 ms·
It’s 27b active params vs 13b active params, so you’d expect it to be 2x more expensive when serving multiple users
by tipsytoad 1mo ago
It’s 27b active params vs 13b active params, so you’d expect it to be 2x more expensive when serving multiple users