4 ms·
I'd assume the closed weight models are all working on shrinking their parameter counts anyways. They too benefit from smaller models. It'd be foolish for the
by cogman10 2mo ago
I'd assume the closed weight models are all working on shrinking their parameter counts anyways. They too benefit from smaller models. It'd be foolish for these SOTA labs to not be working at reducing parameter counts.
- literalAardvark 2mo agoThe incentive is there, but their money making niche is to solve problems you can't solve locally with a 30b, so they're unlikely to stray into territory owned by ultra cheap to run open weights models.