3 ms·
Any plans on distilling it down to an 8b model to enable it for pure local usage on most consumer hardware?
by doubtfuluser 2y ago
Any plans on distilling it down to an 8b model to enable it for pure local usage on most consumer hardware?
- samatdav 2y agoCould be done in the future. Our current focus is highest accuracy. But there are no limitations on the models - just would depend on user preference of size/performance tradeoff.