2 ms·
In this regard, the release of open-weight Gemma models that can run on reasonable local hardware, and are not drastically worse than Anthropic flagships, is qu
by nine_k 7mo ago
In this regard, the release of open-weight Gemma models that can run on reasonable local hardware, and are not drastically worse than Anthropic flagships, is quite a punch. An M2 Mac Mini with 32GB is about 10 months worth of Claude Max subscription.
- Readerium 7mo agoIn coding they are worse. Chinese models (GLM, MiniMax) are better.
- nine_k 7mo agoAnyway, there are a few model that are freely distributable, and that can reasonably run on consumer-grade local hardware. It changes a number of things. Not all tasks require very high intelligence, but a lot of data may be sensitive enough to avoid sharing it with a third party.