3 ms·
You can still make money on open weight models. The compute required to run these models is still very far out of reach for the average consumer, yet known ent
by HDBaseT 5mo ago
You can still make money on open weight models.
The compute required to run these models is still very far out of reach for the average consumer, yet known enthusiast, therefore they still sell inference, whilst also getting consumer goodwill for providing open weights.
- datadrivenangel 5mo agoAnd the efficiency! Big accelerator cards are ~100x the throughput per watt in terms of raw processing power.