2 ms·
Can you run any of those models without $20 000 worth of hardware that uses as much power and makes as much noise as a small factory?
by oblio 1y ago
Can you run any of those models without $20 000 worth of hardware that uses as much power and makes as much noise as a small factory?
- segmondy 1y agoI run them with under $3,000 hardware and inference is about 500-600watts with no noise.