3 ms·
A jacked up PC can do really well and there is much fun to be had there. ...but you'd struggle to get close to even GPT 3.5 let alone 4 for generic tasks. For
by Havoc 3y ago
A jacked up PC can do really well and there is much fun to be had there.
...but you'd struggle to get close to even GPT 3.5 let alone 4 for generic tasks.
For custom tunes...yeah sure custom rolls will beat generic openAI. But that's a bit like pitting customed tuned cars against street legal manufacturer cars. It's an apple to oranges comparison
- kuchenbecker 3y agoIf it takes ~150k / year on AWS to fine tune, I'd assume ~50k onprem based on experience with cloud pricing.
- dragonwriter 3y ago> ...but you'd struggle to get close to even GPT 3.5 let alone 4 for generic tasks. But tasks are only generic in the aggregate, and with local models you can hand-off between different models for different tasks.