4 ms·
How much are you going to spend on electricity though? Is this really going to be more cost-effective than just using openrouter?
by joelthelion 7mo ago
How much are you going to spend on electricity though? Is this really going to be more cost-effective than just using openrouter?
- austinthetaco 7mo agoThere are many other reasons someone might want to run a model locally outside of cost savings, ownership of data flow and use in locations without internet to name a couple.
- hadlock 7mo agoIf my options are run Opus 4.6 in the cloud for $200/mo or run Opus 4.6 locally for $275, I am absolutely going to self-host 100% of the time. Sending all that data to the cloud presents tremendous legal risk for companies. There's currently no retention rules about privately hosted AI.