3 ms·
If you use a bajillion tokens your economical approach is to self host.
by lnenad 20d ago
If you use a bajillion tokens your economical approach is to self host.
- noir_lord 20d agoThere is a point where those two lines do cross but with them effectively subsidising token cost by burning debt, it's further away than it will be at some point. That said I use local only models purely because I don't want to use remote models, never having to think about token costs is worth it and no one is training anything on my data either.