2 ms·
if all the competition pushes down margins on tokens to 10-20%, i dont see how the inherent scale advantages of cloud inference wont be way more to account for
by anthonypasq 3mo ago
if all the competition pushes down margins on tokens to 10-20%, i dont see how the inherent scale advantages of cloud inference wont be way more to account for the 20% cheaper tokens youd be getting running locally. i dont see how local will ever be more economical
- deleted 3mo ago[deleted]
- pixl97 3mo agoWhat is the economic cost of having your data monitored by external sources?