2 ms·
> The most private AI is the one running on my own hardware, not in some giant data center. I want that too, but you gotta ask yourself the question how effici
by amelius 2mo ago
> The most private AI is the one running on my own hardware, not in some giant data center.
I want that too, but you gotta ask yourself the question how efficient that is compared to running it in a datacenter shared with everybody else.
- lupire 2mo agoIt doesn't matter how efficient it is because the user base for that workflow is microscopic
- adgjlsfhk1 2mo agoit's more efficient than paying 1000x for fhe
- Chris2048 2mo agoEnergy efficient, yes, but when you want to keep a query/data private it's maybe worth the extra $ KW. Chicken pie recipes and google AI-search can still go though the datacentres. As an aside: The computation might also not be the same e.g. ever-changing hidden pre-prompts, security/safety checks blocking or degrading responses, unavoidable verbosity to simple questions, watermarking, collection of prompt data to build user profiles for the purpose of advertising - and we haven't even seen in-response adverts, or sponsor-biased responses yet, but no doubt it's coming.