5 ms·
OP Here. It is my firm belief that the only realistic use of AI in the future is either locally on-device for almost free, or in the cloud but way more expensiv
by janandonly 7mo ago
OP Here. It is my firm belief that the only realistic use of AI in the future is either locally on-device for almost free, or in the cloud but way more expensive then it is today.
The latter option will only bemusedly for tasks that humans are more expensive or much slower in.
This Gemma 4 model gives me hope for a future Siri or other with iPhone and macOS integration, “Her” (as in the movie) style.
- kennywinker 7mo agoDid you really watch “Her” and think this is a future that should happen?? Seriously????
- deleted 7mo ago[deleted]
- jfreds 7mo agoI don’t think OP’s point has anything to do with AI companions. The big benefit of moving compute to edge devices is to distribute the inference load on the grid. Powering and cooling phones is a lot easier than powering and cooling a datacenter
- kennywinker 7mo agoLocal ai is probably a good direction, i agree. But there was a part of their point that had to do with ai companions: the bit where they say we are closer to “her”-like ai companions. That was the bit i was responding to.
- sambapa 7mo agoTorment Nexus sounds fun
- kennywinker 7mo agoWatch out! We got an info hazard here! Danger danger
- aninteger 7mo agoHaving Scarlett Johansson's voice might not be so bad or even something less robotic.
- deleted 7mo ago[deleted]
- kennywinker 7mo agoThat happened already, in typical ai fashion: blatant theft https://www.nbcnews.com/tech/scarlett-johansson-legal-action-ai-app-rcna123248 https://www.nbcnews.com/tech/scarlett-johansson-legal-action...
- nothinkjustai 7mo ago[flagged]
- kennywinker 7mo agoDo you genuinely think a “frequency” is what makes a human voice recognizable? That’s like using someone’s face in an app and then saying “how can you steal pixels?”
- nothinkjustai 7mo ago[flagged]
- kennywinker 7mo agoYou can’t steal pixels or frequencies. But you can use someone’s image or their voice to sell your product without their permission. You can get all existential about it if you want - I just know that if someone used my face or my voice to shill for a product without my permission i’d be pissed. I’m pretty sure you would be too.
- 7mo ago
- esafak 7mo agoUnfortunately, one man's dystopia is another's utopia.
- satvikpendem 7mo agoWhat does what they said have anything to do with Her? Local LLMs are better than big corporations owning your data and offering LLMs for a huge cost.
- kennywinker 7mo agoI get the local ai thing. I agree it’s probably a good direction. The bit that has to do with the movie “her” is the bit at the end where they are excited about “her”-like companions on our phones.
- teolandon 7mo agoThey literally mentioned Her 2013 at the end of their comment.
- 0dayman 7mo agothis is not that first step towards your dream
- crazygringo 7mo ago> or in the cloud but way more expensive then it is today. Why? It's widely understood that the big players are making profit on inference. The only reason they still have losses is because training is so expensive, but you need to do that no matter whether the models are running in the cloud or on your device. If you think about it, it's always going to be cheaper and more energy-efficient to have dedicated cloud hardware to run models. Running them on your phone, even if possible, is just going to suck up your battery life.
- nothinkjustai 7mo ago> It's widely understood that the big players are making profit on inference. Are they? Or are they just saying that to make their offerings more attractive to investors? Plus I think most people using agents for coding are using subscriptions which they are definitely not profitable in. Locally running models that are snappy and mostly as capable as current sota models would be a dream. No internet connection required, no payment plans or relying on a third party provider to do your job. No privacy concerns. Etc etc.
- zozbot234 7mo agoYou can pick models that are snappy, or models that are as capable as SOTA. You don't really get both unless you spend extremely unreasonable amounts of money on what is essentially a datacenter-scale inference platform of your own, meant to service hundreds of users at once. (I don't care how many agent harnesses you spin up at once, you aren't going to get the same utilization as hundreds of concurrent users.) This assessment might change if local AI frameworks start working seriously on support for tensor-parallel distributed inference, then you might get away with cheaper homelab-class hardware and only mildly unreasonable amounts of money.
- nl 7mo ago> Plus I think most people using agents for coding are using subscriptions which they are definitely not profitable in. Where on earth do people get this idea? Subscriptions that are based around obscure, vendor defined "credits" are the perfect business model for vendors. They can change the amount you can use whenever they want. It's likely they occasionally make a loss on some users but in general they are highly profitable for AI companies: > Anthropic last month projected it would generate a 40% gross profit margin from selling AI to businesses and application developers in 2025 and > OpenAI projected a gross margin of around 46% in 2025, including inference costs of both paying and nonpaying ChatGPT users. https://archive.is/aKFYZ#selection-1075.0-1083.119 https://archive.is/aKFYZ#selection-1075.0-1083.119
- amelius 7mo agoA local model running on a phone owned and controlled by the vendor is still not really exciting, imho. It may be physically "local" but not in spirit.
- _pdp_ 7mo agoIf you can run free models on consumer devices why do you think cloud providers cannot do the same except better and bundled with a tone of value worth paying?