4 ms·
Most consumers do not care about reprogramming or fine-tuning and have no idea what NPU is. For many (including specifically those who still mourn dead AI compa
by ivan_gammel 8mo ago
Most consumers do not care about reprogramming or fine-tuning and have no idea what NPU is. For many (including specifically those who still mourn dead AI companions, killed by 4o switch) the long term stability is much more important than benchmark performance of evergreen frontier model. If Taalas can produce a good hardwired model at scale at consumer market price point, a lot of people will just drop their AI subscriptions.
- bigyabai 8mo ago> a lot of people will just drop their AI subscriptions. For a 2.5 kW Server? I don't see it happening, your money and electricity is better spent on CUDA compute.
- ivan_gammel 8mo ago>For a 2.5 kW Server? I don’t see any reason why this should not drop to 100-300W at peak with maybe 100W*h of daily usage on smartphones.