3 ms·
Yeah; plus we know they're designing with potential future local-only Vs. hybrid Vs. cloud-only in mind depending on hardware/market changes. So having it be th
by Someone1234 12d ago
Yeah; plus we know they're designing with potential future local-only Vs. hybrid Vs. cloud-only in mind depending on hardware/market changes. So having it be this flexible buys them a ton of future potential.
People have speculated that with FPGAs or even an ASIC you could take some smaller models we have today, turn the chip into essentially that model-as-hardware, and get some really compelling performance/power-usage characteristics.
At that point running a GOOD quantized Q8 model on a phone is not beyond the realm.
- donbox 12d agoMaybe we would get LLMs on (pluggable) cartridges.
- pvtmert 12d agoMay happen with Android, not going to happen on $AAPL devices... Heck, even the battery is non-swappable!
- juiceland 12d agoThis is such a funny comment. I’d been hearing about the un-repairability of Apple products for years and I believed it. Then I went to Shenzhen and walked past an entire floor of individuals doing all sorts of “impossible” repairs right in front of the customer.
- fragmede 12d agoThat's "despite", not "because of" Apple.
- dlkasajiewo 12d agoMy speculation: "impossible" repairs work a lot better when you buy replacements parts for near-market price from a competitively priced seller next door, rather than having to order your parts online from one of a handful of distributors substantially upcharging even for the off-brand version.
- fennecbutt 12d agoTbf that's where many of the phones stolen by muggers in western countries ultimately end up.
- fennecbutt 12d agoYes, it's very Gibson. That's what I was hoping for with Taalas, ultimately ending up with a microsd-ish card that's hot swappable intelligence.