4 ms·

It’d be short sighted to not have a wrapper around which AI to use, even without implementation for them. Like, having an abstract parent class with a Siri imp

by taybin 13d ago

It’d be short sighted to not have a wrapper around which AI to use, even without implementation for them. Like, having an abstract parent class with a Siri implementation of it would be baseline good software engineering.

Someone1234 12d ago
Yeah; plus we know they're designing with potential future local-only Vs. hybrid Vs. cloud-only in mind depending on hardware/market changes. So having it be this flexible buys them a ton of future potential. People have speculated that with FPGAs or even an ASIC you could take some smaller models we have today, turn the chip into essentially that model-as-hardware, and get some really compelling performance/power-usage characteristics. At that point running a GOOD quantized Q8 model on a phone is not beyond the realm.
- donbox 12d ago
  Maybe we would get LLMs on (pluggable) cartridges.
  - pvtmert 12d ago
    May happen with Android, not going to happen on $AAPL devices... Heck, even the battery is non-swappable!
    - juiceland 12d ago
      This is such a funny comment. I’d been hearing about the un-repairability of Apple products for years and I believed it. Then I went to Shenzhen and walked past an entire floor of individuals doing all sorts of “impossible” repairs right in front of the customer.
      - fragmede 12d ago
        That's "despite", not "because of" Apple.
      - dlkasajiewo 12d ago
        My speculation: "impossible" repairs work a lot better when you buy replacements parts for near-market price from a competitively priced seller next door, rather than having to order your parts online from one of a handful of distributors substantially upcharging even for the off-brand version.
      - fennecbutt 12d ago
        Tbf that's where many of the phones stolen by muggers in western countries ultimately end up.
  - fennecbutt 12d ago
    Yes, it's very Gibson. That's what I was hoping for with Taalas, ultimately ending up with a microsd-ish card that's hot swappable intelligence.
Grombobulous 12d ago
I’m not even sure how they would implement these features without them being interoperable. All the AI systems use pretty similar if not identical API standards.
tiffanyh 12d ago
And given how Apple switched out OpenAI for Gemini (to power Siri), they experienced firsthand the importance of having said wrapper.
dd8601fn 12d ago
That exists already for Apple devices. They just never give third party models first class access to user and device data. That arrangement will change, somewhat, later today.

by taybin 13d ago

Someone1234 12d ago

Yeah; plus we know they're designing with potential future local-only Vs. hybrid Vs. cloud-only in mind depending on hardware/market changes. So having it be this flexible buys them a ton of future potential. People have speculated that with FPGAs or even an ASIC you could take some smaller models we have today, turn the chip into essentially that model-as-hardware, and get some really compelling performance/power-usage characteristics. At that point running a GOOD quantized Q8 model on a phone is not beyond the realm.

donbox 12d ago
Maybe we would get LLMs on (pluggable) cartridges.
- pvtmert 12d ago
  May happen with Android, not going to happen on $AAPL devices... Heck, even the battery is non-swappable!
  - juiceland 12d ago
    This is such a funny comment. I’d been hearing about the un-repairability of Apple products for years and I believed it. Then I went to Shenzhen and walked past an entire floor of individuals doing all sorts of “impossible” repairs right in front of the customer.
    - fragmede 12d ago
      That's "despite", not "because of" Apple.
    - dlkasajiewo 12d ago
      My speculation: "impossible" repairs work a lot better when you buy replacements parts for near-market price from a competitively priced seller next door, rather than having to order your parts online from one of a handful of distributors substantially upcharging even for the off-brand version.
    - fennecbutt 12d ago
      Tbf that's where many of the phones stolen by muggers in western countries ultimately end up.
- fennecbutt 12d ago
  Yes, it's very Gibson. That's what I was hoping for with Taalas, ultimately ending up with a microsd-ish card that's hot swappable intelligence.

Grombobulous 12d ago

I’m not even sure how they would implement these features without them being interoperable. All the AI systems use pretty similar if not identical API standards.

tiffanyh 12d ago

And given how Apple switched out OpenAI for Gemini (to power Siri), they experienced firsthand the importance of having said wrapper.

dd8601fn 12d ago

That exists already for Apple devices. They just never give third party models first class access to user and device data. That arrangement will change, somewhat, later today.