4 ms·
Apple letting Siri stagnate for so many years is such a shame. I do wonder what foundation model Apple will eventually use. Both training their own as well as
by yellow_postit 3y ago
Apple letting Siri stagnate for so many years is such a shame.
I do wonder what foundation model Apple will eventually use.
Both training their own as well as licensing a 3P one seem at odds with their claimed data privacy stance.
My bet though is a licensed 3p model that’s fine tuned locally with on device data.
- freedomben 3y agoDon't have a link right now, but I read earlier they have a model developed internally already called colloquially "Apple GPT" that (supposedly) rivals OpenAI in parameter size, etc. They'll release a hardware co-processor similar to Google's when they're ready to ship this.
- yellow_postit 3y agoI saw that too but what data did they train on? iMessage, apple photos, Siri inputs? These all seem problematic beyond the standard open crawl type datasets. They don’t have a web search corpus.
- MBCook 3y agoThey could’ve gotten a corpus somehow. Maybe they licensed it from someone, maybe they do have a crawler. It’s a very good question though. That could make all the difference, huh.