4 ms·
They are going to want to start putting more RAM in their machines then or they are going to find it a bit tricky to compete given how big even moderate AI is.
by PaulKeeble 3y ago
They are going to want to start putting more RAM in their machines then or they are going to find it a bit tricky to compete given how big even moderate AI is.
- freedomben 3y agoThey will ship hardware (a new iphone for example) that has a co-processor and flash storage dedicated to the Apple model (which many are calling Apple GPT). They aren't going to make it easy to run your own model. That's completely against their style
- MBCook 3y agoThey already allow that. There are apps in the store doing that.
- freedomben 3y agoThere are apps in the app store that are allowed to use the new co-processor that I'm predicting they'll develop? That seems physically impossible since it doesn't exist yet.
- MBCook 3y agoThe Neural Engine was added in the like the A11 a few years ago.
- MBCook 3y agoThey did publish that paper the other day explaining how to use less RAM, but you’re right it’s still a big chunk.