2 ms·
And how will that materialize? Will Apple build a new AI chip that would be affordable enough to embed in every iPhone, or whatever new device they will invent?
by elorant 3y ago
And how will that materialize? Will Apple build a new AI chip that would be affordable enough to embed in every iPhone, or whatever new device they will invent? Or will it all be cloud based where it should be able to support hundreds of millions of users?
Microsoft already has the cloud infrastructure ready. They don't need to build a new device, or a new operating system, or whatever. They're milking the AI cow as we speak.
- jjtheblunt 3y agoApple has had "AI chips" in the iOS devices for years already. I wonder what you define as an AI chip, though, since we could be discussing different sorts of custom accelerators.
- elorant 3y agoLook at what a company called Groq does. Their chip can generate 500 tokens/second from a model like Llama 2 70b. https://groq.com/ https://groq.com/