4 ms·

i think you're overlooking iOS instances with "neural" accelerators in the pockets of the people in those corporations.

• elorant 3y ago
  And how will that materialize? Will Apple build a new AI chip that would be affordable enough to embed in every iPhone, or whatever new device they will invent? Or will it all be cloud based where it should be able to support hundreds of millions of users? Microsoft already has the cloud infrastructure ready. They don't need to build a new device, or a new operating system, or whatever. They're milking the AI cow as we speak.
  • jjtheblunt 3y ago
    Apple has had "AI chips" in the iOS devices for years already. I wonder what you define as an AI chip, though, since we could be discussing different sorts of custom accelerators.
    • elorant 3y ago
      Look at what a company called Groq does. Their chip can generate 500 tokens/second from a model like Llama 2 70b. https://groq.com/ https://groq.com/