3 ms·
Apple has had "AI chips" in the iOS devices for years already. I wonder what you define as an AI chip, though, since we could be discussing different sorts of
by jjtheblunt 3y ago
Apple has had "AI chips" in the iOS devices for years already. I wonder what you define as an AI chip, though, since we could be discussing different sorts of custom accelerators.
- elorant 3y agoLook at what a company called Groq does. Their chip can generate 500 tokens/second from a model like Llama 2 70b. https://groq.com/ https://groq.com/