3 ms·

Apple should really jump on this and support teams working on local LLMs.

• Tepix 4y ago
  Have you seen this? https://github.com/apple/ml-ane-transformers https://github.com/apple/ml-ane-transformers
  • omneity 4y ago
    Yes and it's definitely a step in the right direction. It's beyond me whether this is enough of an effort to support the current LLM movement. I expect Apple to be more proactive in these regards to capture the minds of a lightning-fast growing market increasingly slipping through its control (ChatGPT can be accessed from anywhere) and offer more incentives to developers, co-marketing being the lowest starting point.. probably something they're already working on and we didn't see the results of yet.
• j45 4y ago
  It hard not to wonder if some of today llm use cases weren’t kept in mind on the current Apple Silicon roadmap.