3 ms·
What is on offer optimized for running these LLMs?
by Tostino 3y ago
What is on offer optimized for running these LLMs?
- wyldfire 3y agoThe hexagon NSP is reasonably well suited for running ML in general. I know it's used for some image/CV use cases and I think it will work well for language models, but maybe suboptimal for the recent large ones. This processor shows up in both snapdragon SoCs and cloud ai 100.