3 ms·
The work involved probably includes porting to the Snapdragon NSP for throughput and efficiency's sake. For LLMs the biggest challenge is addressing such a lar
by wyldfire 3y ago
The work involved probably includes porting to the Snapdragon NSP for throughput and efficiency's sake.
For LLMs the biggest challenge is addressing such a large model - or finding a balance between the model size and its capability on a mobile device.